Jul 06 12:02:22.659374 ip-10-0-138-36 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 12:02:22.659384 ip-10-0-138-36 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 12:02:22.659390 ip-10-0-138-36 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 12:02:22.659632 ip-10-0-138-36 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 12:02:33.752372 ip-10-0-138-36 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 12:02:33.752390 ip-10-0-138-36 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c1b94b78fcc44c688d219270a683bb46 -- Jul 06 12:04:13.914312 ip-10-0-138-36 systemd[1]: Starting Kubernetes Kubelet... Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.331343 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337742 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337755 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337759 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337762 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337765 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337768 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337771 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:14.452711 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337774 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337777 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337780 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337782 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337785 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337787 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337790 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337793 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337795 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337798 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337800 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337802 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337805 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337807 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337809 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337812 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337814 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337817 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337819 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337822 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:14.464847 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337824 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:14.409906 ip-10-0-138-36 systemd[1]: Started Kubernetes Kubelet. Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337830 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337833 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337835 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337838 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337840 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337843 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337845 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337848 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337851 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337853 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337855 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337858 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337860 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337863 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337866 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337868 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337871 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337873 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337876 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:14.467014 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337879 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337881 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337883 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337886 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337889 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337891 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337893 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337898 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337901 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337904 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337907 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337910 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337913 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337916 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337918 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337922 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337925 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337928 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337930 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:14.481229 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337934 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337938 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337941 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337943 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337946 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337949 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337952 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337954 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337957 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337959 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337964 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337968 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337971 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337973 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337976 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337978 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337980 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337983 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337986 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337988 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:14.484456 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337991 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337993 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337995 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.337998 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338000 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338004 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338006 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338009 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338011 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338014 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338016 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338035 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338038 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338718 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338725 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338728 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338731 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338734 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338736 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338739 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:14.486649 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338742 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338745 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338747 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338751 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338753 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338758 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338762 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338765 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338768 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338771 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338776 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338779 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338782 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338785 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338788 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338791 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338793 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338796 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338798 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:14.488440 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338801 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338804 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338807 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338809 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338812 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338814 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338817 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338819 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338822 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338824 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338827 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338829 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338831 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338834 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338836 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338838 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338841 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338843 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338847 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338849 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:14.490782 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338852 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338855 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338857 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338861 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338865 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338867 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338870 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338872 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338875 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338878 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338881 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338884 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338886 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338888 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338891 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338893 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338895 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338898 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338900 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:14.492591 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338903 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338906 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338908 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338911 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338913 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338916 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338918 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338920 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338923 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338925 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338927 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338930 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338933 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338935 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338938 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338941 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338943 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338945 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338948 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338951 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:14.494750 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338954 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338956 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338958 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338961 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338963 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338966 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338968 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338970 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338972 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338975 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338977 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338979 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338982 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.338985 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339409 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339416 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339419 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339423 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339426 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339428 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:14.496469 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339431 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339433 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339436 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339442 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339445 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339448 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339451 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339454 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339457 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339459 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339463 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339466 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339469 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339472 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339474 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339477 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339479 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339482 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339484 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:14.498808 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339486 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339489 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339491 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339494 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339497 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339502 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339506 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339509 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339512 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339515 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339517 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339519 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339522 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339524 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339527 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339529 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339532 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339534 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339537 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339539 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:14.501094 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339542 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339544 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339547 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339549 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339552 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339554 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339557 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339559 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339562 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339564 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339566 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339569 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339571 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339574 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339576 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339579 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339581 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339587 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339589 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339592 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:14.650621 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339605 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339609 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339612 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339615 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339618 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339620 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339623 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339626 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339628 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339631 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339633 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339636 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339638 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339641 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339643 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339646 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339648 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339651 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339654 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339657 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:14.651394 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339659 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339662 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339664 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339669 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339672 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339675 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339677 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339679 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339682 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339686 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339688 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339691 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339695 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.339700 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339769 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339775 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339782 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339786 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339790 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339795 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339801 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 12:04:14.651996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339807 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339811 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339816 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339820 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339823 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339826 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339829 2581 flags.go:64] FLAG: --cgroup-root="" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339832 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339835 2581 flags.go:64] FLAG: --client-ca-file="" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339839 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339842 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339846 2581 flags.go:64] FLAG: --cluster-domain="" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339848 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339851 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339854 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339857 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339861 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339864 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339867 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339870 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339875 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339878 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339881 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339884 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 12:04:14.652606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339888 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339892 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339894 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339897 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339900 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339903 2581 flags.go:64] FLAG: --enable-server="true" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339906 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339910 2581 flags.go:64] FLAG: --event-burst="100" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339913 2581 flags.go:64] FLAG: --event-qps="50" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339915 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339918 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339921 2581 flags.go:64] FLAG: --eviction-hard="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339924 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339927 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339930 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339933 2581 flags.go:64] FLAG: --eviction-soft="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339935 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339938 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339946 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339949 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339952 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339955 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339958 2581 flags.go:64] FLAG: --feature-gates="" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339961 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339964 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 12:04:14.653329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339967 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339970 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339973 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339977 2581 flags.go:64] FLAG: --help="false" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339980 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339982 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339985 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339989 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339993 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339996 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.339999 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340002 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340005 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340007 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340010 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340013 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340016 2581 flags.go:64] FLAG: --kube-reserved="" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340032 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340035 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340038 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340041 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340044 2581 flags.go:64] FLAG: --lock-file="" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340047 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340050 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 12:04:14.654367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340052 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340063 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340066 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340069 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340071 2581 flags.go:64] FLAG: --logging-format="text" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340074 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340078 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340080 2581 flags.go:64] FLAG: --manifest-url="" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340083 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340087 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340090 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340096 2581 flags.go:64] FLAG: --max-pods="110" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340099 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340102 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340104 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340109 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340112 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340115 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340118 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340125 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340128 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340131 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340133 2581 flags.go:64] FLAG: --pod-cidr="" Jul 06 12:04:14.655385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340136 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340142 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340144 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340147 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340150 2581 flags.go:64] FLAG: --port="10250" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340153 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340156 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d3fba8874f8e92fe" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340159 2581 flags.go:64] FLAG: --qos-reserved="" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340161 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340165 2581 flags.go:64] FLAG: --register-node="true" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340167 2581 flags.go:64] FLAG: --register-with-taints="" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340170 2581 flags.go:64] FLAG: --registry-burst="10" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340174 2581 flags.go:64] FLAG: --registry-qps="5" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340176 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340180 2581 flags.go:64] FLAG: --reserved-memory="" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340183 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340186 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340189 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340191 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340194 2581 flags.go:64] FLAG: --runonce="false" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340197 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340202 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340204 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340207 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340211 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340214 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 12:04:14.657163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340217 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340220 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340222 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340225 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340228 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340231 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340234 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340236 2581 flags.go:64] FLAG: --system-cgroups="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340239 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340245 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340247 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340250 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340256 2581 flags.go:64] FLAG: --tls-min-version="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340258 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340261 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340264 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340266 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340269 2581 flags.go:64] FLAG: --v="2" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340273 2581 flags.go:64] FLAG: --version="false" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340277 2581 flags.go:64] FLAG: --vmodule="" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340281 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.340284 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340399 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340403 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:14.657861 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340406 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340409 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340411 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340415 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340418 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340420 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340424 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340426 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340429 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340432 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340434 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340437 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340439 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340442 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340444 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340447 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340449 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340452 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340454 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340457 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:14.659207 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340459 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340462 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340464 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340466 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340469 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340473 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340476 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340479 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340482 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340485 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340487 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340490 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340492 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340495 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340497 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340501 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340504 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340506 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:14.659776 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340513 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340515 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340517 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340520 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340522 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340525 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340527 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340530 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340532 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340535 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340537 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340540 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340543 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340545 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340547 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340550 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340552 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340556 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340559 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:14.803372 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340562 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340565 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340567 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340570 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340572 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340575 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340577 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340579 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340582 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340585 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340588 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340590 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340595 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340598 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340600 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340603 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340606 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340609 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340612 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340616 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:14.804077 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340619 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340622 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340624 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340627 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340629 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340632 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340634 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340637 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340640 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340643 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340645 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340647 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340650 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340652 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340655 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340657 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340660 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340663 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:14.804679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.340665 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.341591 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.348747 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.348764 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.348781 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.348791 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348845 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348850 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348853 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348856 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348859 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348863 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348865 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348868 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348871 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:14.805212 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348873 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348876 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348879 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348881 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348884 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348886 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348889 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348891 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348894 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348896 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348899 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348902 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348904 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348907 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348910 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348912 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348915 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348917 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348920 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348923 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:14.805622 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348926 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348929 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348931 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348934 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348936 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348938 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348941 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348944 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348946 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348949 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348951 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348953 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348956 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348958 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348961 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348963 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348965 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348968 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348970 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348973 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:14.806189 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348975 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348977 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348980 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348986 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348988 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348991 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348993 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348996 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.348998 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349001 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349003 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349006 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349008 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349011 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349014 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349036 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349064 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349067 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349071 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:14.806696 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349073 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349076 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349079 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349082 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349085 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349087 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349090 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349093 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349095 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349098 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349100 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349103 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349105 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349108 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349111 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349114 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349116 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349119 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349121 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349124 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:14.807254 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349127 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349129 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349132 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349134 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349138 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349142 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349145 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349150 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349154 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349159 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349161 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.349167 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349275 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349279 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 12:04:14.807799 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349282 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349285 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349288 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349291 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349294 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349296 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349299 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349302 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349305 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349307 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349310 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349314 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349317 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349320 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349323 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349325 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349329 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349332 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349335 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 12:04:14.808248 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349338 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349342 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349345 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349348 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349351 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349354 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349357 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349360 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349363 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349366 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349368 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349371 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349373 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349376 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349378 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349380 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349383 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349385 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349388 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349390 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 12:04:14.808737 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349392 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349395 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349397 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349399 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349403 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349406 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349409 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349411 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349414 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349416 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349419 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349421 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349424 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349426 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349429 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349431 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349433 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349436 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349438 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349442 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 12:04:14.809293 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349445 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349448 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349450 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349454 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349457 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349460 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349463 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349465 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349468 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349471 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349473 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349475 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349478 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349480 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349483 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349485 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349489 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349491 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349494 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 12:04:14.809816 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349496 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349499 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349501 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349503 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349506 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349508 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349510 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349513 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349515 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349518 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349521 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349523 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349527 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349529 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349535 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349538 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349540 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349543 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 12:04:14.810357 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:14.349545 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.349550 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.349655 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.353861 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.356594 2581 server.go:1019] "Starting client certificate rotation" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.356690 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.356724 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.359365 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.361712 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.373129 2581 log.go:25] "Validated CRI v1 runtime API" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.376567 2581 log.go:25] "Validated CRI v1 image API" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.377340 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 12:04:14.810807 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.380673 2581 fs.go:135] Filesystem UUIDs: map[47fce5c7-9284-4d87-8704-16a9def6e957:/dev/nvme0n1p3 5c3dfd8f-25f4-4355-92f7-e6d7a958b525:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 06 12:04:14.811194 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.380688 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.387364 2581 manager.go:216] Machine: {Timestamp:2026-07-06 12:04:14.384626165 +0000 UTC m=+0.362391951 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3203159 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2895391a80ab6cb1064cd3356620ef SystemUUID:ec289539-1a80-ab6c-b106-4cd3356620ef BootID:c1b94b78-fcc4-4c68-8d21-9270a683bb46 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:61:5a:df:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:61:5a:df:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:26:a7:29:b1:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.387474 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.387554 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.391030 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.391053 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.391948 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.391958 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 12:04:14.811295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.391965 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.392488 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.392689 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.394584 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399163 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399267 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399295 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399310 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399324 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399338 2581 kubelet.go:398] "Adding apiserver pod source" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399348 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399668 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.399691 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.402087 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.404545 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.404571 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.405958 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.405973 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.405979 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.405985 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.405994 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.405999 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406006 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406011 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406017 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406037 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406051 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406056 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406079 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.406084 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.409118 2581 server.go:1268] "Started kubelet" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.409200 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.409226 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.409280 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.410204 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.410535 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.410577 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.414290 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.414505 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 12:04:14.811603 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.417216 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.420147 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-36.ec2.internal.18bfb1c905fe38c0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-36.ec2.internal,UID:ip-10-0-138-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-36.ec2.internal,},FirstTimestamp:2026-07-06 12:04:14.40909536 +0000 UTC m=+0.386861147,LastTimestamp:2026-07-06 12:04:14.40909536 +0000 UTC m=+0.386861147,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-36.ec2.internal,}" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.421307 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.421324 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.421375 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422055 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422260 2581 factory.go:55] Registering systemd factory Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422275 2581 factory.go:223] Registration of the systemd container factory successfully Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422498 2581 factory.go:153] Registering CRI-O factory Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422509 2581 factory.go:223] Registration of the crio container factory successfully Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422556 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422578 2581 factory.go:103] Registering Raw factory Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422591 2581 manager.go:1196] Started watching for new ooms in manager Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.422957 2581 manager.go:349] Starting recovery of all containers Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.423159 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.423186 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.423345 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.423352 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.428509 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.428665 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.432660 2581 manager.go:354] Recovery completed Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.437267 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.438906 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.438940 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.438952 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.439446 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.439455 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.439469 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.439515 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.440125 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.440147 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.812905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.440159 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.441272 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-36.ec2.internal.18bfb1c907c565da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-36.ec2.internal,UID:ip-10-0-138-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-36.ec2.internal,},FirstTimestamp:2026-07-06 12:04:14.438925786 +0000 UTC m=+0.416691573,LastTimestamp:2026-07-06 12:04:14.438925786 +0000 UTC m=+0.416691573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-36.ec2.internal,}" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.441645 2581 policy_none.go:49] "None policy: Start" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.441657 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.441667 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.443618 2581 policy_none.go:47] "Start" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.453850 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-36.ec2.internal.18bfb1c907c5b7be default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-36.ec2.internal,UID:ip-10-0-138-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-36.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-36.ec2.internal,},FirstTimestamp:2026-07-06 12:04:14.43894675 +0000 UTC m=+0.416712538,LastTimestamp:2026-07-06 12:04:14.43894675 +0000 UTC m=+0.416712538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-36.ec2.internal,}" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.457234 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9jl9k" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.469992 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9jl9k" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.471863 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-36.ec2.internal.18bfb1c907c5dd3d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-36.ec2.internal,UID:ip-10-0-138-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-36.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-36.ec2.internal,},FirstTimestamp:2026-07-06 12:04:14.438956349 +0000 UTC m=+0.416722136,LastTimestamp:2026-07-06 12:04:14.438956349 +0000 UTC m=+0.416722136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-36.ec2.internal,}" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.521468 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524261 2581 manager.go:337] "Starting Device Plugin manager" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.524289 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524301 2581 server.go:87] "Starting device plugin registration server" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524591 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524605 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524700 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524770 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.524777 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.525225 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 12:04:14.813762 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.525289 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.613489 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.614657 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.614692 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.614715 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.614746 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.619735 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.625618 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.626450 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.626478 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.626487 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.626508 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.640050 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.640069 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-36.ec2.internal\": node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.707079 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.715120 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal"] Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.715187 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.716324 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.716350 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.716359 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.718640 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.718739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.718762 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.719269 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.719291 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.719300 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.719398 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.719609 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.719821 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.721667 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.721691 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:14.973227 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.723584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71da5c5a834b0330f878adb624359a1d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-36.ec2.internal\" (UID: \"71da5c5a834b0330f878adb624359a1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.723612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a0986dce90a04fe143b1afcf7a6c69e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal\" (UID: \"3a0986dce90a04fe143b1afcf7a6c69e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.723647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0986dce90a04fe143b1afcf7a6c69e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal\" (UID: \"3a0986dce90a04fe143b1afcf7a6c69e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.724116 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.724142 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.724151 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.758586 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-36.ec2.internal\" not found" node="ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.762980 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-36.ec2.internal\" not found" node="ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.807320 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.824060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a0986dce90a04fe143b1afcf7a6c69e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal\" (UID: \"3a0986dce90a04fe143b1afcf7a6c69e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.824082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0986dce90a04fe143b1afcf7a6c69e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal\" (UID: \"3a0986dce90a04fe143b1afcf7a6c69e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.824099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71da5c5a834b0330f878adb624359a1d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-36.ec2.internal\" (UID: \"71da5c5a834b0330f878adb624359a1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.824137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71da5c5a834b0330f878adb624359a1d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-36.ec2.internal\" (UID: \"71da5c5a834b0330f878adb624359a1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.824155 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a0986dce90a04fe143b1afcf7a6c69e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal\" (UID: \"3a0986dce90a04fe143b1afcf7a6c69e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:14.824169 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a0986dce90a04fe143b1afcf7a6c69e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal\" (UID: \"3a0986dce90a04fe143b1afcf7a6c69e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:14.974101 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:14.908201 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:15.142688 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:15.009064 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:15.142688 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:15.061496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:15.142688 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:15.066233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" Jul 06 12:04:15.142688 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:15.109597 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:15.301653 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:15.210147 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:16.733109 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:15.310606 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:16.733109 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:15.356144 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 12:04:16.733109 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:15.356313 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 12:04:16.733109 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:15.411586 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:16.735620 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.735327 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 11:59:15 +0000 UTC" deadline="2028-04-16 06:31:29.554863728 +0000 UTC" Jul 06 12:04:16.735620 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.735365 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15594h27m12.819502023s" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.767469 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.768345 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientMemory" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.768368 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.768381 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeHasSufficientPID" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:16.768670 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:16.807186 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:16.893482 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:16.869180 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:17.030414 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:16.970093 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-36.ec2.internal\" not found" Jul 06 12:04:17.030414 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.028350 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:17.183654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.079188 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" Jul 06 12:04:17.183654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.090658 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:04:17.183654 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:17.095745 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0986dce90a04fe143b1afcf7a6c69e.slice/crio-15ee23084f067ee4b5e078b0433e6064a03318e68307d7d27a6c2f1107f80bbb WatchSource:0}: Error finding container 15ee23084f067ee4b5e078b0433e6064a03318e68307d7d27a6c2f1107f80bbb: Status 404 returned error can't find the container with id 15ee23084f067ee4b5e078b0433e6064a03318e68307d7d27a6c2f1107f80bbb Jul 06 12:04:17.183654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.124434 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 12:04:17.183654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.125347 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" Jul 06 12:04:17.183654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.161764 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 12:04:17.362375 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.237228 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:17.669202 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.657603 2581 apiserver.go:52] "Watching apiserver" Jul 06 12:04:17.669202 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.664880 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 12:04:17.669202 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.665896 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jpzwm","kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nbq6g","openshift-image-registry/node-ca-8qm75","openshift-network-diagnostics/network-check-target-mk5zf","openshift-network-operator/iptables-alerter-7qrqb","openshift-ovn-kubernetes/ovnkube-node-q68gp","kube-system/konnectivity-agent-hz7cp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx","openshift-dns/node-resolver-bqb6h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal","openshift-multus/multus-additional-cni-plugins-zhvxw","openshift-multus/multus-hpds8","openshift-multus/network-metrics-daemon-9t74n"] Jul 06 12:04:17.669202 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.668848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.671420 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.671046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.673428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.675545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.677853 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.677926 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.680484 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.680613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.682727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.682781 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.684848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.687212 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.687283 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688546 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688599 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688618 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688552 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tvnj7\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688694 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688731 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688943 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.688970 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.689349 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.689559 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.689599 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.689605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.689622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.689778 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.798559 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690211 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ts549\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690223 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-sys\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-var-lib-kubelet\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690406 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690420 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nrzs4\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfqkr\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690470 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5x5n\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-host\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690473 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c023631-fafb-4b8d-beb4-7a55321bae79-tmp\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee561c3f-af45-41d7-a7ce-3680040d9761-host\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690648 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r5wv\"" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysctl-d\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-etc-selinux\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-slash\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-node-log\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-env-overrides\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-systemd\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-host-slash\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-kubelet\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-systemd-units\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-log-socket\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-cni-netd\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovnkube-script-lib\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-kubernetes\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.690998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-run-netns\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.801918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovnkube-config\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdks\" (UniqueName: \"kubernetes.io/projected/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-kube-api-access-2hdks\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/526122c7-949b-4d5d-ac90-1643f978892d-dbus\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-iptables-alerter-script\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nttw4\" (UniqueName: \"kubernetes.io/projected/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-kube-api-access-nttw4\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnx7r\" (UniqueName: \"kubernetes.io/projected/ee561c3f-af45-41d7-a7ce-3680040d9761-kube-api-access-cnx7r\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-lib-modules\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhm7s\" (UniqueName: \"kubernetes.io/projected/071a9757-191d-4c39-a4c1-36acdb331f80-kube-api-access-xhm7s\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/526122c7-949b-4d5d-ac90-1643f978892d-kubelet-config\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee561c3f-af45-41d7-a7ce-3680040d9761-serviceca\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfcbk\" (UniqueName: \"kubernetes.io/projected/2c023631-fafb-4b8d-beb4-7a55321bae79-kube-api-access-pfcbk\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.960433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-registration-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-device-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-etc-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-cni-bin\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691464 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-run\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-tuned\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-var-lib-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovn-node-metrics-cert\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysconfig\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysctl-conf\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-sys-fs\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-systemd\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-ovn\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.960935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-socket-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-modprobe-d\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.691951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.698684 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.699591 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.699673 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.703749 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.703748 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.703876 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.703935 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.704046 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.704130 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.704305 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nttvz\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.704608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lkppq\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.704616 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.705731 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhttf\"" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.711445 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.731573 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4rrdp" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.739531 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4rrdp" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.781002 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nttw4\" (UniqueName: \"kubernetes.io/projected/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-kube-api-access-nttw4\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee561c3f-af45-41d7-a7ce-3680040d9761-serviceca\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfcbk\" (UniqueName: \"kubernetes.io/projected/2c023631-fafb-4b8d-beb4-7a55321bae79-kube-api-access-pfcbk\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.961393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-os-release\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-run\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-tuned\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792748 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-run\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovn-node-metrics-cert\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d2506c1-634c-4289-b429-136d071708a9-cni-binary-copy\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-etc-kubernetes\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysctl-conf\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-sys-fs\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-systemd\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1210dbf-17b6-4f3f-8f12-be26acfcb4b9-agent-certs\") pod \"konnectivity-agent-hz7cp\" (UID: \"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9\") " pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.792992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tc4t\" (UniqueName: \"kubernetes.io/projected/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-kube-api-access-6tc4t\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-os-release\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.962313 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-sys-fs\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-systemd\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793026 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysctl-conf\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-socket-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-modprobe-d\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-host\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793114 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793136 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee561c3f-af45-41d7-a7ce-3680040d9761-serviceca\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-host\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdks\" (UniqueName: \"kubernetes.io/projected/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-kube-api-access-2hdks\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cnibin\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.962768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-modprobe-d\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-socket-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee561c3f-af45-41d7-a7ce-3680040d9761-host\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysctl-d\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee561c3f-af45-41d7-a7ce-3680040d9761-host\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-etc-selinux\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-socket-dir-parent\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-conf-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-etc-selinux\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-host-slash\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793374 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysctl-d\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-kubelet\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793395 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-host-slash\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-log-socket\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.963371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-kubelet\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793460 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-log-socket\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6x8f\" (UniqueName: \"kubernetes.io/projected/3a3278d0-d407-479f-8fec-b83d75a545f0-kube-api-access-b6x8f\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.793493 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-kubernetes\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.793550 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:04:18.293531255 +0000 UTC m=+3.014520074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793563 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793565 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-kubernetes\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72kxs\" (UniqueName: \"kubernetes.io/projected/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-kube-api-access-72kxs\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-system-cni-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.963845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-iptables-alerter-script\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnx7r\" (UniqueName: \"kubernetes.io/projected/ee561c3f-af45-41d7-a7ce-3680040d9761-kube-api-access-cnx7r\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-lib-modules\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhm7s\" (UniqueName: \"kubernetes.io/projected/071a9757-191d-4c39-a4c1-36acdb331f80-kube-api-access-xhm7s\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-cnibin\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-kubelet\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-hostroot\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-registration-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-device-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-etc-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-cni-bin\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fp6h\" (UniqueName: \"kubernetes.io/projected/5d2506c1-634c-4289-b429-136d071708a9-kube-api-access-4fp6h\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793972 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-device-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.964339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793974 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/071a9757-191d-4c39-a4c1-36acdb331f80-registration-dir\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.793988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-var-lib-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794004 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-cni-bin\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-etc-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysconfig\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794047 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-var-lib-openvswitch\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-ovn\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1210dbf-17b6-4f3f-8f12-be26acfcb4b9-konnectivity-ca\") pod \"konnectivity-agent-hz7cp\" (UID: \"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9\") " pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-run-ovn\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-sysconfig\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-cni-multus\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-sys\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.964997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-sys\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-iptables-alerter-script\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-var-lib-kubelet\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c023631-fafb-4b8d-beb4-7a55321bae79-tmp\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-lib-modules\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-node-log\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d2506c1-634c-4289-b429-136d071708a9-multus-daemon-config\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794330 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-var-lib-kubelet\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-slash\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-node-log\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-env-overrides\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovnkube-script-lib\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794389 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-slash\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/526122c7-949b-4d5d-ac90-1643f978892d-kubelet-config\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-hosts-file\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-k8s-cni-cncf-io\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-systemd\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-systemd-units\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794534 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/526122c7-949b-4d5d-ac90-1643f978892d-kubelet-config\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-systemd\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-cni-netd\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/526122c7-949b-4d5d-ac90-1643f978892d-dbus\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794663 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-systemd-units\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-tmp-dir\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-cni-bin\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794769 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-cni-netd\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-multus-certs\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-run-netns\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.965853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-env-overrides\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/526122c7-949b-4d5d-ac90-1643f978892d-dbus\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovnkube-config\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-host-run-netns\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-system-cni-dir\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.794994 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovnkube-script-lib\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.795011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-cni-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.795044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-netns\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.795345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovnkube-config\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.796416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c023631-fafb-4b8d-beb4-7a55321bae79-etc-tuned\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.796537 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-ovn-node-metrics-cert\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.798037 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c023631-fafb-4b8d-beb4-7a55321bae79-tmp\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.803630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nttw4\" (UniqueName: \"kubernetes.io/projected/51f66841-7616-4c49-a5c1-bb2a1cbfd66e-kube-api-access-nttw4\") pod \"iptables-alerter-7qrqb\" (UID: \"51f66841-7616-4c49-a5c1-bb2a1cbfd66e\") " pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.804266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfcbk\" (UniqueName: \"kubernetes.io/projected/2c023631-fafb-4b8d-beb4-7a55321bae79-kube-api-access-pfcbk\") pod \"tuned-nbq6g\" (UID: \"2c023631-fafb-4b8d-beb4-7a55321bae79\") " pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.807357 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:17.966259 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.807371 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.807380 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.807426 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:18.307409382 +0000 UTC m=+3.028398203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.810625 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnx7r\" (UniqueName: \"kubernetes.io/projected/ee561c3f-af45-41d7-a7ce-3680040d9761-kube-api-access-cnx7r\") pod \"node-ca-8qm75\" (UID: \"ee561c3f-af45-41d7-a7ce-3680040d9761\") " pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.810647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdks\" (UniqueName: \"kubernetes.io/projected/bf5027d4-1dbb-4247-8e2f-be7f777e06c9-kube-api-access-2hdks\") pod \"ovnkube-node-q68gp\" (UID: \"bf5027d4-1dbb-4247-8e2f-be7f777e06c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.811002 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhm7s\" (UniqueName: \"kubernetes.io/projected/071a9757-191d-4c39-a4c1-36acdb331f80-kube-api-access-xhm7s\") pod \"aws-ebs-csi-driver-node-fgsqx\" (UID: \"071a9757-191d-4c39-a4c1-36acdb331f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.875776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" event={"ID":"3a0986dce90a04fe143b1afcf7a6c69e","Type":"ContainerStarted","Data":"15ee23084f067ee4b5e078b0433e6064a03318e68307d7d27a6c2f1107f80bbb"} Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.876623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" event={"ID":"71da5c5a834b0330f878adb624359a1d","Type":"ContainerStarted","Data":"6a8482b6f012d8682e7825dcdd7113939dcc724b8824f6b3e0abbf4cda7a8a65"} Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-system-cni-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-cnibin\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-kubelet\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895483 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-kubelet\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-system-cni-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.966642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-hostroot\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fp6h\" (UniqueName: \"kubernetes.io/projected/5d2506c1-634c-4289-b429-136d071708a9-kube-api-access-4fp6h\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895557 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-hostroot\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1210dbf-17b6-4f3f-8f12-be26acfcb4b9-konnectivity-ca\") pod \"konnectivity-agent-hz7cp\" (UID: \"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9\") " pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.895614 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:17.895650 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:18.395637221 +0000 UTC m=+3.116626041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895717 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-cnibin\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-cni-multus\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d2506c1-634c-4289-b429-136d071708a9-multus-daemon-config\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-hosts-file\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-cni-multus\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-k8s-cni-cncf-io\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895901 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-hosts-file\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-tmp-dir\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-k8s-cni-cncf-io\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-cni-bin\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.895973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-var-lib-cni-bin\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-multus-certs\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-system-cni-dir\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-cni-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-netns\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-os-release\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896087 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1210dbf-17b6-4f3f-8f12-be26acfcb4b9-konnectivity-ca\") pod \"konnectivity-agent-hz7cp\" (UID: \"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9\") " pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-system-cni-dir\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-cni-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896151 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-netns\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-host-run-multus-certs\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-tmp-dir\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d2506c1-634c-4289-b429-136d071708a9-multus-daemon-config\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896585 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d2506c1-634c-4289-b429-136d071708a9-cni-binary-copy\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.896153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d2506c1-634c-4289-b429-136d071708a9-cni-binary-copy\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-etc-kubernetes\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1210dbf-17b6-4f3f-8f12-be26acfcb4b9-agent-certs\") pod \"konnectivity-agent-hz7cp\" (UID: \"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9\") " pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899847 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-etc-kubernetes\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tc4t\" (UniqueName: \"kubernetes.io/projected/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-kube-api-access-6tc4t\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-os-release\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cnibin\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-socket-dir-parent\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-conf-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-os-release\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.899999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6x8f\" (UniqueName: \"kubernetes.io/projected/3a3278d0-d407-479f-8fec-b83d75a545f0-kube-api-access-b6x8f\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.900016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-cnibin\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.900023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-socket-dir-parent\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.900047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.900057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d2506c1-634c-4289-b429-136d071708a9-multus-conf-dir\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.900081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72kxs\" (UniqueName: \"kubernetes.io/projected/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-kube-api-access-72kxs\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.900471 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.901982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1210dbf-17b6-4f3f-8f12-be26acfcb4b9-agent-certs\") pod \"konnectivity-agent-hz7cp\" (UID: \"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9\") " pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.902693 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-os-release\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.906428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fp6h\" (UniqueName: \"kubernetes.io/projected/5d2506c1-634c-4289-b429-136d071708a9-kube-api-access-4fp6h\") pod \"multus-hpds8\" (UID: \"5d2506c1-634c-4289-b429-136d071708a9\") " pod="openshift-multus/multus-hpds8" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.908441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6x8f\" (UniqueName: \"kubernetes.io/projected/3a3278d0-d407-479f-8fec-b83d75a545f0-kube-api-access-b6x8f\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.909720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tc4t\" (UniqueName: \"kubernetes.io/projected/1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c-kube-api-access-6tc4t\") pod \"node-resolver-bqb6h\" (UID: \"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c\") " pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:17.968225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.914302 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72kxs\" (UniqueName: \"kubernetes.io/projected/7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8-kube-api-access-72kxs\") pod \"multus-additional-cni-plugins-zhvxw\" (UID: \"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8\") " pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:17.985768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.985740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qrqb" Jul 06 12:04:17.992191 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:17.992171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" Jul 06 12:04:17.995421 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:17.995404 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f66841_7616_4c49_a5c1_bb2a1cbfd66e.slice/crio-eb630b7fff832f5747c037ee45330554f39b2ef7285ddade0c1d8e9d3834df82 WatchSource:0}: Error finding container eb630b7fff832f5747c037ee45330554f39b2ef7285ddade0c1d8e9d3834df82: Status 404 returned error can't find the container with id eb630b7fff832f5747c037ee45330554f39b2ef7285ddade0c1d8e9d3834df82 Jul 06 12:04:18.000624 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.000602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:18.000822 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.000791 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071a9757_191d_4c39_a4c1_36acdb331f80.slice/crio-53c10ecefa9cea7fde905134ec8aeae1076bee22d4160cdea56ed5141ebf4f29 WatchSource:0}: Error finding container 53c10ecefa9cea7fde905134ec8aeae1076bee22d4160cdea56ed5141ebf4f29: Status 404 returned error can't find the container with id 53c10ecefa9cea7fde905134ec8aeae1076bee22d4160cdea56ed5141ebf4f29 Jul 06 12:04:18.006238 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.006223 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hpds8" Jul 06 12:04:18.009195 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.009126 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5027d4_1dbb_4247_8e2f_be7f777e06c9.slice/crio-a22a1a6cd3d2b191423053b5c0391c3d42fbce95267b25f53d5f676dd17410e5 WatchSource:0}: Error finding container a22a1a6cd3d2b191423053b5c0391c3d42fbce95267b25f53d5f676dd17410e5: Status 404 returned error can't find the container with id a22a1a6cd3d2b191423053b5c0391c3d42fbce95267b25f53d5f676dd17410e5 Jul 06 12:04:18.010920 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.010900 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qm75" Jul 06 12:04:18.017252 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.017227 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2506c1_634c_4289_b429_136d071708a9.slice/crio-2fcebb5968f74294f2a3bd60eee7ab9ca095dd7377244bacc2d68d61463a768e WatchSource:0}: Error finding container 2fcebb5968f74294f2a3bd60eee7ab9ca095dd7377244bacc2d68d61463a768e: Status 404 returned error can't find the container with id 2fcebb5968f74294f2a3bd60eee7ab9ca095dd7377244bacc2d68d61463a768e Jul 06 12:04:18.017319 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.017295 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" Jul 06 12:04:18.018350 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.018332 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 12:04:18.019637 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.019614 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee561c3f_af45_41d7_a7ce_3680040d9761.slice/crio-289a81a0be9c0863421eaefa3d25065ed860c20ae1ecb8cd15a875f201e2286e WatchSource:0}: Error finding container 289a81a0be9c0863421eaefa3d25065ed860c20ae1ecb8cd15a875f201e2286e: Status 404 returned error can't find the container with id 289a81a0be9c0863421eaefa3d25065ed860c20ae1ecb8cd15a875f201e2286e Jul 06 12:04:18.023442 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.023420 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:18.025872 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.025851 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c023631_fafb_4b8d_beb4_7a55321bae79.slice/crio-1fa753ef496dfc762b10c8f0144f10a827582efbcafbe95f023d831d6d83eb1e WatchSource:0}: Error finding container 1fa753ef496dfc762b10c8f0144f10a827582efbcafbe95f023d831d6d83eb1e: Status 404 returned error can't find the container with id 1fa753ef496dfc762b10c8f0144f10a827582efbcafbe95f023d831d6d83eb1e Jul 06 12:04:18.029791 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.029776 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqb6h" Jul 06 12:04:18.032769 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.032750 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1210dbf_17b6_4f3f_8f12_be26acfcb4b9.slice/crio-a47ecf4254078a64e71d7377fb5de73a5db6c1695bdec08baa79132e520a9b9a WatchSource:0}: Error finding container a47ecf4254078a64e71d7377fb5de73a5db6c1695bdec08baa79132e520a9b9a: Status 404 returned error can't find the container with id a47ecf4254078a64e71d7377fb5de73a5db6c1695bdec08baa79132e520a9b9a Jul 06 12:04:18.033213 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.033198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" Jul 06 12:04:18.041233 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.041214 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1bc1ae_dc7d_4029_a03a_5df0bd8fcf2c.slice/crio-f03206edaf9a244fe3d2f72006d8aa2b893e825e409f7c764753bedb8ed39639 WatchSource:0}: Error finding container f03206edaf9a244fe3d2f72006d8aa2b893e825e409f7c764753bedb8ed39639: Status 404 returned error can't find the container with id f03206edaf9a244fe3d2f72006d8aa2b893e825e409f7c764753bedb8ed39639 Jul 06 12:04:18.044183 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:18.044091 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb8bcb1_6b93_411d_9bfe_f0f0243a65d8.slice/crio-5e846045a3d8fbe789ca204f8dd4794487ba4b285a17d3cbfb37b4002f13eb75 WatchSource:0}: Error finding container 5e846045a3d8fbe789ca204f8dd4794487ba4b285a17d3cbfb37b4002f13eb75: Status 404 returned error can't find the container with id 5e846045a3d8fbe789ca204f8dd4794487ba4b285a17d3cbfb37b4002f13eb75 Jul 06 12:04:18.303947 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.303867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:18.304117 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.303973 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:18.304117 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.304036 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:04:19.304018619 +0000 UTC m=+4.025007443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:18.404396 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.404363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:18.404569 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.404412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:18.404569 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.404527 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:18.404569 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.404547 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:18.404569 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.404568 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:18.404759 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.404588 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:18.404759 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.404591 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:19.404572709 +0000 UTC m=+4.125561531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:18.404759 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.404648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:19.404632033 +0000 UTC m=+4.125620852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:18.742621 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.742532 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:59:17 +0000 UTC" deadline="2028-04-18 08:30:46.464021604 +0000 UTC" Jul 06 12:04:18.742621 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.742570 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15644h26m27.72145637s" Jul 06 12:04:18.873897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.873863 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:18.874448 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:18.874002 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:18.879515 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.879485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"a22a1a6cd3d2b191423053b5c0391c3d42fbce95267b25f53d5f676dd17410e5"} Jul 06 12:04:18.880985 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.880887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" event={"ID":"071a9757-191d-4c39-a4c1-36acdb331f80","Type":"ContainerStarted","Data":"53c10ecefa9cea7fde905134ec8aeae1076bee22d4160cdea56ed5141ebf4f29"} Jul 06 12:04:18.882133 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.882103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qrqb" event={"ID":"51f66841-7616-4c49-a5c1-bb2a1cbfd66e","Type":"ContainerStarted","Data":"eb630b7fff832f5747c037ee45330554f39b2ef7285ddade0c1d8e9d3834df82"} Jul 06 12:04:18.883474 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.883445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqb6h" event={"ID":"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c","Type":"ContainerStarted","Data":"f03206edaf9a244fe3d2f72006d8aa2b893e825e409f7c764753bedb8ed39639"} Jul 06 12:04:18.884581 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.884555 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" event={"ID":"2c023631-fafb-4b8d-beb4-7a55321bae79","Type":"ContainerStarted","Data":"1fa753ef496dfc762b10c8f0144f10a827582efbcafbe95f023d831d6d83eb1e"} Jul 06 12:04:18.886067 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.886038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerStarted","Data":"5e846045a3d8fbe789ca204f8dd4794487ba4b285a17d3cbfb37b4002f13eb75"} Jul 06 12:04:18.887348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.887329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hz7cp" event={"ID":"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9","Type":"ContainerStarted","Data":"a47ecf4254078a64e71d7377fb5de73a5db6c1695bdec08baa79132e520a9b9a"} Jul 06 12:04:18.888477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.888447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qm75" event={"ID":"ee561c3f-af45-41d7-a7ce-3680040d9761","Type":"ContainerStarted","Data":"289a81a0be9c0863421eaefa3d25065ed860c20ae1ecb8cd15a875f201e2286e"} Jul 06 12:04:18.890293 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:18.890270 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hpds8" event={"ID":"5d2506c1-634c-4289-b429-136d071708a9","Type":"ContainerStarted","Data":"2fcebb5968f74294f2a3bd60eee7ab9ca095dd7377244bacc2d68d61463a768e"} Jul 06 12:04:19.310604 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.310564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:19.310823 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.310750 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:19.310902 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.310831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:04:21.310813374 +0000 UTC m=+6.031802209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.410937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.410985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.411152 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.411213 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:21.411195903 +0000 UTC m=+6.132184726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.411615 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.411640 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.411653 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:19.411737 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.411700 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:21.411683384 +0000 UTC m=+6.132672202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:19.743700 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.743601 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:59:17 +0000 UTC" deadline="2028-03-29 18:16:10.269450904 +0000 UTC" Jul 06 12:04:19.743700 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.743649 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15174h11m50.525806914s" Jul 06 12:04:19.872954 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.872924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:19.873119 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.873073 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:19.873175 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:19.873115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:19.873255 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:19.873234 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:20.871915 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:20.871875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:20.872366 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:20.872040 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:21.327383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:21.327278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:21.327562 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.327460 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:21.327562 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.327520 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:04:25.327502671 +0000 UTC m=+10.048491492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:21.428603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:21.428652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.428793 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.428880 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:25.428860976 +0000 UTC m=+10.149849796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.429339 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.429361 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.429373 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:21.429466 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.429421 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:25.429405933 +0000 UTC m=+10.150394755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:21.873130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:21.873096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:21.873577 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.873233 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:21.873577 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:21.873310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:21.873577 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:21.873381 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:22.872521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:22.872139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:22.872521 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:22.872240 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:23.872841 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:23.872667 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:23.872841 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:23.872824 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:23.873341 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:23.872866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:23.873341 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:23.872954 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:24.872740 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:24.872263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:24.872740 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:24.872398 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:25.363662 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:25.363570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:25.363859 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.363784 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:25.363944 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.363881 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:04:33.363859905 +0000 UTC m=+18.084848734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:25.464161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:25.464124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:25.464161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:25.464168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:25.464395 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.464332 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:25.464395 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.464363 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:25.464395 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.464391 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:25.464531 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.464402 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:33.464382626 +0000 UTC m=+18.185371457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:25.464531 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.464406 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:25.464531 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.464458 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:33.464441688 +0000 UTC m=+18.185430536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:25.872300 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:25.872263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:25.872515 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.872482 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:25.872655 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:25.872553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:25.873667 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:25.873636 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:26.872968 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:26.872933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:26.873141 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:26.873074 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:27.872327 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:27.872061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:27.872771 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:27.872448 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:27.872771 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:27.872505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:27.872771 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:27.872562 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:28.872211 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.871925 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:28.872375 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:28.872274 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:28.910907 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.910879 2581 generic.go:356] "Generic (PLEG): container finished" podID="3a0986dce90a04fe143b1afcf7a6c69e" containerID="e28bd6c44630a61bfbc70c9240271dd3d14340ee8870cc8a2a90e87881fa9bd9" exitCode=0 Jul 06 12:04:28.911077 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.910951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" event={"ID":"3a0986dce90a04fe143b1afcf7a6c69e","Type":"ContainerDied","Data":"e28bd6c44630a61bfbc70c9240271dd3d14340ee8870cc8a2a90e87881fa9bd9"} Jul 06 12:04:28.912590 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.912554 2581 generic.go:356] "Generic (PLEG): container finished" podID="7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8" containerID="cdc7bb913399e3195a7f1d02b7059e5fbe50c744ae08c92156a1d78365be2db8" exitCode=0 Jul 06 12:04:28.912711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.912625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerDied","Data":"cdc7bb913399e3195a7f1d02b7059e5fbe50c744ae08c92156a1d78365be2db8"} Jul 06 12:04:28.914262 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.914227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hz7cp" event={"ID":"c1210dbf-17b6-4f3f-8f12-be26acfcb4b9","Type":"ContainerStarted","Data":"136fc8104c27d47ea64db92efa3a8d40aac479ceed46a312fa30ec04f14da7e0"} Jul 06 12:04:28.915886 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.915860 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qm75" event={"ID":"ee561c3f-af45-41d7-a7ce-3680040d9761","Type":"ContainerStarted","Data":"5e5cf32ae635f61bb3980ae27c93c3e08bc501aec4271784f7ea5a924b26dd6d"} Jul 06 12:04:28.917483 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.917465 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" event={"ID":"071a9757-191d-4c39-a4c1-36acdb331f80","Type":"ContainerStarted","Data":"d6f835bdf8bbc957f88d44b658984c7cce4b197bf07bf44a7203504c356a9aa3"} Jul 06 12:04:28.918908 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.918890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" event={"ID":"71da5c5a834b0330f878adb624359a1d","Type":"ContainerStarted","Data":"1b3bf6e5b472c06d56560ae102cb277fdeb056f84075705779466d072b534416"} Jul 06 12:04:28.920443 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.920423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqb6h" event={"ID":"1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c","Type":"ContainerStarted","Data":"246c69bf78b45625e4124d6429a537541e49502158cf92858102212a98c4cddd"} Jul 06 12:04:28.921814 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.921770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" event={"ID":"2c023631-fafb-4b8d-beb4-7a55321bae79","Type":"ContainerStarted","Data":"c6d816681a00dc0e2f2e029617cc287f3adb2981bf2a56efc2fdff8ba21a6158"} Jul 06 12:04:28.986718 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:28.986659 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8qm75" podStartSLOduration=3.135766081 podStartE2EDuration="12.986637167s" totalImagesPullingTime="9.850871086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:28.963772517 +0000 UTC m=+13.684761356" watchObservedRunningTime="2026-07-06 12:04:28.986637167 +0000 UTC m=+13.707626007" Jul 06 12:04:29.021447 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.021377 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hz7cp" podStartSLOduration=3.186485098 podStartE2EDuration="13.02135833s" totalImagesPullingTime="9.834873232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:28.986386057 +0000 UTC m=+13.707374907" watchObservedRunningTime="2026-07-06 12:04:29.02135833 +0000 UTC m=+13.742347169" Jul 06 12:04:29.050327 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.050276 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bqb6h" podStartSLOduration=3.220183064 podStartE2EDuration="13.050254492s" totalImagesPullingTime="9.830071428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:29.021221326 +0000 UTC m=+13.742210167" watchObservedRunningTime="2026-07-06 12:04:29.050254492 +0000 UTC m=+13.771243331" Jul 06 12:04:29.050739 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.050704 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-36.ec2.internal" podStartSLOduration=12.050692567 podStartE2EDuration="12.050692567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:29.050155384 +0000 UTC m=+13.771144223" watchObservedRunningTime="2026-07-06 12:04:29.050692567 +0000 UTC m=+13.771681406" Jul 06 12:04:29.127485 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.127374 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nbq6g" podStartSLOduration=3.259724183 podStartE2EDuration="13.127327565s" totalImagesPullingTime="9.867603382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:29.082108367 +0000 UTC m=+13.803097208" watchObservedRunningTime="2026-07-06 12:04:29.127327565 +0000 UTC m=+13.848316405" Jul 06 12:04:29.801998 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.801927 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:29.871816 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.871775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:29.872003 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.871775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:29.872063 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:29.872010 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:29.872131 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:29.872097 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:29.925718 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.925682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qrqb" event={"ID":"51f66841-7616-4c49-a5c1-bb2a1cbfd66e","Type":"ContainerStarted","Data":"2f36b912cf475cc617898e63056f56b7a767163d6e13d45555b6db91e3e33db6"} Jul 06 12:04:29.928374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.928307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" event={"ID":"3a0986dce90a04fe143b1afcf7a6c69e","Type":"ContainerStarted","Data":"be69ca967317bbf734d7c707fcc7803ab65533d58509c447a27a07eddbb2d314"} Jul 06 12:04:29.970636 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.970572 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7qrqb" podStartSLOduration=5.123742115 podStartE2EDuration="14.970557175s" totalImagesPullingTime="9.84681506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:29.951820446 +0000 UTC m=+14.672809286" watchObservedRunningTime="2026-07-06 12:04:29.970557175 +0000 UTC m=+14.691546068" Jul 06 12:04:29.971056 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:29.970997 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-36.ec2.internal" podStartSLOduration=12.970984079 podStartE2EDuration="12.970984079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:29.970936707 +0000 UTC m=+14.691925539" watchObservedRunningTime="2026-07-06 12:04:29.970984079 +0000 UTC m=+14.691972918" Jul 06 12:04:30.240196 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:30.240112 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:30.240991 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:30.240944 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:30.872200 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:30.872165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:30.872377 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:30.872290 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:30.931016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:30.930989 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hz7cp" Jul 06 12:04:31.872082 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:31.872049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:31.872277 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:31.872191 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:31.872513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:31.872053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:31.872513 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:31.872470 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:32.872441 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:32.872401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:32.873260 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:32.872533 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:33.426564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:33.426523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:33.426863 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.426662 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:33.426863 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.426732 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:04:49.426708996 +0000 UTC m=+34.147697836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:33.527382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:33.527305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:33.527573 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:33.527404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:33.527573 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.527505 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:33.527573 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.527521 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:33.527573 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.527537 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:33.527573 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.527548 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:33.527861 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.527587 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:49.52756514 +0000 UTC m=+34.248553968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:33.527861 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.527608 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:49.527597678 +0000 UTC m=+34.248586494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:33.875646 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:33.875567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:33.875646 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:33.875590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:33.876265 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.875679 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:33.876265 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:33.875795 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:34.871844 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:34.871789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:34.872024 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:34.871943 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:35.873437 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:35.873397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:35.873437 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:35.873424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:35.873952 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:35.873517 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:35.873952 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:35.873673 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:36.872509 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:36.872473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:36.872692 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:36.872583 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:37.872430 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:37.872397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:37.872818 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:37.872508 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:37.872818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:37.872559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:37.872818 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:37.872644 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:38.872153 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:38.871953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:38.872350 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:38.872257 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:39.872312 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.872241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:39.872689 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:39.872391 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:39.872689 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.872440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:39.872689 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:39.872562 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:39.934053 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.934026 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 12:04:39.949189 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.949158 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hpds8" event={"ID":"5d2506c1-634c-4289-b429-136d071708a9","Type":"ContainerStarted","Data":"348e57628d2d3c82a3d0e16bd86bfa44d51848edbae833c8e9d850b88ff620d6"} Jul 06 12:04:39.950433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.950408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"a0ea9210cfab1933c30305bee1132dd84700437b74c5ee3f4af8d8fa6923dd2b"} Jul 06 12:04:39.952216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.952178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" event={"ID":"071a9757-191d-4c39-a4c1-36acdb331f80","Type":"ContainerStarted","Data":"abe671e11883fe673a844447e68628677ab1e1fc604b1343d608483bbc1618e6"} Jul 06 12:04:39.976212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:39.976167 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hpds8" podStartSLOduration=2.18060327 podStartE2EDuration="23.976154892s" totalImagesPullingTime="21.795551622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:39.976045024 +0000 UTC m=+24.697033863" watchObservedRunningTime="2026-07-06 12:04:39.976154892 +0000 UTC m=+24.697143729" Jul 06 12:04:40.794928 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.794611 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T12:04:39.934049071Z","UUID":"9d37d941-63f8-45c9-8690-baa1ceecccc0","Handler":null,"Name":"","Endpoint":""} Jul 06 12:04:40.796225 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.796199 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 12:04:40.796346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.796241 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 12:04:40.871751 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.871722 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:40.871938 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:40.871851 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:40.956279 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.956249 2581 generic.go:356] "Generic (PLEG): container finished" podID="7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8" containerID="baf10466027a0383efc684238dd320f32e782e9c9494bdcca930bff34056a189" exitCode=0 Jul 06 12:04:40.956781 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.956332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerDied","Data":"baf10466027a0383efc684238dd320f32e782e9c9494bdcca930bff34056a189"} Jul 06 12:04:40.959338 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.959318 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"7c1eef233aa6ba58d5b737f6e41c3a81c414e8026f7174aa21a98d1b59fb9f69"} Jul 06 12:04:40.959394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.959377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"958094f1f32a236620d7e34ed1c86d4071a84c2c68595d97afdbb984093fe36a"} Jul 06 12:04:40.959435 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.959425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"db385bb7b19822546ad8ff65439ef4e447e27324be5912523aa9217209e5fd7e"} Jul 06 12:04:40.959476 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.959456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"ffd6ae07d1f632e3c21158bbbd637cc12461545ae89b91ca5291ff5e9353d005"} Jul 06 12:04:40.959509 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:40.959482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"2023bfc67d5021c2df44e3e3dd10b8b5db308ef51b2c77434bc68c1915725087"} Jul 06 12:04:41.871890 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:41.871854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:41.872083 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:41.871972 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:41.872083 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:41.872004 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:41.872083 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:41.872064 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:41.964126 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:41.964035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" event={"ID":"071a9757-191d-4c39-a4c1-36acdb331f80","Type":"ContainerStarted","Data":"9cf37b5c8913b807e95d44159e373d6f3fbc3f1fc08f7bad6d60452cd085a625"} Jul 06 12:04:42.872494 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:42.872402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:42.872705 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:42.872524 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:42.967943 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:42.967913 2581 generic.go:356] "Generic (PLEG): container finished" podID="7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8" containerID="1ceebb65af6f56aff5c2037de29c37b934b2fd0361729e0eb91c4ef100b99256" exitCode=0 Jul 06 12:04:42.968391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:42.967999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerDied","Data":"1ceebb65af6f56aff5c2037de29c37b934b2fd0361729e0eb91c4ef100b99256"} Jul 06 12:04:42.971252 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:42.971231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"1c7314a526f4f3a7f9e393fd023db046c970fe2fb113c69c2197af875327e634"} Jul 06 12:04:42.999423 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:42.999388 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fgsqx" podStartSLOduration=5.179398356 podStartE2EDuration="27.999374168s" totalImagesPullingTime="22.819975812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:41.997277095 +0000 UTC m=+26.718265938" watchObservedRunningTime="2026-07-06 12:04:42.999374168 +0000 UTC m=+27.720363024" Jul 06 12:04:43.871743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:43.871707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:43.871960 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:43.871828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:43.871960 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:43.871834 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:43.871960 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:43.871939 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:44.872392 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:44.872239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:44.872845 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:44.872472 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:44.982296 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:44.982108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" event={"ID":"bf5027d4-1dbb-4247-8e2f-be7f777e06c9","Type":"ContainerStarted","Data":"deec4a20d0356a5dcf8f7de1af0390158f6335fcb85e95a713b389c512b7d555"} Jul 06 12:04:44.982882 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:44.982852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:44.984889 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:44.984860 2581 generic.go:356] "Generic (PLEG): container finished" podID="7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8" containerID="4eabb3638504ea693d561054998bec832abd9638856c1fb4563101a84d0a6494" exitCode=0 Jul 06 12:04:44.985015 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:44.984900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerDied","Data":"4eabb3638504ea693d561054998bec832abd9638856c1fb4563101a84d0a6494"} Jul 06 12:04:44.999379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:44.999357 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:45.017241 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:45.017194 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" podStartSLOduration=7.244556292 podStartE2EDuration="29.017181517s" totalImagesPullingTime="21.772625225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:45.01656716 +0000 UTC m=+29.737556009" watchObservedRunningTime="2026-07-06 12:04:45.017181517 +0000 UTC m=+29.738170355" Jul 06 12:04:45.872728 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:45.872696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:45.873261 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:45.872773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:45.873261 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:45.872794 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:45.873261 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:45.872905 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:45.988287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:45.988249 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:45.988486 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:45.988341 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:46.004166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:46.004136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:04:46.872649 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:46.872624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:46.872795 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:46.872717 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:47.200822 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:47.200719 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jpzwm"] Jul 06 12:04:47.200971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:47.200868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:47.200971 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:47.200958 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:47.217055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:47.217028 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9t74n"] Jul 06 12:04:47.217232 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:47.217159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:47.217283 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:47.217262 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:47.217723 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:47.217702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mk5zf"] Jul 06 12:04:47.217855 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:47.217777 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:47.217912 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:47.217875 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:48.871966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:48.871929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:48.871966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:48.871966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:48.872361 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:48.871971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:48.872361 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:48.872059 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:48.872361 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:48.872179 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:48.872361 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:48.872240 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:49.449706 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:49.449622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:49.449860 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.449826 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:49.449909 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.449901 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret podName:526122c7-949b-4d5d-ac90-1643f978892d nodeName:}" failed. No retries permitted until 2026-07-06 12:05:21.449882146 +0000 UTC m=+66.170870966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret") pod "global-pull-secret-syncer-jpzwm" (UID: "526122c7-949b-4d5d-ac90-1643f978892d") : object "kube-system"/"original-pull-secret" not registered Jul 06 12:04:49.549997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:49.549963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:49.549997 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:49.550004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:49.550233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.550109 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:49.550233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.550137 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 12:04:49.550233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.550161 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 12:04:49.550233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.550174 2581 projected.go:196] Error preparing data for projected volume kube-api-access-4nfk2 for pod openshift-network-diagnostics/network-check-target-mk5zf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:49.550233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.550164 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:21.550148616 +0000 UTC m=+66.271137449 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 12:04:49.550233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:49.550234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2 podName:db22db43-ec47-4ef9-8e47-caba959389e5 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:21.550216194 +0000 UTC m=+66.271205017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4nfk2" (UniqueName: "kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2") pod "network-check-target-mk5zf" (UID: "db22db43-ec47-4ef9-8e47-caba959389e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 12:04:50.872287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:50.872204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:50.872669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:50.872204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:50.872669 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:50.872328 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9t74n" podUID="3a3278d0-d407-479f-8fec-b83d75a545f0" Jul 06 12:04:50.872669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:50.872204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:50.872669 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:50.872391 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpzwm" podUID="526122c7-949b-4d5d-ac90-1643f978892d" Jul 06 12:04:50.872669 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:50.872506 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mk5zf" podUID="db22db43-ec47-4ef9-8e47-caba959389e5" Jul 06 12:04:52.003267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.003043 2581 generic.go:356] "Generic (PLEG): container finished" podID="7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8" containerID="9e63e8a654efe88bbc7c20d81eea9a83a289cbd693d873a97798e53ccf7995c1" exitCode=0 Jul 06 12:04:52.003267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.003121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerDied","Data":"9e63e8a654efe88bbc7c20d81eea9a83a289cbd693d873a97798e53ccf7995c1"} Jul 06 12:04:52.548248 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.548222 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-36.ec2.internal" event="NodeReady" Jul 06 12:04:52.548382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.548351 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 12:04:52.588162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.588135 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57b9dd98c5-jhtdf"] Jul 06 12:04:52.602918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.602897 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.605130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.605067 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57b9dd98c5-jhtdf"] Jul 06 12:04:52.606392 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.606372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfj6t\"" Jul 06 12:04:52.606522 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.606376 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 12:04:52.606522 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.606380 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 12:04:52.606522 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.606410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 12:04:52.612142 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.612123 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p5p77"] Jul 06 12:04:52.612724 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.612701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 12:04:52.632872 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.632847 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26lvh"] Jul 06 12:04:52.632980 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.632958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.636912 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.636892 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 12:04:52.636912 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.636894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 12:04:52.637055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.636940 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 12:04:52.637151 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.637139 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t7z7n\"" Jul 06 12:04:52.652929 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.652910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p5p77"] Jul 06 12:04:52.653024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.652940 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26lvh"] Jul 06 12:04:52.653056 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.653022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.656676 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.656654 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qcfg\"" Jul 06 12:04:52.656676 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.656672 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 12:04:52.656844 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.656689 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 12:04:52.775481 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c45130cf-2eca-43f0-8cf9-534403a33df9-config-volume\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.775631 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-image-registry-private-configuration\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775631 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-installation-pull-secrets\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-certificates\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8mlp\" (UniqueName: \"kubernetes.io/projected/c45130cf-2eca-43f0-8cf9-534403a33df9-kube-api-access-c8mlp\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.775732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txbrb\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-kube-api-access-txbrb\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fd371b4-8ef9-4bd1-8187-faf157957179-cert\") pod \"ingress-canary-p5p77\" (UID: \"9fd371b4-8ef9-4bd1-8187-faf157957179\") " pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.775732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45130cf-2eca-43f0-8cf9-534403a33df9-tmp-dir\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.775941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775824 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.775941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-trusted-ca\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-bound-sa-token\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.775941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v89mr\" (UniqueName: \"kubernetes.io/projected/9fd371b4-8ef9-4bd1-8187-faf157957179-kube-api-access-v89mr\") pod \"ingress-canary-p5p77\" (UID: \"9fd371b4-8ef9-4bd1-8187-faf157957179\") " pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.775941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.775909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-ca-trust-extracted\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.871930 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.871852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:04:52.872064 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.871852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:04:52.872064 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.871857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:04:52.874943 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.874920 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 12:04:52.874943 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.874939 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb44c\"" Jul 06 12:04:52.875102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.874963 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 12:04:52.875102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.874924 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 12:04:52.875102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.874965 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 12:04:52.875102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.874931 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn8kl\"" Jul 06 12:04:52.876877 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.876860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c45130cf-2eca-43f0-8cf9-534403a33df9-config-volume\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.876978 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.876911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-image-registry-private-configuration\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877079 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-installation-pull-secrets\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877142 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-certificates\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877142 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8mlp\" (UniqueName: \"kubernetes.io/projected/c45130cf-2eca-43f0-8cf9-534403a33df9-kube-api-access-c8mlp\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.877239 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txbrb\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-kube-api-access-txbrb\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877239 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fd371b4-8ef9-4bd1-8187-faf157957179-cert\") pod \"ingress-canary-p5p77\" (UID: \"9fd371b4-8ef9-4bd1-8187-faf157957179\") " pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.877239 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45130cf-2eca-43f0-8cf9-534403a33df9-tmp-dir\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.877368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.877368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-trusted-ca\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-bound-sa-token\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v89mr\" (UniqueName: \"kubernetes.io/projected/9fd371b4-8ef9-4bd1-8187-faf157957179-kube-api-access-v89mr\") pod \"ingress-canary-p5p77\" (UID: \"9fd371b4-8ef9-4bd1-8187-faf157957179\") " pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.877585 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-ca-trust-extracted\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877675 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:52.877636 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:04:52.877794 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:52.877708 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:53.377690028 +0000 UTC m=+38.098678847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:04:52.877794 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-ca-trust-extracted\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.877794 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.877746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-certificates\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.878193 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.878171 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45130cf-2eca-43f0-8cf9-534403a33df9-tmp-dir\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.878281 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:52.878183 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:04:52.878281 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:52.878216 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:04:52.878281 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:52.878276 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:53.378260072 +0000 UTC m=+38.099248896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:04:52.878526 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.878507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c45130cf-2eca-43f0-8cf9-534403a33df9-config-volume\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.878982 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.878875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-trusted-ca\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.881869 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.881846 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-image-registry-private-configuration\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.881946 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.881893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-installation-pull-secrets\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.881946 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.881908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fd371b4-8ef9-4bd1-8187-faf157957179-cert\") pod \"ingress-canary-p5p77\" (UID: \"9fd371b4-8ef9-4bd1-8187-faf157957179\") " pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.886758 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.886738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txbrb\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-kube-api-access-txbrb\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.888272 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.888249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8mlp\" (UniqueName: \"kubernetes.io/projected/c45130cf-2eca-43f0-8cf9-534403a33df9-kube-api-access-c8mlp\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:52.889088 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.889070 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-bound-sa-token\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:52.889183 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.889164 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v89mr\" (UniqueName: \"kubernetes.io/projected/9fd371b4-8ef9-4bd1-8187-faf157957179-kube-api-access-v89mr\") pod \"ingress-canary-p5p77\" (UID: \"9fd371b4-8ef9-4bd1-8187-faf157957179\") " pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:52.941039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:52.941014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p5p77" Jul 06 12:04:53.008345 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:53.008292 2581 generic.go:356] "Generic (PLEG): container finished" podID="7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8" containerID="06017fca1909b5e668ab4b1b96afd41df960eecf4788029b7a04737c489c620b" exitCode=0 Jul 06 12:04:53.009124 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:53.008361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerDied","Data":"06017fca1909b5e668ab4b1b96afd41df960eecf4788029b7a04737c489c620b"} Jul 06 12:04:53.116942 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:53.116773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p5p77"] Jul 06 12:04:53.120241 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:04:53.120219 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd371b4_8ef9_4bd1_8187_faf157957179.slice/crio-1b1d18d2c7cfec2de059f52e46a1b95c26698d3adbfdfd5f159d280c539e5f79 WatchSource:0}: Error finding container 1b1d18d2c7cfec2de059f52e46a1b95c26698d3adbfdfd5f159d280c539e5f79: Status 404 returned error can't find the container with id 1b1d18d2c7cfec2de059f52e46a1b95c26698d3adbfdfd5f159d280c539e5f79 Jul 06 12:04:53.381616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:53.381537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:53.381779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:53.381636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:53.381779 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:53.381700 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:04:53.381779 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:53.381733 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:04:53.381779 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:53.381744 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:04:53.381779 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:53.381768 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:54.38175017 +0000 UTC m=+39.102739006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:04:53.381971 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:53.381784 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:54.381776558 +0000 UTC m=+39.102765378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:04:54.013842 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.013794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" event={"ID":"7bb8bcb1-6b93-411d-9bfe-f0f0243a65d8","Type":"ContainerStarted","Data":"35645e5e49e70e38074cf203a230c511bea7dae6afa399eccab2391ceca23d4e"} Jul 06 12:04:54.014830 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.014794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p5p77" event={"ID":"9fd371b4-8ef9-4bd1-8187-faf157957179","Type":"ContainerStarted","Data":"1b1d18d2c7cfec2de059f52e46a1b95c26698d3adbfdfd5f159d280c539e5f79"} Jul 06 12:04:54.039390 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.039347 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zhvxw" podStartSLOduration=7.920706637 podStartE2EDuration="38.039332359s" totalImagesPullingTime="30.118625722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:54.039297605 +0000 UTC m=+38.760286444" watchObservedRunningTime="2026-07-06 12:04:54.039332359 +0000 UTC m=+38.760321192" Jul 06 12:04:54.233284 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.233249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hz7cp_c1210dbf-17b6-4f3f-8f12-be26acfcb4b9/konnectivity-agent/0.log" limit=1024 Jul 06 12:04:54.347996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.347911 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hz7cp_c1210dbf-17b6-4f3f-8f12-be26acfcb4b9/konnectivity-agent/0.log" limit=1024 Jul 06 12:04:54.391039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.391008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:54.391172 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:54.391050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:54.391172 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:54.391153 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:04:54.391240 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:54.391200 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:56.39118715 +0000 UTC m=+41.112175967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:04:54.391240 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:54.391156 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:04:54.391240 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:54.391240 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:04:54.391337 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:54.391282 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:56.391270686 +0000 UTC m=+41.112259504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:04:56.406648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:56.406607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:04:56.407165 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:56.406659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:04:56.407165 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:56.406764 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:04:56.407165 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:56.406775 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:04:56.407165 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:56.406812 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:04:56.407165 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:56.406840 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:00.406821672 +0000 UTC m=+45.127810492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:04:56.407165 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:04:56.406867 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:00.406850322 +0000 UTC m=+45.127839156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:04:58.025965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:58.025929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p5p77" event={"ID":"9fd371b4-8ef9-4bd1-8187-faf157957179","Type":"ContainerStarted","Data":"d8935749e8149f61fcfb3d5ef7266b7ad1b0684827ea365d904b8850f3427b3e"} Jul 06 12:04:58.058131 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:04:58.057930 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p5p77" podStartSLOduration=2.151755751 podStartE2EDuration="6.057915329s" totalImagesPullingTime="3.906159578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:58.057873554 +0000 UTC m=+42.778862394" watchObservedRunningTime="2026-07-06 12:04:58.057915329 +0000 UTC m=+42.778904168" Jul 06 12:05:00.437393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:00.437350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:00.437778 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:00.437406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:05:00.437778 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:00.437521 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:00.437778 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:00.437524 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:05:00.437778 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:00.437620 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:05:00.437778 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:00.437623 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.437602515 +0000 UTC m=+53.158591333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:05:00.437778 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:00.437666 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.437655183 +0000 UTC m=+53.158644013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:05:08.495469 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:08.495419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:08.495469 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:08.495479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:05:08.495941 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:08.495584 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:05:08.495941 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:08.495601 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:08.495941 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:08.495604 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:05:08.495941 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:08.495656 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:24.495641604 +0000 UTC m=+69.216630423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:05:08.495941 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:08.495668 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:24.495662775 +0000 UTC m=+69.216651592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:05:18.002472 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:18.002443 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q68gp" Jul 06 12:05:21.491660 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.491620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:05:21.494746 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.494725 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 12:05:21.506183 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.506158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/526122c7-949b-4d5d-ac90-1643f978892d-original-pull-secret\") pod \"global-pull-secret-syncer-jpzwm\" (UID: \"526122c7-949b-4d5d-ac90-1643f978892d\") " pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:05:21.592569 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.592536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:05:21.592569 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.592574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:05:21.600616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.600592 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 12:05:21.600680 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.600625 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 12:05:21.603706 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:21.603685 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 12:05:21.603791 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:21.603782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs podName:3a3278d0-d407-479f-8fec-b83d75a545f0 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:25.603765975 +0000 UTC m=+130.324754793 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs") pod "network-metrics-daemon-9t74n" (UID: "3a3278d0-d407-479f-8fec-b83d75a545f0") : secret "metrics-daemon-secret" not found Jul 06 12:05:21.610061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.610044 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 12:05:21.616725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.616706 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfk2\" (UniqueName: \"kubernetes.io/projected/db22db43-ec47-4ef9-8e47-caba959389e5-kube-api-access-4nfk2\") pod \"network-check-target-mk5zf\" (UID: \"db22db43-ec47-4ef9-8e47-caba959389e5\") " pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:05:21.687322 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.687293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn8kl\"" Jul 06 12:05:21.692049 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.692034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:05:21.706583 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.706559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpzwm" Jul 06 12:05:21.888729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.888696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mk5zf"] Jul 06 12:05:21.897860 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:21.897835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jpzwm"] Jul 06 12:05:21.898727 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:05:21.898699 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22db43_ec47_4ef9_8e47_caba959389e5.slice/crio-3c48e2892dd7bf5b37692c47c00386f02989287af40fdc140a0e49280177114e WatchSource:0}: Error finding container 3c48e2892dd7bf5b37692c47c00386f02989287af40fdc140a0e49280177114e: Status 404 returned error can't find the container with id 3c48e2892dd7bf5b37692c47c00386f02989287af40fdc140a0e49280177114e Jul 06 12:05:21.899245 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:05:21.899228 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526122c7_949b_4d5d_ac90_1643f978892d.slice/crio-26e64d622658dc1272e3698763d1a83f921f6ffa722cbdadd7c78dfb559a8276 WatchSource:0}: Error finding container 26e64d622658dc1272e3698763d1a83f921f6ffa722cbdadd7c78dfb559a8276: Status 404 returned error can't find the container with id 26e64d622658dc1272e3698763d1a83f921f6ffa722cbdadd7c78dfb559a8276 Jul 06 12:05:22.083538 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:22.083498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jpzwm" event={"ID":"526122c7-949b-4d5d-ac90-1643f978892d","Type":"ContainerStarted","Data":"26e64d622658dc1272e3698763d1a83f921f6ffa722cbdadd7c78dfb559a8276"} Jul 06 12:05:22.084607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:22.084579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mk5zf" event={"ID":"db22db43-ec47-4ef9-8e47-caba959389e5","Type":"ContainerStarted","Data":"3c48e2892dd7bf5b37692c47c00386f02989287af40fdc140a0e49280177114e"} Jul 06 12:05:24.516164 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:24.516114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:24.516775 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:24.516183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:05:24.516775 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:24.516261 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 12:05:24.516775 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:24.516283 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b9dd98c5-jhtdf: secret "image-registry-tls" not found Jul 06 12:05:24.516775 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:24.516317 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 12:05:24.516775 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:24.516353 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls podName:b0ec080b-c4b0-4aa0-8f03-c391417e89d2 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.516332069 +0000 UTC m=+101.237320890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls") pod "image-registry-57b9dd98c5-jhtdf" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2") : secret "image-registry-tls" not found Jul 06 12:05:24.516775 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:24.516378 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls podName:c45130cf-2eca-43f0-8cf9-534403a33df9 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.516361206 +0000 UTC m=+101.237350023 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls") pod "dns-default-26lvh" (UID: "c45130cf-2eca-43f0-8cf9-534403a33df9") : secret "dns-default-metrics-tls" not found Jul 06 12:05:26.099108 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:26.099066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mk5zf" event={"ID":"db22db43-ec47-4ef9-8e47-caba959389e5","Type":"ContainerStarted","Data":"cf754cbb013ed552c50ed84927c8702742c833fe2305b3d0969bede7f195e134"} Jul 06 12:05:26.099571 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:26.099159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:05:26.131588 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:26.131525 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mk5zf" podStartSLOduration=66.670718181 podStartE2EDuration="1m10.131508917s" totalImagesPullingTime="3.460790736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:26.130146942 +0000 UTC m=+70.851135782" watchObservedRunningTime="2026-07-06 12:05:26.131508917 +0000 UTC m=+70.852497757" Jul 06 12:05:28.105039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:28.104994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jpzwm" event={"ID":"526122c7-949b-4d5d-ac90-1643f978892d","Type":"ContainerStarted","Data":"cc666a35bfdd3323dd2ff04b7afffe1e7c77e4399b4222bc4b69fce8b2f98371"} Jul 06 12:05:28.132278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:28.132230 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jpzwm" podStartSLOduration=66.936901955 podStartE2EDuration="1m12.132213553s" totalImagesPullingTime="5.195311598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:28.13181742 +0000 UTC m=+72.852806255" watchObservedRunningTime="2026-07-06 12:05:28.132213553 +0000 UTC m=+72.853202392" Jul 06 12:05:34.397183 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.395776 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8f795cc85-wb5g9"] Jul 06 12:05:34.401094 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.401069 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.403897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.403868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nrwd4\"" Jul 06 12:05:34.403897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.403882 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 12:05:34.404085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.403909 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 12:05:34.404085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.403868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 12:05:34.404210 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.404200 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 12:05:34.404425 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.404406 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 12:05:34.404782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.404769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 12:05:34.414018 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.413998 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8f795cc85-wb5g9"] Jul 06 12:05:34.487494 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.487460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.487686 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.487509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-default-certificate\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.487686 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.487560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssnm4\" (UniqueName: \"kubernetes.io/projected/289d166f-52f9-4437-bf34-553f2d116868-kube-api-access-ssnm4\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.487686 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.487594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.487686 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.487658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-stats-auth\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.588772 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.588728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.588772 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.588780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-stats-auth\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.588995 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.588870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.588995 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:34.588930 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:35.088910319 +0000 UTC m=+79.809899137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : configmap references non-existent config key: service-ca.crt Jul 06 12:05:34.588995 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:34.588973 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 12:05:34.588995 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.588977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-default-certificate\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.589192 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.589001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssnm4\" (UniqueName: \"kubernetes.io/projected/289d166f-52f9-4437-bf34-553f2d116868-kube-api-access-ssnm4\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.589192 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:34.589031 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:35.089015764 +0000 UTC m=+79.810004582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : secret "router-metrics-certs-default" not found Jul 06 12:05:34.591343 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.591317 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-stats-auth\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.591466 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.591345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-default-certificate\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:34.614391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:34.614359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssnm4\" (UniqueName: \"kubernetes.io/projected/289d166f-52f9-4437-bf34-553f2d116868-kube-api-access-ssnm4\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:35.093055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:35.093008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:35.093233 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:35.093091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:35.093233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:35.093153 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 12:05:35.093233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:35.093218 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:36.093203801 +0000 UTC m=+80.814192620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : secret "router-metrics-certs-default" not found Jul 06 12:05:35.093233 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:35.093231 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:36.093225679 +0000 UTC m=+80.814214497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : configmap references non-existent config key: service-ca.crt Jul 06 12:05:36.101278 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:36.101236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:36.101699 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:36.101303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:36.101699 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:36.101406 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:38.101392451 +0000 UTC m=+82.822381269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : configmap references non-existent config key: service-ca.crt Jul 06 12:05:36.101699 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:36.101404 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 12:05:36.101699 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:36.101479 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:38.101461256 +0000 UTC m=+82.822450081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : secret "router-metrics-certs-default" not found Jul 06 12:05:38.116392 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:38.116353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:38.116820 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:38.116418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:38.116820 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:38.116504 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 12:05:38.116820 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:38.116528 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.116511061 +0000 UTC m=+86.837499879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : configmap references non-existent config key: service-ca.crt Jul 06 12:05:38.116820 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:38.116556 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.116547085 +0000 UTC m=+86.837535904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : secret "router-metrics-certs-default" not found Jul 06 12:05:40.817092 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.817056 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5lc7x"] Jul 06 12:05:40.820305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.820287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:40.824265 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.824239 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 12:05:40.824464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.824236 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 12:05:40.824538 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.824525 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q47gn\"" Jul 06 12:05:40.824929 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.824913 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 12:05:40.826136 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.826117 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 12:05:40.840140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.840067 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lc7x"] Jul 06 12:05:40.940371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.940326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:40.940579 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.940453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccc8a323-e81a-4a98-b281-1b42b3f17f25-data-volume\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:40.940579 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.940497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdh2z\" (UniqueName: \"kubernetes.io/projected/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-api-access-bdh2z\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:40.940579 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.940522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:40.940753 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:40.940605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccc8a323-e81a-4a98-b281-1b42b3f17f25-crio-socket\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.041965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.041926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccc8a323-e81a-4a98-b281-1b42b3f17f25-data-volume\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.041965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.041966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdh2z\" (UniqueName: \"kubernetes.io/projected/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-api-access-bdh2z\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.041986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.042025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccc8a323-e81a-4a98-b281-1b42b3f17f25-crio-socket\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.042058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.042129 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.042164 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.042161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccc8a323-e81a-4a98-b281-1b42b3f17f25-crio-socket\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.042209 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.042205 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.542186431 +0000 UTC m=+86.263175260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : configmap "kube-rbac-proxy" not found Jul 06 12:05:41.042516 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.042226 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.542217853 +0000 UTC m=+86.263206674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.042516 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.042401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccc8a323-e81a-4a98-b281-1b42b3f17f25-data-volume\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.052020 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.051985 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdh2z\" (UniqueName: \"kubernetes.io/projected/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-api-access-bdh2z\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.547432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.547392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.547623 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:41.547465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:41.547623 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.547526 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:41.547623 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.547555 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:41.547623 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.547587 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.547573278 +0000 UTC m=+87.268562096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : configmap "kube-rbac-proxy" not found Jul 06 12:05:41.547623 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:41.547619 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.547606703 +0000 UTC m=+87.268595522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:42.152044 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.152009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:42.152496 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.152079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:42.152496 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.152195 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:50.152170932 +0000 UTC m=+94.873159753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : configmap references non-existent config key: service-ca.crt Jul 06 12:05:42.152496 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.152201 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 12:05:42.152496 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.152264 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:50.152246653 +0000 UTC m=+94.873235473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : secret "router-metrics-certs-default" not found Jul 06 12:05:42.556201 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.556126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:42.556366 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.556247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:42.556366 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.556297 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:42.556366 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.556321 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:42.556462 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.556372 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:44.556356062 +0000 UTC m=+89.277344880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:42.556462 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:42.556388 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:44.556381937 +0000 UTC m=+89.277370755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : configmap "kube-rbac-proxy" not found Jul 06 12:05:42.929105 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.929015 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-f6rdg"] Jul 06 12:05:42.931999 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.931980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:42.940698 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.940677 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 12:05:42.940839 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.940754 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 12:05:42.941451 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.941433 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 12:05:42.941866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.941852 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-75pqb\"" Jul 06 12:05:42.942844 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.942831 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 12:05:42.957881 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:42.956183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-f6rdg"] Jul 06 12:05:43.060450 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.060410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/462546eb-b241-4d57-8a66-90ff2e8ae2d8-signing-key\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.060626 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.060462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhk5l\" (UniqueName: \"kubernetes.io/projected/462546eb-b241-4d57-8a66-90ff2e8ae2d8-kube-api-access-xhk5l\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.060626 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.060487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/462546eb-b241-4d57-8a66-90ff2e8ae2d8-signing-cabundle\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.161682 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.161639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/462546eb-b241-4d57-8a66-90ff2e8ae2d8-signing-key\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.162130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.161694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhk5l\" (UniqueName: \"kubernetes.io/projected/462546eb-b241-4d57-8a66-90ff2e8ae2d8-kube-api-access-xhk5l\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.162130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.161717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/462546eb-b241-4d57-8a66-90ff2e8ae2d8-signing-cabundle\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.162496 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.162473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/462546eb-b241-4d57-8a66-90ff2e8ae2d8-signing-cabundle\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.164216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.164190 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/462546eb-b241-4d57-8a66-90ff2e8ae2d8-signing-key\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.173095 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.173059 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhk5l\" (UniqueName: \"kubernetes.io/projected/462546eb-b241-4d57-8a66-90ff2e8ae2d8-kube-api-access-xhk5l\") pod \"service-ca-758f599c5-f6rdg\" (UID: \"462546eb-b241-4d57-8a66-90ff2e8ae2d8\") " pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.240743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.240660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-f6rdg" Jul 06 12:05:43.381008 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.380974 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-f6rdg"] Jul 06 12:05:43.385097 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:05:43.385069 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462546eb_b241_4d57_8a66_90ff2e8ae2d8.slice/crio-815f9f1c5ca6a477de28803fcc2934ba4e7e532791f21a07aace6e37073601d7 WatchSource:0}: Error finding container 815f9f1c5ca6a477de28803fcc2934ba4e7e532791f21a07aace6e37073601d7: Status 404 returned error can't find the container with id 815f9f1c5ca6a477de28803fcc2934ba4e7e532791f21a07aace6e37073601d7 Jul 06 12:05:43.432330 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:43.432301 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqb6h_1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c/dns-node-resolver/0.log" Jul 06 12:05:44.145544 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:44.145501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-f6rdg" event={"ID":"462546eb-b241-4d57-8a66-90ff2e8ae2d8","Type":"ContainerStarted","Data":"815f9f1c5ca6a477de28803fcc2934ba4e7e532791f21a07aace6e37073601d7"} Jul 06 12:05:44.573762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:44.573727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:44.574201 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:44.573822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:44.574201 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:44.573896 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:44.574201 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:44.573964 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:44.574201 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:44.573983 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:48.573961525 +0000 UTC m=+93.294950360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : configmap "kube-rbac-proxy" not found Jul 06 12:05:44.574201 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:44.574018 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:48.574007264 +0000 UTC m=+93.294996098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:44.830590 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:44.830509 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qm75_ee561c3f-af45-41d7-a7ce-3680040d9761/node-ca/0.log" Jul 06 12:05:45.634406 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:45.634315 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p5p77_9fd371b4-8ef9-4bd1-8187-faf157957179/serve-healthcheck-canary/0.log" Jul 06 12:05:46.152489 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:46.152453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-f6rdg" event={"ID":"462546eb-b241-4d57-8a66-90ff2e8ae2d8","Type":"ContainerStarted","Data":"3366d39d8066b38ec62f93b880e8b41bbfd28ecbe352b9470b408a32eddf9e02"} Jul 06 12:05:46.177936 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:46.177881 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-f6rdg" podStartSLOduration=2.205577114 podStartE2EDuration="4.177864661s" totalImagesPullingTime="1.972287547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:46.177132362 +0000 UTC m=+90.898121201" watchObservedRunningTime="2026-07-06 12:05:46.177864661 +0000 UTC m=+90.898853501" Jul 06 12:05:48.611467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:48.611417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:48.611962 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:48.611481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:48.611962 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:48.611546 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 12:05:48.611962 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:48.611592 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 12:05:48.611962 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:48.611615 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.611598359 +0000 UTC m=+101.332587177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : configmap "kube-rbac-proxy" not found Jul 06 12:05:48.611962 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:48.611632 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls podName:ccc8a323-e81a-4a98-b281-1b42b3f17f25 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.611621417 +0000 UTC m=+101.332610236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lc7x" (UID: "ccc8a323-e81a-4a98-b281-1b42b3f17f25") : secret "insights-runtime-extractor-tls" not found Jul 06 12:05:50.223543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:50.223508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:50.223956 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:50.223562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:05:50.223956 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:50.223671 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 12:05:50.223956 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:50.223697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:06.223677728 +0000 UTC m=+110.944666549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : configmap references non-existent config key: service-ca.crt Jul 06 12:05:50.223956 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:05:50.223723 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs podName:289d166f-52f9-4437-bf34-553f2d116868 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:06.223715938 +0000 UTC m=+110.944704757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs") pod "router-default-8f795cc85-wb5g9" (UID: "289d166f-52f9-4437-bf34-553f2d116868") : secret "router-metrics-certs-default" not found Jul 06 12:05:56.575736 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.575706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:05:56.576087 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.575790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:56.578130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.578102 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"image-registry-57b9dd98c5-jhtdf\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:56.578240 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.578110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45130cf-2eca-43f0-8cf9-534403a33df9-metrics-tls\") pod \"dns-default-26lvh\" (UID: \"c45130cf-2eca-43f0-8cf9-534403a33df9\") " pod="openshift-dns/dns-default-26lvh" Jul 06 12:05:56.677232 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.677188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:56.677431 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.677296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:56.677889 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.677865 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccc8a323-e81a-4a98-b281-1b42b3f17f25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:56.679510 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.679490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccc8a323-e81a-4a98-b281-1b42b3f17f25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lc7x\" (UID: \"ccc8a323-e81a-4a98-b281-1b42b3f17f25\") " pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:56.729397 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.729350 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lc7x" Jul 06 12:05:56.817025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.816957 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfj6t\"" Jul 06 12:05:56.824396 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.824371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:56.863814 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.863765 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qcfg\"" Jul 06 12:05:56.867519 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.867493 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lc7x"] Jul 06 12:05:56.871189 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.870991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26lvh" Jul 06 12:05:56.872215 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:05:56.872174 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc8a323_e81a_4a98_b281_1b42b3f17f25.slice/crio-769009bb86e0388e960aaac0d11985649c980168cc0ebc66f132f6ddbd775379 WatchSource:0}: Error finding container 769009bb86e0388e960aaac0d11985649c980168cc0ebc66f132f6ddbd775379: Status 404 returned error can't find the container with id 769009bb86e0388e960aaac0d11985649c980168cc0ebc66f132f6ddbd775379 Jul 06 12:05:56.966446 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:56.966411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57b9dd98c5-jhtdf"] Jul 06 12:05:56.971319 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:05:56.971288 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ec080b_c4b0_4aa0_8f03_c391417e89d2.slice/crio-1ff4634cecb0b42341b0b692492bcbed7bbc0596716154f994d8a0c8f4255d7b WatchSource:0}: Error finding container 1ff4634cecb0b42341b0b692492bcbed7bbc0596716154f994d8a0c8f4255d7b: Status 404 returned error can't find the container with id 1ff4634cecb0b42341b0b692492bcbed7bbc0596716154f994d8a0c8f4255d7b Jul 06 12:05:57.015735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.015710 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26lvh"] Jul 06 12:05:57.019880 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:05:57.019847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45130cf_2eca_43f0_8cf9_534403a33df9.slice/crio-5c850c6dbef187fc38c09ee56e8dd275226cb6d79e6253fa3a333aa7025ac68b WatchSource:0}: Error finding container 5c850c6dbef187fc38c09ee56e8dd275226cb6d79e6253fa3a333aa7025ac68b: Status 404 returned error can't find the container with id 5c850c6dbef187fc38c09ee56e8dd275226cb6d79e6253fa3a333aa7025ac68b Jul 06 12:05:57.103000 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.102914 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mk5zf" Jul 06 12:05:57.183213 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.183176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26lvh" event={"ID":"c45130cf-2eca-43f0-8cf9-534403a33df9","Type":"ContainerStarted","Data":"5c850c6dbef187fc38c09ee56e8dd275226cb6d79e6253fa3a333aa7025ac68b"} Jul 06 12:05:57.184370 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.184339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lc7x" event={"ID":"ccc8a323-e81a-4a98-b281-1b42b3f17f25","Type":"ContainerStarted","Data":"769009bb86e0388e960aaac0d11985649c980168cc0ebc66f132f6ddbd775379"} Jul 06 12:05:57.185756 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.185732 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" event={"ID":"b0ec080b-c4b0-4aa0-8f03-c391417e89d2","Type":"ContainerStarted","Data":"bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0"} Jul 06 12:05:57.185895 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.185764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" event={"ID":"b0ec080b-c4b0-4aa0-8f03-c391417e89d2","Type":"ContainerStarted","Data":"1ff4634cecb0b42341b0b692492bcbed7bbc0596716154f994d8a0c8f4255d7b"} Jul 06 12:05:57.185955 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.185925 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:05:57.209365 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:05:57.209312 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" podStartSLOduration=101.209299325 podStartE2EDuration="1m41.209299325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:57.208694831 +0000 UTC m=+101.929683671" watchObservedRunningTime="2026-07-06 12:05:57.209299325 +0000 UTC m=+101.930288143" Jul 06 12:06:03.208066 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:03.208013 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26lvh" event={"ID":"c45130cf-2eca-43f0-8cf9-534403a33df9","Type":"ContainerStarted","Data":"c600a66efd41d2bfba4769c533e7be165c86c5d87d07e9179cba36bbcbce1181"} Jul 06 12:06:03.208521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:03.208129 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26lvh" Jul 06 12:06:03.208521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:03.208153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26lvh" event={"ID":"c45130cf-2eca-43f0-8cf9-534403a33df9","Type":"ContainerStarted","Data":"7e2ae9b1b5f16c2099f5719f0afb9df4645505e57e305c5b17e098b08b0ce374"} Jul 06 12:06:03.210065 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:03.210040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lc7x" event={"ID":"ccc8a323-e81a-4a98-b281-1b42b3f17f25","Type":"ContainerStarted","Data":"cc1549887937130e13a043d415c21bb96319b42bae3032ff006348662dc2ecc2"} Jul 06 12:06:03.210170 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:03.210090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lc7x" event={"ID":"ccc8a323-e81a-4a98-b281-1b42b3f17f25","Type":"ContainerStarted","Data":"6c656883f7afddb1ea0900c2629079947ba58c954d8de7b872c83f7b5161ccfc"} Jul 06 12:06:03.228756 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:03.228707 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-26lvh" podStartSLOduration=66.080569377 podStartE2EDuration="1m11.228688903s" totalImagesPullingTime="5.148119526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:03.227625985 +0000 UTC m=+107.948614819" watchObservedRunningTime="2026-07-06 12:06:03.228688903 +0000 UTC m=+107.949677747" Jul 06 12:06:06.221833 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.221784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lc7x" event={"ID":"ccc8a323-e81a-4a98-b281-1b42b3f17f25","Type":"ContainerStarted","Data":"3484c6d4474bfa8ae82740b894d3600e9781bcdf38a8a93a3600db65741cd7c7"} Jul 06 12:06:06.245553 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.245504 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5lc7x" podStartSLOduration=17.598197344 podStartE2EDuration="26.245490002s" totalImagesPullingTime="8.647292658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:05:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:06.24485208 +0000 UTC m=+110.965840919" watchObservedRunningTime="2026-07-06 12:06:06.245490002 +0000 UTC m=+110.966478841" Jul 06 12:06:06.252159 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.252136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:06.252250 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.252209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:06.252764 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.252746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289d166f-52f9-4437-bf34-553f2d116868-service-ca-bundle\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:06.254541 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.254520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/289d166f-52f9-4437-bf34-553f2d116868-metrics-certs\") pod \"router-default-8f795cc85-wb5g9\" (UID: \"289d166f-52f9-4437-bf34-553f2d116868\") " pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:06.509690 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.509603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:06.638477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:06.638443 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8f795cc85-wb5g9"] Jul 06 12:06:06.641589 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:06.641561 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289d166f_52f9_4437_bf34_553f2d116868.slice/crio-65953070890dfeab6e47d61b8fbba1b9ecaebea4950081c79e5ecda920f91915 WatchSource:0}: Error finding container 65953070890dfeab6e47d61b8fbba1b9ecaebea4950081c79e5ecda920f91915: Status 404 returned error can't find the container with id 65953070890dfeab6e47d61b8fbba1b9ecaebea4950081c79e5ecda920f91915 Jul 06 12:06:07.226656 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:07.226614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8f795cc85-wb5g9" event={"ID":"289d166f-52f9-4437-bf34-553f2d116868","Type":"ContainerStarted","Data":"eca460fbba112a9b203aa3e5a553d0873caea803ce4a988e069a7dad01f97745"} Jul 06 12:06:07.227173 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:07.226672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8f795cc85-wb5g9" event={"ID":"289d166f-52f9-4437-bf34-553f2d116868","Type":"ContainerStarted","Data":"65953070890dfeab6e47d61b8fbba1b9ecaebea4950081c79e5ecda920f91915"} Jul 06 12:06:07.253862 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:07.253793 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8f795cc85-wb5g9" podStartSLOduration=33.253773767 podStartE2EDuration="33.253773767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:07.252373799 +0000 UTC m=+111.973362643" watchObservedRunningTime="2026-07-06 12:06:07.253773767 +0000 UTC m=+111.974762607" Jul 06 12:06:07.510026 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:07.509945 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:07.512215 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:07.512186 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:08.230193 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:08.230165 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:08.231447 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:08.231427 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8f795cc85-wb5g9" Jul 06 12:06:10.920818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.920768 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-gdt29"] Jul 06 12:06:10.924024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.924005 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:10.927860 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.927834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 12:06:10.927993 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.927846 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 12:06:10.928274 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.928261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2sqdp\"" Jul 06 12:06:10.941791 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.941765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gdt29"] Jul 06 12:06:10.991369 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.991335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lr8\" (UniqueName: \"kubernetes.io/projected/38b36935-98c5-4b0d-83ee-10ac524d9755-kube-api-access-72lr8\") pod \"downloads-685bfb5f64-gdt29\" (UID: \"38b36935-98c5-4b0d-83ee-10ac524d9755\") " pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:10.998226 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:10.998203 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59987b659c-fw2wl"] Jul 06 12:06:11.001125 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.001109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.005128 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.005107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 12:06:11.005285 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.005169 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 12:06:11.005388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.005374 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xxd9g\"" Jul 06 12:06:11.013439 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.013420 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 12:06:11.014546 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.014532 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 12:06:11.014868 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.014841 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 12:06:11.017097 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.017078 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9"] Jul 06 12:06:11.020088 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.020071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:11.022673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.022641 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59987b659c-fw2wl"] Jul 06 12:06:11.023936 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.023915 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k7vd8\"" Jul 06 12:06:11.028283 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.028264 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 12:06:11.046242 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.046212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9"] Jul 06 12:06:11.092433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lr8\" (UniqueName: \"kubernetes.io/projected/38b36935-98c5-4b0d-83ee-10ac524d9755-kube-api-access-72lr8\") pod \"downloads-685bfb5f64-gdt29\" (UID: \"38b36935-98c5-4b0d-83ee-10ac524d9755\") " pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:11.092632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-oauth-serving-cert\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.092632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-oauth-config\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.092632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-console-config\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.092632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/df1de742-8a39-4c77-8198-486bcbd8e845-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8vcm9\" (UID: \"df1de742-8a39-4c77-8198-486bcbd8e845\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:11.092632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-service-ca\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.092908 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4qc\" (UniqueName: \"kubernetes.io/projected/15019f44-bc22-4308-b24e-39727de82e0f-kube-api-access-sz4qc\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.092908 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.092735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-serving-cert\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.114078 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.114048 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lr8\" (UniqueName: \"kubernetes.io/projected/38b36935-98c5-4b0d-83ee-10ac524d9755-kube-api-access-72lr8\") pod \"downloads-685bfb5f64-gdt29\" (UID: \"38b36935-98c5-4b0d-83ee-10ac524d9755\") " pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:11.193508 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-serving-cert\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.193508 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-oauth-serving-cert\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.193744 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-oauth-config\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.193744 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-console-config\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.193744 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/df1de742-8a39-4c77-8198-486bcbd8e845-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8vcm9\" (UID: \"df1de742-8a39-4c77-8198-486bcbd8e845\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:11.193744 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-service-ca\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.194009 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.193777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4qc\" (UniqueName: \"kubernetes.io/projected/15019f44-bc22-4308-b24e-39727de82e0f-kube-api-access-sz4qc\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.194467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.194442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-oauth-serving-cert\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.194597 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.194493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-service-ca\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.194597 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.194473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-console-config\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.196161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.196141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-oauth-config\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.196268 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.196248 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/df1de742-8a39-4c77-8198-486bcbd8e845-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8vcm9\" (UID: \"df1de742-8a39-4c77-8198-486bcbd8e845\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:11.196308 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.196279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-serving-cert\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.220069 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.220042 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4qc\" (UniqueName: \"kubernetes.io/projected/15019f44-bc22-4308-b24e-39727de82e0f-kube-api-access-sz4qc\") pod \"console-59987b659c-fw2wl\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.233867 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.233832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:11.310233 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.310192 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:11.329285 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.329247 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:11.402596 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.402036 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gdt29"] Jul 06 12:06:11.411032 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:11.410974 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b36935_98c5_4b0d_83ee_10ac524d9755.slice/crio-d764653a9e2c0a22a10c84326d8de2adc583ff727a88c65fa504577166476713 WatchSource:0}: Error finding container d764653a9e2c0a22a10c84326d8de2adc583ff727a88c65fa504577166476713: Status 404 returned error can't find the container with id d764653a9e2c0a22a10c84326d8de2adc583ff727a88c65fa504577166476713 Jul 06 12:06:11.514651 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.514623 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9"] Jul 06 12:06:11.515596 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:11.515573 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59987b659c-fw2wl"] Jul 06 12:06:11.516970 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:11.516944 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1de742_8a39_4c77_8198_486bcbd8e845.slice/crio-ef373d8ca15adc2f2bc34dd2f7846d15024ebd62f5574693124650a582f049e0 WatchSource:0}: Error finding container ef373d8ca15adc2f2bc34dd2f7846d15024ebd62f5574693124650a582f049e0: Status 404 returned error can't find the container with id ef373d8ca15adc2f2bc34dd2f7846d15024ebd62f5574693124650a582f049e0 Jul 06 12:06:11.517511 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:11.517491 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15019f44_bc22_4308_b24e_39727de82e0f.slice/crio-35e2afac04db8b3876ce2a8b80260d352389f564150d2409ac9ab91203ce383a WatchSource:0}: Error finding container 35e2afac04db8b3876ce2a8b80260d352389f564150d2409ac9ab91203ce383a: Status 404 returned error can't find the container with id 35e2afac04db8b3876ce2a8b80260d352389f564150d2409ac9ab91203ce383a Jul 06 12:06:12.245483 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:12.245448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gdt29" event={"ID":"38b36935-98c5-4b0d-83ee-10ac524d9755","Type":"ContainerStarted","Data":"d764653a9e2c0a22a10c84326d8de2adc583ff727a88c65fa504577166476713"} Jul 06 12:06:12.248383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:12.246951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59987b659c-fw2wl" event={"ID":"15019f44-bc22-4308-b24e-39727de82e0f","Type":"ContainerStarted","Data":"35e2afac04db8b3876ce2a8b80260d352389f564150d2409ac9ab91203ce383a"} Jul 06 12:06:12.248548 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:12.248474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" event={"ID":"df1de742-8a39-4c77-8198-486bcbd8e845","Type":"ContainerStarted","Data":"ef373d8ca15adc2f2bc34dd2f7846d15024ebd62f5574693124650a582f049e0"} Jul 06 12:06:13.216440 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:13.216351 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26lvh" Jul 06 12:06:13.258666 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:13.257703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" event={"ID":"df1de742-8a39-4c77-8198-486bcbd8e845","Type":"ContainerStarted","Data":"809c6590debe5af70e205b9aa5c3ddf2501c10ac27571746400f01429cefdef2"} Jul 06 12:06:13.258666 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:13.258577 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:13.264316 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:13.264288 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" Jul 06 12:06:13.277456 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:13.277401 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8vcm9" podStartSLOduration=1.950329837 podStartE2EDuration="3.277382461s" totalImagesPullingTime="1.327052624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:13.276119128 +0000 UTC m=+117.997107968" watchObservedRunningTime="2026-07-06 12:06:13.277382461 +0000 UTC m=+117.998371301" Jul 06 12:06:13.997410 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:13.997371 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8"] Jul 06 12:06:14.002668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.002637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.006753 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.006705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 12:06:14.006753 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.006761 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 12:06:14.007149 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.006850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xgfcv\"" Jul 06 12:06:14.007149 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.007015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 12:06:14.007149 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.007031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 12:06:14.007149 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.007064 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 12:06:14.012551 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.012531 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8"] Jul 06 12:06:14.019001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.018532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.019001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.018605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.019001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.018661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5536358-90d8-4100-8362-dae17cd29991-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.019001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.018720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcpsp\" (UniqueName: \"kubernetes.io/projected/d5536358-90d8-4100-8362-dae17cd29991-kube-api-access-zcpsp\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.119958 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.119924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcpsp\" (UniqueName: \"kubernetes.io/projected/d5536358-90d8-4100-8362-dae17cd29991-kube-api-access-zcpsp\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.120135 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.119977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.120135 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.120035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.120135 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.120091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5536358-90d8-4100-8362-dae17cd29991-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.120452 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:14.120419 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 12:06:14.120595 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:14.120494 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-tls podName:d5536358-90d8-4100-8362-dae17cd29991 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:14.620472778 +0000 UTC m=+119.341461597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-c6rb8" (UID: "d5536358-90d8-4100-8362-dae17cd29991") : secret "prometheus-operator-tls" not found Jul 06 12:06:14.120941 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.120917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5536358-90d8-4100-8362-dae17cd29991-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.123865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.123816 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.132407 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.132377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcpsp\" (UniqueName: \"kubernetes.io/projected/d5536358-90d8-4100-8362-dae17cd29991-kube-api-access-zcpsp\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.624744 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.624626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.627703 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.627674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5536358-90d8-4100-8362-dae17cd29991-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c6rb8\" (UID: \"d5536358-90d8-4100-8362-dae17cd29991\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:14.916661 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:14.916580 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" Jul 06 12:06:15.083226 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:15.083196 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8"] Jul 06 12:06:15.084484 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:15.084454 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5536358_90d8_4100_8362_dae17cd29991.slice/crio-9c7c79cd69a3d8a153ff6e4a23b25e34d804076c6bdfc9b8d1dc4b75b8dc6f6c WatchSource:0}: Error finding container 9c7c79cd69a3d8a153ff6e4a23b25e34d804076c6bdfc9b8d1dc4b75b8dc6f6c: Status 404 returned error can't find the container with id 9c7c79cd69a3d8a153ff6e4a23b25e34d804076c6bdfc9b8d1dc4b75b8dc6f6c Jul 06 12:06:15.271160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:15.271116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" event={"ID":"d5536358-90d8-4100-8362-dae17cd29991","Type":"ContainerStarted","Data":"9c7c79cd69a3d8a153ff6e4a23b25e34d804076c6bdfc9b8d1dc4b75b8dc6f6c"} Jul 06 12:06:15.272894 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:15.272855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59987b659c-fw2wl" event={"ID":"15019f44-bc22-4308-b24e-39727de82e0f","Type":"ContainerStarted","Data":"3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023"} Jul 06 12:06:15.306647 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:15.306591 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59987b659c-fw2wl" podStartSLOduration=1.85829741 podStartE2EDuration="5.306571046s" totalImagesPullingTime="3.448273636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:15.306082312 +0000 UTC m=+120.027071153" watchObservedRunningTime="2026-07-06 12:06:15.306571046 +0000 UTC m=+120.027559865" Jul 06 12:06:16.830661 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:16.830613 2581 patch_prober.go:28] interesting pod/image-registry-57b9dd98c5-jhtdf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 12:06:16.831170 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:16.830686 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" podUID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 12:06:17.284517 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.284474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" event={"ID":"d5536358-90d8-4100-8362-dae17cd29991","Type":"ContainerStarted","Data":"01b39d0ae54575c73f01afda56bded6488eb5120111bf797c2251be9e0608748"} Jul 06 12:06:17.284730 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.284580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" event={"ID":"d5536358-90d8-4100-8362-dae17cd29991","Type":"ContainerStarted","Data":"848d564d69b60e0ae105c2c11fd33a5e1c053b1bb2b1e21e60fde47b26016607"} Jul 06 12:06:17.330446 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.330381 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c6rb8" podStartSLOduration=2.482343964 podStartE2EDuration="4.330357286s" totalImagesPullingTime="1.848013322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:17.329211623 +0000 UTC m=+122.050200466" watchObservedRunningTime="2026-07-06 12:06:17.330357286 +0000 UTC m=+122.051346127" Jul 06 12:06:17.428250 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.428214 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-646c74cfbb-cbgpq"] Jul 06 12:06:17.435127 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.435086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.459625 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.459593 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 12:06:17.468022 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.467991 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646c74cfbb-cbgpq"] Jul 06 12:06:17.552125 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-oauth-config\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.552125 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-oauth-serving-cert\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.552125 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-config\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.552383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-trusted-ca-bundle\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.552383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmv9b\" (UniqueName: \"kubernetes.io/projected/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-kube-api-access-kmv9b\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.552383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-serving-cert\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.552383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.552289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-service-ca\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmv9b\" (UniqueName: \"kubernetes.io/projected/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-kube-api-access-kmv9b\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-serving-cert\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-service-ca\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-oauth-config\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-oauth-serving-cert\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-config\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.653943 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.653869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-trusted-ca-bundle\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.654478 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.654444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-service-ca\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.654613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.654542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-config\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.655226 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.655195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-trusted-ca-bundle\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.655346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.655320 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-oauth-serving-cert\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.656668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.656649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-serving-cert\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.656755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.656734 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-oauth-config\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.722293 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.722253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmv9b\" (UniqueName: \"kubernetes.io/projected/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-kube-api-access-kmv9b\") pod \"console-646c74cfbb-cbgpq\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.752174 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.752138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:17.986815 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:17.986765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646c74cfbb-cbgpq"] Jul 06 12:06:17.990547 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:17.990511 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef38c5dc_5b0d_4557_bc06_9b8b06be2f05.slice/crio-e75cebcbca8e7560f1f0540d305767515d5f8a68548aea4a829c69dc750c6bc7 WatchSource:0}: Error finding container e75cebcbca8e7560f1f0540d305767515d5f8a68548aea4a829c69dc750c6bc7: Status 404 returned error can't find the container with id e75cebcbca8e7560f1f0540d305767515d5f8a68548aea4a829c69dc750c6bc7 Jul 06 12:06:18.196316 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:18.196283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:06:18.291035 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:18.290973 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c74cfbb-cbgpq" event={"ID":"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05","Type":"ContainerStarted","Data":"2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f"} Jul 06 12:06:18.291035 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:18.291025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c74cfbb-cbgpq" event={"ID":"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05","Type":"ContainerStarted","Data":"e75cebcbca8e7560f1f0540d305767515d5f8a68548aea4a829c69dc750c6bc7"} Jul 06 12:06:18.334533 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:18.334428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-646c74cfbb-cbgpq" podStartSLOduration=1.334405995 podStartE2EDuration="1.334405995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:18.33364396 +0000 UTC m=+123.054632808" watchObservedRunningTime="2026-07-06 12:06:18.334405995 +0000 UTC m=+123.055394838" Jul 06 12:06:19.650453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.650414 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd"] Jul 06 12:06:19.655480 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.655451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.655638 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.655607 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7"] Jul 06 12:06:19.660604 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.660582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.660828 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.660682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 12:06:19.660909 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.660866 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 12:06:19.660991 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.660726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xrgt2\"" Jul 06 12:06:19.671167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.671149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 12:06:19.671572 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.671555 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 12:06:19.676653 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.676634 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dhc7n\"" Jul 06 12:06:19.680080 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.680056 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 12:06:19.690067 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.689609 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd"] Jul 06 12:06:19.691008 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.690984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7"] Jul 06 12:06:19.709914 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.709884 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tlnm7"] Jul 06 12:06:19.714690 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.714400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.719660 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.719576 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 12:06:19.720379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.719984 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 12:06:19.720379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.720007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bgdrk\"" Jul 06 12:06:19.720379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.720282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 12:06:19.771157 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9038e8de-b6a6-428e-982b-24c6d30c9b3c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.771348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9038e8de-b6a6-428e-982b-24c6d30c9b3c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.771348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-sys\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.771348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-root\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-wtmp\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-textfile\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-tls\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a69a838-8795-48d9-a809-59452a9b77c5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a5f68e-e68b-4e74-a543-383b30dac7db-metrics-client-ca\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771607 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9kt7\" (UniqueName: \"kubernetes.io/projected/64a5f68e-e68b-4e74-a543-383b30dac7db-kube-api-access-z9kt7\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.771966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a69a838-8795-48d9-a809-59452a9b77c5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.771966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx4xc\" (UniqueName: \"kubernetes.io/projected/4a69a838-8795-48d9-a809-59452a9b77c5-kube-api-access-vx4xc\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.771966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.771966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fkz7\" (UniqueName: \"kubernetes.io/projected/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-api-access-8fkz7\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.771966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.771842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a69a838-8795-48d9-a809-59452a9b77c5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.872780 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.872780 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-root\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-wtmp\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-textfile\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-tls\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.873037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.872984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a69a838-8795-48d9-a809-59452a9b77c5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a5f68e-e68b-4e74-a543-383b30dac7db-metrics-client-ca\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9kt7\" (UniqueName: \"kubernetes.io/projected/64a5f68e-e68b-4e74-a543-383b30dac7db-kube-api-access-z9kt7\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a69a838-8795-48d9-a809-59452a9b77c5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx4xc\" (UniqueName: \"kubernetes.io/projected/4a69a838-8795-48d9-a809-59452a9b77c5-kube-api-access-vx4xc\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fkz7\" (UniqueName: \"kubernetes.io/projected/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-api-access-8fkz7\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a69a838-8795-48d9-a809-59452a9b77c5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.873323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9038e8de-b6a6-428e-982b-24c6d30c9b3c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.873782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9038e8de-b6a6-428e-982b-24c6d30c9b3c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.873782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-sys\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.873782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.873457 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-sys\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.874507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.874586 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-root\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.874713 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-wtmp\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.875012 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-textfile\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:19.875392 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:19.875462 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-tls podName:64a5f68e-e68b-4e74-a543-383b30dac7db nodeName:}" failed. No retries permitted until 2026-07-06 12:06:20.375441856 +0000 UTC m=+125.096430685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-tls") pod "node-exporter-tlnm7" (UID: "64a5f68e-e68b-4e74-a543-383b30dac7db") : secret "node-exporter-tls" not found Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.875485 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a69a838-8795-48d9-a809-59452a9b77c5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.876221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.876073 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9038e8de-b6a6-428e-982b-24c6d30c9b3c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.876771 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.876583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.876771 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.876735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9038e8de-b6a6-428e-982b-24c6d30c9b3c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.877546 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.877521 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a5f68e-e68b-4e74-a543-383b30dac7db-metrics-client-ca\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.878066 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.878041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a69a838-8795-48d9-a809-59452a9b77c5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.879613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.879431 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.879613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.879540 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.879613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.879568 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a69a838-8795-48d9-a809-59452a9b77c5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.881751 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.881722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.888430 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.888362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9kt7\" (UniqueName: \"kubernetes.io/projected/64a5f68e-e68b-4e74-a543-383b30dac7db-kube-api-access-z9kt7\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:19.888548 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.888439 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fkz7\" (UniqueName: \"kubernetes.io/projected/9038e8de-b6a6-428e-982b-24c6d30c9b3c-kube-api-access-8fkz7\") pod \"kube-state-metrics-7c9dbb8b7d-242n7\" (UID: \"9038e8de-b6a6-428e-982b-24c6d30c9b3c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:19.902239 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.902146 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx4xc\" (UniqueName: \"kubernetes.io/projected/4a69a838-8795-48d9-a809-59452a9b77c5-kube-api-access-vx4xc\") pod \"openshift-state-metrics-54cf96dfcf-lfdbd\" (UID: \"4a69a838-8795-48d9-a809-59452a9b77c5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.969604 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.969362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" Jul 06 12:06:19.976546 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:19.976516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" Jul 06 12:06:20.153678 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.153650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd"] Jul 06 12:06:20.156389 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:20.156358 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a69a838_8795_48d9_a809_59452a9b77c5.slice/crio-2c76f80b32221b151e1c4d328b46e00b447d31704d793d2524083baaff068232 WatchSource:0}: Error finding container 2c76f80b32221b151e1c4d328b46e00b447d31704d793d2524083baaff068232: Status 404 returned error can't find the container with id 2c76f80b32221b151e1c4d328b46e00b447d31704d793d2524083baaff068232 Jul 06 12:06:20.178422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.178331 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7"] Jul 06 12:06:20.186859 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:20.186831 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9038e8de_b6a6_428e_982b_24c6d30c9b3c.slice/crio-de2baaa2b2c75f178f8161f77d648b41e1897b4e85f0d9068fe39fbf2235a63d WatchSource:0}: Error finding container de2baaa2b2c75f178f8161f77d648b41e1897b4e85f0d9068fe39fbf2235a63d: Status 404 returned error can't find the container with id de2baaa2b2c75f178f8161f77d648b41e1897b4e85f0d9068fe39fbf2235a63d Jul 06 12:06:20.300602 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.300571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" event={"ID":"9038e8de-b6a6-428e-982b-24c6d30c9b3c","Type":"ContainerStarted","Data":"de2baaa2b2c75f178f8161f77d648b41e1897b4e85f0d9068fe39fbf2235a63d"} Jul 06 12:06:20.302511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.302482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" event={"ID":"4a69a838-8795-48d9-a809-59452a9b77c5","Type":"ContainerStarted","Data":"aaaac1c3efb2c535d12c6d252b0e31f8962ffa500bb3dc970a5bb278acc04d0e"} Jul 06 12:06:20.302615 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.302545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" event={"ID":"4a69a838-8795-48d9-a809-59452a9b77c5","Type":"ContainerStarted","Data":"1a0cd5879d4b65725ff1717a50816a17315b54562fe01a7cdcb094ee4ce35fd0"} Jul 06 12:06:20.302615 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.302576 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" event={"ID":"4a69a838-8795-48d9-a809-59452a9b77c5","Type":"ContainerStarted","Data":"2c76f80b32221b151e1c4d328b46e00b447d31704d793d2524083baaff068232"} Jul 06 12:06:20.378062 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.378028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-tls\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:20.380885 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.380852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64a5f68e-e68b-4e74-a543-383b30dac7db-node-exporter-tls\") pod \"node-exporter-tlnm7\" (UID: \"64a5f68e-e68b-4e74-a543-383b30dac7db\") " pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:20.582372 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.582335 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 12:06:20.586709 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.586687 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.589152 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.589099 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 12:06:20.589321 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.589178 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 12:06:20.590025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.590005 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 12:06:20.590606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.590392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gkqv9\"" Jul 06 12:06:20.590606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.590522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 12:06:20.590606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.590536 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 12:06:20.591238 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.591219 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 12:06:20.591522 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.591470 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 12:06:20.591522 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.591480 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 12:06:20.605022 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.604994 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 12:06:20.609826 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.609775 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 12:06:20.627208 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.627178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlnm7" Jul 06 12:06:20.639679 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:20.639648 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a5f68e_e68b_4e74_a543_383b30dac7db.slice/crio-c52c276d12f8f1151849aeaa6772c03a06e5f7652e75990dc2b1158dd0db1668 WatchSource:0}: Error finding container c52c276d12f8f1151849aeaa6772c03a06e5f7652e75990dc2b1158dd0db1668: Status 404 returned error can't find the container with id c52c276d12f8f1151849aeaa6772c03a06e5f7652e75990dc2b1158dd0db1668 Jul 06 12:06:20.680855 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.680811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450d9e6b-f709-4a98-92ad-7cd229f9dad5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.680868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6p6j\" (UniqueName: \"kubernetes.io/projected/450d9e6b-f709-4a98-92ad-7cd229f9dad5-kube-api-access-b6p6j\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.680900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.680930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.680958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/450d9e6b-f709-4a98-92ad-7cd229f9dad5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.680992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-config-volume\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-web-config\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/450d9e6b-f709-4a98-92ad-7cd229f9dad5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/450d9e6b-f709-4a98-92ad-7cd229f9dad5-config-out\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.681388 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.681378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/450d9e6b-f709-4a98-92ad-7cd229f9dad5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.782509 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.782711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-config-volume\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.782711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-web-config\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.782711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/450d9e6b-f709-4a98-92ad-7cd229f9dad5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.782711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.782711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/450d9e6b-f709-4a98-92ad-7cd229f9dad5-config-out\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/450d9e6b-f709-4a98-92ad-7cd229f9dad5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450d9e6b-f709-4a98-92ad-7cd229f9dad5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6p6j\" (UniqueName: \"kubernetes.io/projected/450d9e6b-f709-4a98-92ad-7cd229f9dad5-kube-api-access-b6p6j\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783036 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.782954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/450d9e6b-f709-4a98-92ad-7cd229f9dad5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.783387 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.783363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/450d9e6b-f709-4a98-92ad-7cd229f9dad5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.784457 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.784149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/450d9e6b-f709-4a98-92ad-7cd229f9dad5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.785714 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.785277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/450d9e6b-f709-4a98-92ad-7cd229f9dad5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.785714 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.785668 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-config-volume\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.787079 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.787022 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-web-config\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.787079 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.787039 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.787246 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.787231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/450d9e6b-f709-4a98-92ad-7cd229f9dad5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.787608 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.787583 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.787816 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.787777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.787899 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.787837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.788093 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.788062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/450d9e6b-f709-4a98-92ad-7cd229f9dad5-config-out\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.788898 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.788874 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/450d9e6b-f709-4a98-92ad-7cd229f9dad5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.796387 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.796364 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6p6j\" (UniqueName: \"kubernetes.io/projected/450d9e6b-f709-4a98-92ad-7cd229f9dad5-kube-api-access-b6p6j\") pod \"alertmanager-main-0\" (UID: \"450d9e6b-f709-4a98-92ad-7cd229f9dad5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:20.902468 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:20.902387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 12:06:21.097289 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:21.097178 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 12:06:21.098028 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:21.097992 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450d9e6b_f709_4a98_92ad_7cd229f9dad5.slice/crio-ac52387f1ddf5fe9508c152164cb7acad4a8c4ed047b2bfabfaf10242c1beffd WatchSource:0}: Error finding container ac52387f1ddf5fe9508c152164cb7acad4a8c4ed047b2bfabfaf10242c1beffd: Status 404 returned error can't find the container with id ac52387f1ddf5fe9508c152164cb7acad4a8c4ed047b2bfabfaf10242c1beffd Jul 06 12:06:21.310763 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:21.310268 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:21.312828 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:21.311044 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"ac52387f1ddf5fe9508c152164cb7acad4a8c4ed047b2bfabfaf10242c1beffd"} Jul 06 12:06:21.312828 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:21.311435 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:21.315929 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:21.315874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlnm7" event={"ID":"64a5f68e-e68b-4e74-a543-383b30dac7db","Type":"ContainerStarted","Data":"c52c276d12f8f1151849aeaa6772c03a06e5f7652e75990dc2b1158dd0db1668"} Jul 06 12:06:21.318764 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:21.318740 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:22.324446 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.324407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" event={"ID":"4a69a838-8795-48d9-a809-59452a9b77c5","Type":"ContainerStarted","Data":"3d5ecc681195872190c0fe2d8c6c33a9f95f60818b2f560310f88f9bdde433eb"} Jul 06 12:06:22.330198 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.330172 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:06:22.359116 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.359054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-lfdbd" podStartSLOduration=2.08982381 podStartE2EDuration="3.359029302s" totalImagesPullingTime="1.269205492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:22.357046602 +0000 UTC m=+127.078035506" watchObservedRunningTime="2026-07-06 12:06:22.359029302 +0000 UTC m=+127.080018144" Jul 06 12:06:22.661121 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.660605 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c6ff54988-zc7n9"] Jul 06 12:06:22.666050 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.666017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.669556 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.669528 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 12:06:22.669736 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.669529 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 12:06:22.669922 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.669893 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 12:06:22.670073 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.670055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1cn00eakjfpe9\"" Jul 06 12:06:22.670148 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.670123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 12:06:22.670502 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.670487 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 12:06:22.670908 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.670888 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4q7zp\"" Jul 06 12:06:22.686353 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.686325 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c6ff54988-zc7n9"] Jul 06 12:06:22.703239 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703239 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703525 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703525 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-tls\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703637 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0542ee6c-640f-4774-80ca-dfc6b90655aa-metrics-client-ca\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703637 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8tf8\" (UniqueName: \"kubernetes.io/projected/0542ee6c-640f-4774-80ca-dfc6b90655aa-kube-api-access-b8tf8\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703637 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-grpc-tls\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.703790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.703650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.804971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.804936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-tls\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805175 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0542ee6c-640f-4774-80ca-dfc6b90655aa-metrics-client-ca\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805175 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8tf8\" (UniqueName: \"kubernetes.io/projected/0542ee6c-640f-4774-80ca-dfc6b90655aa-kube-api-access-b8tf8\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805175 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-grpc-tls\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805175 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805396 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805396 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805396 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.805950 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.805922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0542ee6c-640f-4774-80ca-dfc6b90655aa-metrics-client-ca\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.808344 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.808321 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-tls\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.808767 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.808746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.808880 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.808747 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.809195 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.809156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.809495 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.809474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.809914 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.809894 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0542ee6c-640f-4774-80ca-dfc6b90655aa-secret-grpc-tls\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.818910 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.818877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8tf8\" (UniqueName: \"kubernetes.io/projected/0542ee6c-640f-4774-80ca-dfc6b90655aa-kube-api-access-b8tf8\") pod \"thanos-querier-5c6ff54988-zc7n9\" (UID: \"0542ee6c-640f-4774-80ca-dfc6b90655aa\") " pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:22.980778 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:22.980514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:23.330249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:23.330202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" event={"ID":"9038e8de-b6a6-428e-982b-24c6d30c9b3c","Type":"ContainerStarted","Data":"b1fef860f4ed18c723c7f865120a6abbfa6ce77368169b0e1a8f4c5d5e15541d"} Jul 06 12:06:23.332054 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:23.332012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlnm7" event={"ID":"64a5f68e-e68b-4e74-a543-383b30dac7db","Type":"ContainerStarted","Data":"51eca127ccce9d52a1376eed9b305149f59ad2fc012b9b343983b0ee2eb95cf8"} Jul 06 12:06:24.204431 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.204395 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646c74cfbb-cbgpq"] Jul 06 12:06:24.215481 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.215447 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn"] Jul 06 12:06:24.220588 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.220559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.227752 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.227597 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 12:06:24.227752 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.227608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2rr5f\"" Jul 06 12:06:24.243665 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.243635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn"] Jul 06 12:06:24.254385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.254348 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f4685b768-ntl6l"] Jul 06 12:06:24.258146 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.258119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.270013 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.269983 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4685b768-ntl6l"] Jul 06 12:06:24.320057 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-config\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.320274 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-oauth-config\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.320274 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-oauth-serving-cert\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.320274 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0eec6573-15f6-47fd-a1ae-e207e35876bb-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-287mn\" (UID: \"0eec6573-15f6-47fd-a1ae-e207e35876bb\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.320274 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-serving-cert\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.320497 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-service-ca\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.320497 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-trusted-ca-bundle\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.320497 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzztf\" (UniqueName: \"kubernetes.io/projected/0eec6573-15f6-47fd-a1ae-e207e35876bb-kube-api-access-hzztf\") pod \"monitoring-plugin-d5dcff7cf-287mn\" (UID: \"0eec6573-15f6-47fd-a1ae-e207e35876bb\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.320497 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.320454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvd9f\" (UniqueName: \"kubernetes.io/projected/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-kube-api-access-vvd9f\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.421044 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.421004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-serving-cert\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.421044 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.421051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-service-ca\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.421667 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.421183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-trusted-ca-bundle\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.421667 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.421242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzztf\" (UniqueName: \"kubernetes.io/projected/0eec6573-15f6-47fd-a1ae-e207e35876bb-kube-api-access-hzztf\") pod \"monitoring-plugin-d5dcff7cf-287mn\" (UID: \"0eec6573-15f6-47fd-a1ae-e207e35876bb\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.421667 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.421325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvd9f\" (UniqueName: \"kubernetes.io/projected/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-kube-api-access-vvd9f\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.421667 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.421396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-config\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.422267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.422005 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-service-ca\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.422267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.422094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-oauth-config\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.422267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.422129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-oauth-serving-cert\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.422267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.422209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-config\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.422721 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.422677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-trusted-ca-bundle\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.423138 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.422864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0eec6573-15f6-47fd-a1ae-e207e35876bb-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-287mn\" (UID: \"0eec6573-15f6-47fd-a1ae-e207e35876bb\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.423259 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.423213 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-oauth-serving-cert\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.424329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.424290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-serving-cert\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.425458 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.425373 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-oauth-config\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.425819 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.425780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0eec6573-15f6-47fd-a1ae-e207e35876bb-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-287mn\" (UID: \"0eec6573-15f6-47fd-a1ae-e207e35876bb\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.430405 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.430385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzztf\" (UniqueName: \"kubernetes.io/projected/0eec6573-15f6-47fd-a1ae-e207e35876bb-kube-api-access-hzztf\") pod \"monitoring-plugin-d5dcff7cf-287mn\" (UID: \"0eec6573-15f6-47fd-a1ae-e207e35876bb\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.430575 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.430551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvd9f\" (UniqueName: \"kubernetes.io/projected/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-kube-api-access-vvd9f\") pod \"console-f4685b768-ntl6l\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:24.532763 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.532724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:24.571351 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:24.571311 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:25.634653 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:25.634621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:06:25.637199 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:25.637166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3278d0-d407-479f-8fec-b83d75a545f0-metrics-certs\") pod \"network-metrics-daemon-9t74n\" (UID: \"3a3278d0-d407-479f-8fec-b83d75a545f0\") " pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:06:25.905231 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:25.905103 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb44c\"" Jul 06 12:06:25.913459 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:25.913184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9t74n" Jul 06 12:06:27.752693 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:27.752657 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:30.286190 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.278498 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4685b768-ntl6l"] Jul 06 12:06:30.296898 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.296753 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9t74n"] Jul 06 12:06:30.336790 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:30.336756 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3278d0_d407_479f_8fec_b83d75a545f0.slice/crio-73bc9ebd2cf37e489efcdc15ef891af22df795747666f53b7e670bc8a38f059a WatchSource:0}: Error finding container 73bc9ebd2cf37e489efcdc15ef891af22df795747666f53b7e670bc8a38f059a: Status 404 returned error can't find the container with id 73bc9ebd2cf37e489efcdc15ef891af22df795747666f53b7e670bc8a38f059a Jul 06 12:06:30.337035 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:30.337009 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92214cf3_3bfe_4353_98bd_ecf3d3eff5a1.slice/crio-a96508498f43920b259add5820b26f42ee330aa34c6de6e6cb07cba587bf358a WatchSource:0}: Error finding container a96508498f43920b259add5820b26f42ee330aa34c6de6e6cb07cba587bf358a: Status 404 returned error can't find the container with id a96508498f43920b259add5820b26f42ee330aa34c6de6e6cb07cba587bf358a Jul 06 12:06:30.339299 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.338520 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn"] Jul 06 12:06:30.341622 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.341604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c6ff54988-zc7n9"] Jul 06 12:06:30.347656 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:06:30.347625 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eec6573_15f6_47fd_a1ae_e207e35876bb.slice/crio-55d1bfe4358295a7ec6b4d800463f4bc03178cf3c2777e03644153b829f4a927 WatchSource:0}: Error finding container 55d1bfe4358295a7ec6b4d800463f4bc03178cf3c2777e03644153b829f4a927: Status 404 returned error can't find the container with id 55d1bfe4358295a7ec6b4d800463f4bc03178cf3c2777e03644153b829f4a927 Jul 06 12:06:30.363249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.363217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" event={"ID":"0eec6573-15f6-47fd-a1ae-e207e35876bb","Type":"ContainerStarted","Data":"55d1bfe4358295a7ec6b4d800463f4bc03178cf3c2777e03644153b829f4a927"} Jul 06 12:06:30.364617 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.364590 2581 generic.go:356] "Generic (PLEG): container finished" podID="64a5f68e-e68b-4e74-a543-383b30dac7db" containerID="51eca127ccce9d52a1376eed9b305149f59ad2fc012b9b343983b0ee2eb95cf8" exitCode=0 Jul 06 12:06:30.364788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.364665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlnm7" event={"ID":"64a5f68e-e68b-4e74-a543-383b30dac7db","Type":"ContainerDied","Data":"51eca127ccce9d52a1376eed9b305149f59ad2fc012b9b343983b0ee2eb95cf8"} Jul 06 12:06:30.366606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.366583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4685b768-ntl6l" event={"ID":"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1","Type":"ContainerStarted","Data":"a96508498f43920b259add5820b26f42ee330aa34c6de6e6cb07cba587bf358a"} Jul 06 12:06:30.368321 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.368207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"5bdb91171da55ed0934838aa75ca531b082020fc543f125cddaeb059b014a0d5"} Jul 06 12:06:30.371846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.371627 2581 generic.go:356] "Generic (PLEG): container finished" podID="450d9e6b-f709-4a98-92ad-7cd229f9dad5" containerID="673035b08526fdf9417abe7099163ac8866c2bc26a5df69dd02f6b930c71e26c" exitCode=0 Jul 06 12:06:30.371846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.371735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerDied","Data":"673035b08526fdf9417abe7099163ac8866c2bc26a5df69dd02f6b930c71e26c"} Jul 06 12:06:30.374530 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.374503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" event={"ID":"9038e8de-b6a6-428e-982b-24c6d30c9b3c","Type":"ContainerStarted","Data":"8adad4ecb8871af16eaa2a11d50dff37639bf9f95e294a58b993bc5943a184ec"} Jul 06 12:06:30.375897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.375872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9t74n" event={"ID":"3a3278d0-d407-479f-8fec-b83d75a545f0","Type":"ContainerStarted","Data":"73bc9ebd2cf37e489efcdc15ef891af22df795747666f53b7e670bc8a38f059a"} Jul 06 12:06:30.856852 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.856813 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4685b768-ntl6l"] Jul 06 12:06:30.897167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.894986 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fc7f98c6-488v8"] Jul 06 12:06:30.901734 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.901702 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.925682 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.925649 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fc7f98c6-488v8"] Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-service-ca\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-trusted-ca-bundle\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-oauth-config\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-console-config\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvttb\" (UniqueName: \"kubernetes.io/projected/419f63a3-c04b-405e-bcea-cdd67803ef81-kube-api-access-cvttb\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-oauth-serving-cert\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:30.997729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:30.997476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-serving-cert\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.098983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-service-ca\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.099038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-trusted-ca-bundle\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.099080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-oauth-config\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.099114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-console-config\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.099140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvttb\" (UniqueName: \"kubernetes.io/projected/419f63a3-c04b-405e-bcea-cdd67803ef81-kube-api-access-cvttb\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.099175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-oauth-serving-cert\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.100178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.099243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-serving-cert\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.103470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.101748 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-console-config\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.103470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.102393 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-service-ca\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.103470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.103408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-oauth-serving-cert\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.105569 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.105521 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-trusted-ca-bundle\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.106594 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.106439 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-serving-cert\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.110198 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.110119 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-oauth-config\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.117144 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.114839 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvttb\" (UniqueName: \"kubernetes.io/projected/419f63a3-c04b-405e-bcea-cdd67803ef81-kube-api-access-cvttb\") pod \"console-57fc7f98c6-488v8\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.224600 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.224555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:31.398822 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.398019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlnm7" event={"ID":"64a5f68e-e68b-4e74-a543-383b30dac7db","Type":"ContainerStarted","Data":"cc856430cf16f88447e301116b12b79a8cc299b3167e738c58891913229de525"} Jul 06 12:06:31.398822 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.398089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlnm7" event={"ID":"64a5f68e-e68b-4e74-a543-383b30dac7db","Type":"ContainerStarted","Data":"075f134e55861e435a691d219b84c94431dbbd7ee90e7aaba2aca0234f2d7cac"} Jul 06 12:06:31.408086 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.407763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4685b768-ntl6l" event={"ID":"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1","Type":"ContainerStarted","Data":"aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679"} Jul 06 12:06:31.415847 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.414908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gdt29" event={"ID":"38b36935-98c5-4b0d-83ee-10ac524d9755","Type":"ContainerStarted","Data":"7d6f5d9b36872525c5ccaf5026dff0a12bf102c35b38178e2a97a3ab4f921ee3"} Jul 06 12:06:31.415847 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.415772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:31.424841 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.422862 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tlnm7" podStartSLOduration=10.21644346 podStartE2EDuration="12.422841264s" totalImagesPullingTime="2.118816306s" totalInitContainerRuntime="87.581498ms" isStatefulPod=true podCreationTimestamp="2026-07-06 12:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:31.421700748 +0000 UTC m=+136.142689589" watchObservedRunningTime="2026-07-06 12:06:31.422841264 +0000 UTC m=+136.143830105" Jul 06 12:06:31.425247 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.425176 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-gdt29" Jul 06 12:06:31.426289 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.425598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" event={"ID":"9038e8de-b6a6-428e-982b-24c6d30c9b3c","Type":"ContainerStarted","Data":"47cb5fad98f6f68c87d7732305a1e95ee0bb37b08b117cee991b7d74fe205766"} Jul 06 12:06:31.446204 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.446148 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f4685b768-ntl6l" podStartSLOduration=7.446125925 podStartE2EDuration="7.446125925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:31.444317949 +0000 UTC m=+136.165306791" watchObservedRunningTime="2026-07-06 12:06:31.446125925 +0000 UTC m=+136.167114764" Jul 06 12:06:31.486841 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.486495 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-gdt29" podStartSLOduration=2.6742280149999997 podStartE2EDuration="21.486468516s" totalImagesPullingTime="18.812240501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:31.464125044 +0000 UTC m=+136.185113884" watchObservedRunningTime="2026-07-06 12:06:31.486468516 +0000 UTC m=+136.207457357" Jul 06 12:06:31.489346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.489309 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fc7f98c6-488v8"] Jul 06 12:06:31.492082 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:31.490702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-242n7" podStartSLOduration=9.919328355 podStartE2EDuration="12.490682815s" totalImagesPullingTime="2.57135446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:31.490029773 +0000 UTC m=+136.211018614" watchObservedRunningTime="2026-07-06 12:06:31.490682815 +0000 UTC m=+136.211671658" Jul 06 12:06:32.438193 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:32.438147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc7f98c6-488v8" event={"ID":"419f63a3-c04b-405e-bcea-cdd67803ef81","Type":"ContainerStarted","Data":"7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86"} Jul 06 12:06:32.438718 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:32.438234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc7f98c6-488v8" event={"ID":"419f63a3-c04b-405e-bcea-cdd67803ef81","Type":"ContainerStarted","Data":"119fbb1ce99f0750f1c2e3076986599f9ae85501285c5cd1f16783cc44f540d5"} Jul 06 12:06:32.488292 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:32.486932 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fc7f98c6-488v8" podStartSLOduration=2.486908796 podStartE2EDuration="2.486908796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:32.484880187 +0000 UTC m=+137.205869028" watchObservedRunningTime="2026-07-06 12:06:32.486908796 +0000 UTC m=+137.207897637" Jul 06 12:06:34.065006 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:34.064969 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57b9dd98c5-jhtdf"] Jul 06 12:06:34.571671 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:34.571624 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:35.457508 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.457455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"9bec911923c66f713f8aec32fef715b6bdfcbf1c5e49dd739c4dfb8b13ae20e1"} Jul 06 12:06:35.457983 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.457586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"713fe8d715114895a9f3d2992f403d9c033bd4e9fd0ef37e7cc08c6ad2d1de5f"} Jul 06 12:06:35.457983 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.457634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"53e1ab7c1325ab92f16100f6de38ca8ee5adf30a7c8a5db349da843f8fc84de3"} Jul 06 12:06:35.461262 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.461223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"3616de0ec2cb4875e2e69e95edf78721e1c548dacd50b0f9a7c55295862a1aa4"} Jul 06 12:06:35.461392 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.461317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"4b3acdd166d5c780f49f9cef44d11a6bf5f83c462768f2521ab156b6e0948ef5"} Jul 06 12:06:35.461392 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.461359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"c077849c75008bb4e116b275813cce1f47e0c7965055e76d9f2e8ef1aab0d16b"} Jul 06 12:06:35.463675 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.463598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9t74n" event={"ID":"3a3278d0-d407-479f-8fec-b83d75a545f0","Type":"ContainerStarted","Data":"d3315ff6166af0161fddfe794ee976053fd4e6a3e80376b1c1e22857250aac6a"} Jul 06 12:06:35.463675 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.463649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9t74n" event={"ID":"3a3278d0-d407-479f-8fec-b83d75a545f0","Type":"ContainerStarted","Data":"309e152199f8e687c8cd01f0b9ed6bbb662795bfc2d6dbbd06634057a307bf5a"} Jul 06 12:06:35.465960 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.465934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" event={"ID":"0eec6573-15f6-47fd-a1ae-e207e35876bb","Type":"ContainerStarted","Data":"a578e63db9884566478eaffc3df6eca5c4391f547e9a1ef279cee55ba76dddbc"} Jul 06 12:06:35.466534 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.466513 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:35.472751 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.472712 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" Jul 06 12:06:35.491718 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.491619 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9t74n" podStartSLOduration=134.881923946 podStartE2EDuration="2m19.491596673s" totalImagesPullingTime="4.609672727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:35.491150265 +0000 UTC m=+140.212139118" watchObservedRunningTime="2026-07-06 12:06:35.491596673 +0000 UTC m=+140.212585513" Jul 06 12:06:35.523102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:35.523045 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-287mn" podStartSLOduration=6.926161304 podStartE2EDuration="11.523026579s" totalImagesPullingTime="4.596865275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:35.522218239 +0000 UTC m=+140.243207079" watchObservedRunningTime="2026-07-06 12:06:35.523026579 +0000 UTC m=+140.244015418" Jul 06 12:06:36.475358 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:36.475319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"516c92009a398fc2a02a20171b335929b98f2dbc0148e16aed455ead154db2ec"} Jul 06 12:06:36.475968 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:36.475409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"a453139421f4dc33c96ce37a94e3cd86ec87f7822e3d09b5ec414c4ce3b312f2"} Jul 06 12:06:37.484258 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.484148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"71b0f331849735d766a2b1396ad654bb21bb9c525d7dcc4403ec365071f1b447"} Jul 06 12:06:37.484740 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.484290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"a2d15dcb2faef84f4146d0409620b3fc4d5e59c14552c061ca7a9be7e59525fb"} Jul 06 12:06:37.484740 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.484341 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:37.484740 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.484382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" event={"ID":"0542ee6c-640f-4774-80ca-dfc6b90655aa","Type":"ContainerStarted","Data":"032d183b8f44ab0e42033985cb31a4310cf2ed73cb84e2f2c6ca7f3dc81aaef8"} Jul 06 12:06:37.488314 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.488279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"450d9e6b-f709-4a98-92ad-7cd229f9dad5","Type":"ContainerStarted","Data":"2b8cfc076ce5f74c135fd8ade604ce75314816500a200dd3625e078f35aac5b3"} Jul 06 12:06:37.514217 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.514123 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" podStartSLOduration=9.424364327 podStartE2EDuration="15.514104789s" totalImagesPullingTime="6.089740462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:37.512057061 +0000 UTC m=+142.233045904" watchObservedRunningTime="2026-07-06 12:06:37.514104789 +0000 UTC m=+142.235093647" Jul 06 12:06:37.542594 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:37.542521 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.026849803 podStartE2EDuration="17.542498208s" totalImagesPullingTime="7.491116569s" totalInitContainerRuntime="24.531836ms" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:37.540545045 +0000 UTC m=+142.261533886" watchObservedRunningTime="2026-07-06 12:06:37.542498208 +0000 UTC m=+142.263487052" Jul 06 12:06:41.225362 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:41.225324 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:41.225749 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:41.225396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:41.230132 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:41.230111 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:41.510931 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:41.510846 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:06:41.570124 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:41.570095 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59987b659c-fw2wl"] Jul 06 12:06:43.499735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:43.499708 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c6ff54988-zc7n9" Jul 06 12:06:49.228507 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.228437 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-646c74cfbb-cbgpq" podUID="ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" containerName="console" containerID="cri-o://2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f" gracePeriod=15 Jul 06 12:06:49.513658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.513626 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:49.545390 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.545358 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" containerID="2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f" exitCode=0 Jul 06 12:06:49.545562 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.545422 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c74cfbb-cbgpq" Jul 06 12:06:49.545562 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.545446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c74cfbb-cbgpq" event={"ID":"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05","Type":"ContainerDied","Data":"2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f"} Jul 06 12:06:49.545562 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.545542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c74cfbb-cbgpq" event={"ID":"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05","Type":"ContainerDied","Data":"e75cebcbca8e7560f1f0540d305767515d5f8a68548aea4a829c69dc750c6bc7"} Jul 06 12:06:49.545677 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.545574 2581 scope.go:117] "RemoveContainer" containerID="2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f" Jul 06 12:06:49.553912 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.553874 2581 scope.go:117] "RemoveContainer" containerID="2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f" Jul 06 12:06:49.554186 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:49.554166 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f\": container with ID starting with 2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f not found: ID does not exist" containerID="2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f" Jul 06 12:06:49.554257 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.554195 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f"} err="failed to get container status \"2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f\": rpc error: code = NotFound desc = could not find container \"2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f\": container with ID starting with 2efbdd2b11bb29606146e21353de5ecc74860a4d11cb85db766712053b43200f not found: ID does not exist" Jul 06 12:06:49.575520 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575494 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-config\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575531 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-trusted-ca-bundle\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575554 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-oauth-serving-cert\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575606 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-service-ca\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575625 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-serving-cert\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575867 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575664 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-oauth-config\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575867 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575690 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmv9b\" (UniqueName: \"kubernetes.io/projected/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-kube-api-access-kmv9b\") pod \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\" (UID: \"ef38c5dc-5b0d-4557-bc06-9b8b06be2f05\") " Jul 06 12:06:49.575976 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575881 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-config" (OuterVolumeSpecName: "console-config") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:49.576030 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575988 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.576030 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.575996 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:49.576116 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.576026 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-service-ca" (OuterVolumeSpecName: "service-ca") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:49.576116 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.576036 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:49.577961 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.577936 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:06:49.578055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.578001 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:06:49.578055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.578022 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-kube-api-access-kmv9b" (OuterVolumeSpecName: "kube-api-access-kmv9b") pod "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" (UID: "ef38c5dc-5b0d-4557-bc06-9b8b06be2f05"). InnerVolumeSpecName "kube-api-access-kmv9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:06:49.676452 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.676412 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-oauth-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.676452 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.676446 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-service-ca\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.676659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.676462 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.676659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.676474 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-console-oauth-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.676659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.676486 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmv9b\" (UniqueName: \"kubernetes.io/projected/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-kube-api-access-kmv9b\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.676659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.676499 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05-trusted-ca-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:49.871666 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.871633 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646c74cfbb-cbgpq"] Jul 06 12:06:49.877340 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:49.877315 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-646c74cfbb-cbgpq"] Jul 06 12:06:51.877682 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:51.877649 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" path="/var/lib/kubelet/pods/ef38c5dc-5b0d-4557-bc06-9b8b06be2f05/volumes" Jul 06 12:06:57.470182 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.470141 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f4685b768-ntl6l" podUID="92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" containerName="console" containerID="cri-o://aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679" gracePeriod=15 Jul 06 12:06:57.719516 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.719452 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:57.749769 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749699 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-service-ca\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.749769 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749740 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-serving-cert\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.749971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749819 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvd9f\" (UniqueName: \"kubernetes.io/projected/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-kube-api-access-vvd9f\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.749971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749848 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-trusted-ca-bundle\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.749971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749869 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-oauth-serving-cert\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.749971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749914 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-oauth-config\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.749971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.749949 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-config\") pod \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\" (UID: \"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1\") " Jul 06 12:06:57.750212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.750117 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:57.750212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.750186 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-service-ca\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:57.750455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.750428 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:57.750455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.750450 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:57.750636 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.750520 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-config" (OuterVolumeSpecName: "console-config") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:57.752203 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.752176 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:06:57.752354 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.752336 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:06:57.752399 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.752349 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-kube-api-access-vvd9f" (OuterVolumeSpecName: "kube-api-access-vvd9f") pod "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" (UID: "92214cf3-3bfe-4353-98bd-ecf3d3eff5a1"). InnerVolumeSpecName "kube-api-access-vvd9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:06:57.850729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.850684 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvd9f\" (UniqueName: \"kubernetes.io/projected/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-kube-api-access-vvd9f\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:57.850729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.850717 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-trusted-ca-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:57.850729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.850730 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-oauth-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:57.851002 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.850741 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-oauth-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:57.851002 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.850753 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:57.851002 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:57.850765 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1-console-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:58.584494 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.584454 2581 generic.go:356] "Generic (PLEG): container finished" podID="92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" containerID="aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679" exitCode=0 Jul 06 12:06:58.585016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.584523 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4685b768-ntl6l" Jul 06 12:06:58.585016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.584535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4685b768-ntl6l" event={"ID":"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1","Type":"ContainerDied","Data":"aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679"} Jul 06 12:06:58.585016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.584610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4685b768-ntl6l" event={"ID":"92214cf3-3bfe-4353-98bd-ecf3d3eff5a1","Type":"ContainerDied","Data":"a96508498f43920b259add5820b26f42ee330aa34c6de6e6cb07cba587bf358a"} Jul 06 12:06:58.585016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.584631 2581 scope.go:117] "RemoveContainer" containerID="aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679" Jul 06 12:06:58.595031 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.595011 2581 scope.go:117] "RemoveContainer" containerID="aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679" Jul 06 12:06:58.595262 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:58.595245 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679\": container with ID starting with aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679 not found: ID does not exist" containerID="aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679" Jul 06 12:06:58.595320 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.595268 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679"} err="failed to get container status \"aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679\": rpc error: code = NotFound desc = could not find container \"aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679\": container with ID starting with aef4df00e0e551e5c299c07c6dba6fb638b1b05d452d47eb6d79203d355a5679 not found: ID does not exist" Jul 06 12:06:58.603905 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.603882 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4685b768-ntl6l"] Jul 06 12:06:58.608171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:58.608149 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f4685b768-ntl6l"] Jul 06 12:06:59.093307 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.093268 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" podUID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" containerName="registry" containerID="cri-o://bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0" gracePeriod=30 Jul 06 12:06:59.339610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.339589 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:06:59.365158 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365091 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-image-registry-private-configuration\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365158 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365135 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txbrb\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-kube-api-access-txbrb\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365165 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365193 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-bound-sa-token\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-certificates\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365311 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-installation-pull-secrets\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365337 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-trusted-ca\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365600 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365370 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-ca-trust-extracted\") pod \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\" (UID: \"b0ec080b-c4b0-4aa0-8f03-c391417e89d2\") " Jul 06 12:06:59.365938 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.365908 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:59.366391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.366363 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:06:59.368449 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.368419 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-kube-api-access-txbrb" (OuterVolumeSpecName: "kube-api-access-txbrb") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "kube-api-access-txbrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:06:59.368709 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.368665 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:06:59.368834 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.368696 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:06:59.368834 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.368752 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:06:59.369000 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.368979 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:06:59.374959 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.374940 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b0ec080b-c4b0-4aa0-8f03-c391417e89d2" (UID: "b0ec080b-c4b0-4aa0-8f03-c391417e89d2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:06:59.466421 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466392 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-certificates\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466421 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466417 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-installation-pull-secrets\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466421 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466429 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-trusted-ca\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466441 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-ca-trust-extracted\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466451 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-image-registry-private-configuration\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466462 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txbrb\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-kube-api-access-txbrb\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466470 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-registry-tls\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.466648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.466478 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0ec080b-c4b0-4aa0-8f03-c391417e89d2-bound-sa-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:06:59.589964 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.589932 2581 generic.go:356] "Generic (PLEG): container finished" podID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" containerID="bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0" exitCode=0 Jul 06 12:06:59.590379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.589977 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" Jul 06 12:06:59.590379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.589982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" event={"ID":"b0ec080b-c4b0-4aa0-8f03-c391417e89d2","Type":"ContainerDied","Data":"bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0"} Jul 06 12:06:59.590379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.590021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57b9dd98c5-jhtdf" event={"ID":"b0ec080b-c4b0-4aa0-8f03-c391417e89d2","Type":"ContainerDied","Data":"1ff4634cecb0b42341b0b692492bcbed7bbc0596716154f994d8a0c8f4255d7b"} Jul 06 12:06:59.590379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.590041 2581 scope.go:117] "RemoveContainer" containerID="bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0" Jul 06 12:06:59.598785 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.598763 2581 scope.go:117] "RemoveContainer" containerID="bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0" Jul 06 12:06:59.599051 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:06:59.599034 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0\": container with ID starting with bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0 not found: ID does not exist" containerID="bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0" Jul 06 12:06:59.599100 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.599063 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0"} err="failed to get container status \"bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0\": rpc error: code = NotFound desc = could not find container \"bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0\": container with ID starting with bfe85fb23aa10b7215bdcac5a871bc8e9705e1f71b922d2c147c16a6f6d277e0 not found: ID does not exist" Jul 06 12:06:59.613446 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.613419 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57b9dd98c5-jhtdf"] Jul 06 12:06:59.616732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.616678 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57b9dd98c5-jhtdf"] Jul 06 12:06:59.877204 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.877123 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" path="/var/lib/kubelet/pods/92214cf3-3bfe-4353-98bd-ecf3d3eff5a1/volumes" Jul 06 12:06:59.877525 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:06:59.877512 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" path="/var/lib/kubelet/pods/b0ec080b-c4b0-4aa0-8f03-c391417e89d2/volumes" Jul 06 12:07:06.591296 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.591256 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59987b659c-fw2wl" podUID="15019f44-bc22-4308-b24e-39727de82e0f" containerName="console" containerID="cri-o://3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023" gracePeriod=15 Jul 06 12:07:06.885481 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.885456 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:07:06.933684 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.933649 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-console-config\") pod \"15019f44-bc22-4308-b24e-39727de82e0f\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " Jul 06 12:07:06.933876 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.933704 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-service-ca\") pod \"15019f44-bc22-4308-b24e-39727de82e0f\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " Jul 06 12:07:06.933876 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.933758 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-oauth-config\") pod \"15019f44-bc22-4308-b24e-39727de82e0f\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " Jul 06 12:07:06.933876 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.933784 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-serving-cert\") pod \"15019f44-bc22-4308-b24e-39727de82e0f\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " Jul 06 12:07:06.934042 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.933915 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-oauth-serving-cert\") pod \"15019f44-bc22-4308-b24e-39727de82e0f\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " Jul 06 12:07:06.934042 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.933948 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz4qc\" (UniqueName: \"kubernetes.io/projected/15019f44-bc22-4308-b24e-39727de82e0f-kube-api-access-sz4qc\") pod \"15019f44-bc22-4308-b24e-39727de82e0f\" (UID: \"15019f44-bc22-4308-b24e-39727de82e0f\") " Jul 06 12:07:06.934136 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.934097 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-console-config" (OuterVolumeSpecName: "console-config") pod "15019f44-bc22-4308-b24e-39727de82e0f" (UID: "15019f44-bc22-4308-b24e-39727de82e0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:07:06.934214 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.934199 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-console-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:07:06.934268 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.934219 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "15019f44-bc22-4308-b24e-39727de82e0f" (UID: "15019f44-bc22-4308-b24e-39727de82e0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:07:06.934346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.934323 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15019f44-bc22-4308-b24e-39727de82e0f" (UID: "15019f44-bc22-4308-b24e-39727de82e0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:07:06.936079 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.936050 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15019f44-bc22-4308-b24e-39727de82e0f-kube-api-access-sz4qc" (OuterVolumeSpecName: "kube-api-access-sz4qc") pod "15019f44-bc22-4308-b24e-39727de82e0f" (UID: "15019f44-bc22-4308-b24e-39727de82e0f"). InnerVolumeSpecName "kube-api-access-sz4qc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:07:06.936079 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.936073 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15019f44-bc22-4308-b24e-39727de82e0f" (UID: "15019f44-bc22-4308-b24e-39727de82e0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:07:06.936274 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:06.936247 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15019f44-bc22-4308-b24e-39727de82e0f" (UID: "15019f44-bc22-4308-b24e-39727de82e0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:07:07.035085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.035053 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-oauth-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:07:07.035085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.035078 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz4qc\" (UniqueName: \"kubernetes.io/projected/15019f44-bc22-4308-b24e-39727de82e0f-kube-api-access-sz4qc\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:07:07.035085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.035088 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15019f44-bc22-4308-b24e-39727de82e0f-service-ca\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:07:07.035085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.035097 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-oauth-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:07:07.035340 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.035105 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15019f44-bc22-4308-b24e-39727de82e0f-console-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:07:07.624661 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.624624 2581 generic.go:356] "Generic (PLEG): container finished" podID="15019f44-bc22-4308-b24e-39727de82e0f" containerID="3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023" exitCode=0 Jul 06 12:07:07.625172 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.624669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59987b659c-fw2wl" event={"ID":"15019f44-bc22-4308-b24e-39727de82e0f","Type":"ContainerDied","Data":"3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023"} Jul 06 12:07:07.625172 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.624673 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59987b659c-fw2wl" Jul 06 12:07:07.625172 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.624712 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59987b659c-fw2wl" event={"ID":"15019f44-bc22-4308-b24e-39727de82e0f","Type":"ContainerDied","Data":"35e2afac04db8b3876ce2a8b80260d352389f564150d2409ac9ab91203ce383a"} Jul 06 12:07:07.625172 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.624733 2581 scope.go:117] "RemoveContainer" containerID="3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023" Jul 06 12:07:07.635954 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.635938 2581 scope.go:117] "RemoveContainer" containerID="3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023" Jul 06 12:07:07.636242 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:07:07.636217 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023\": container with ID starting with 3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023 not found: ID does not exist" containerID="3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023" Jul 06 12:07:07.636314 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.636264 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023"} err="failed to get container status \"3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023\": rpc error: code = NotFound desc = could not find container \"3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023\": container with ID starting with 3b7ae714064fd6945263174fb38c3d6aa2079f3dfbcb5a4dc72d984c24c65023 not found: ID does not exist" Jul 06 12:07:07.645897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.645873 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59987b659c-fw2wl"] Jul 06 12:07:07.649601 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.649581 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59987b659c-fw2wl"] Jul 06 12:07:07.877069 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:07:07.876989 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15019f44-bc22-4308-b24e-39727de82e0f" path="/var/lib/kubelet/pods/15019f44-bc22-4308-b24e-39727de82e0f/volumes" Jul 06 12:08:01.568209 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568168 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8557ffd46c-d9pq2"] Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568522 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15019f44-bc22-4308-b24e-39727de82e0f" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568536 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15019f44-bc22-4308-b24e-39727de82e0f" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568545 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568550 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568557 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" containerName="registry" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568562 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" containerName="registry" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568580 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568585 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568637 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef38c5dc-5b0d-4557-bc06-9b8b06be2f05" containerName="console" Jul 06 12:08:01.568642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568644 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="92214cf3-3bfe-4353-98bd-ecf3d3eff5a1" containerName="console" Jul 06 12:08:01.568991 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568653 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ec080b-c4b0-4aa0-8f03-c391417e89d2" containerName="registry" Jul 06 12:08:01.568991 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.568660 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="15019f44-bc22-4308-b24e-39727de82e0f" containerName="console" Jul 06 12:08:01.571656 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.571637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.582860 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.582836 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8557ffd46c-d9pq2"] Jul 06 12:08:01.681161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-service-ca\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.681161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-trusted-ca-bundle\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.681379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-console-config\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.681379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-oauth-serving-cert\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.681379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-oauth-config\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.681379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh8nl\" (UniqueName: \"kubernetes.io/projected/d42667d8-049c-4c59-999e-bb529182ad35-kube-api-access-dh8nl\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.681379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.681369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-serving-cert\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782454 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-oauth-config\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782454 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh8nl\" (UniqueName: \"kubernetes.io/projected/d42667d8-049c-4c59-999e-bb529182ad35-kube-api-access-dh8nl\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782701 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-serving-cert\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782701 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-service-ca\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782701 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-trusted-ca-bundle\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782701 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-console-config\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.782701 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.782581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-oauth-serving-cert\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.783394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.783367 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-service-ca\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.783486 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.783415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-oauth-serving-cert\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.783486 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.783415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-console-config\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.783733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.783713 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-trusted-ca-bundle\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.785560 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.785539 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-serving-cert\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.785669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.785648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-oauth-config\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.791243 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.791222 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh8nl\" (UniqueName: \"kubernetes.io/projected/d42667d8-049c-4c59-999e-bb529182ad35-kube-api-access-dh8nl\") pod \"console-8557ffd46c-d9pq2\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:01.880389 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:01.880302 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:02.025716 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:02.025603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8557ffd46c-d9pq2"] Jul 06 12:08:02.028396 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:08:02.028364 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42667d8_049c_4c59_999e_bb529182ad35.slice/crio-005fa35b58250bf6eec6e58054abb74006006b669a3e5f1465468df7b8413fd1 WatchSource:0}: Error finding container 005fa35b58250bf6eec6e58054abb74006006b669a3e5f1465468df7b8413fd1: Status 404 returned error can't find the container with id 005fa35b58250bf6eec6e58054abb74006006b669a3e5f1465468df7b8413fd1 Jul 06 12:08:02.847708 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:02.847673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8557ffd46c-d9pq2" event={"ID":"d42667d8-049c-4c59-999e-bb529182ad35","Type":"ContainerStarted","Data":"a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717"} Jul 06 12:08:02.848171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:02.847722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8557ffd46c-d9pq2" event={"ID":"d42667d8-049c-4c59-999e-bb529182ad35","Type":"ContainerStarted","Data":"005fa35b58250bf6eec6e58054abb74006006b669a3e5f1465468df7b8413fd1"} Jul 06 12:08:02.868330 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:02.868277 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8557ffd46c-d9pq2" podStartSLOduration=1.868261542 podStartE2EDuration="1.868261542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:08:02.866598942 +0000 UTC m=+227.587587783" watchObservedRunningTime="2026-07-06 12:08:02.868261542 +0000 UTC m=+227.589250447" Jul 06 12:08:11.881012 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:11.880979 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:11.881012 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:11.881018 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:11.886187 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:11.886165 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:12.892943 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:12.892915 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:08:12.944265 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:12.944221 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fc7f98c6-488v8"] Jul 06 12:08:37.965773 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:37.965733 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57fc7f98c6-488v8" podUID="419f63a3-c04b-405e-bcea-cdd67803ef81" containerName="console" containerID="cri-o://7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86" gracePeriod=15 Jul 06 12:08:38.206749 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.206724 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:08:38.391749 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.391719 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-trusted-ca-bundle\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.391949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.391756 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-console-config\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.391949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.391793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvttb\" (UniqueName: \"kubernetes.io/projected/419f63a3-c04b-405e-bcea-cdd67803ef81-kube-api-access-cvttb\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.391949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.391857 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-service-ca\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.391949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.391881 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-oauth-serving-cert\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.392163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.391989 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-serving-cert\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.392163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392020 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-oauth-config\") pod \"419f63a3-c04b-405e-bcea-cdd67803ef81\" (UID: \"419f63a3-c04b-405e-bcea-cdd67803ef81\") " Jul 06 12:08:38.392279 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392182 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-console-config" (OuterVolumeSpecName: "console-config") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:08:38.392337 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392313 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-service-ca" (OuterVolumeSpecName: "service-ca") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:08:38.392420 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392396 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-console-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.392420 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392411 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:08:38.392610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392425 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:08:38.392610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.392424 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-service-ca\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.393982 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.393961 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419f63a3-c04b-405e-bcea-cdd67803ef81-kube-api-access-cvttb" (OuterVolumeSpecName: "kube-api-access-cvttb") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "kube-api-access-cvttb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:08:38.394155 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.394139 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:08:38.394205 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.394163 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "419f63a3-c04b-405e-bcea-cdd67803ef81" (UID: "419f63a3-c04b-405e-bcea-cdd67803ef81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:08:38.493710 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.493672 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-oauth-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.493710 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.493708 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.493710 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.493718 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f63a3-c04b-405e-bcea-cdd67803ef81-console-oauth-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.493922 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.493726 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f63a3-c04b-405e-bcea-cdd67803ef81-trusted-ca-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.493922 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.493734 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvttb\" (UniqueName: \"kubernetes.io/projected/419f63a3-c04b-405e-bcea-cdd67803ef81-kube-api-access-cvttb\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:08:38.986592 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.986559 2581 generic.go:356] "Generic (PLEG): container finished" podID="419f63a3-c04b-405e-bcea-cdd67803ef81" containerID="7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86" exitCode=0 Jul 06 12:08:38.987033 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.986599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc7f98c6-488v8" event={"ID":"419f63a3-c04b-405e-bcea-cdd67803ef81","Type":"ContainerDied","Data":"7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86"} Jul 06 12:08:38.987033 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.986612 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fc7f98c6-488v8" Jul 06 12:08:38.987033 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.986638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fc7f98c6-488v8" event={"ID":"419f63a3-c04b-405e-bcea-cdd67803ef81","Type":"ContainerDied","Data":"119fbb1ce99f0750f1c2e3076986599f9ae85501285c5cd1f16783cc44f540d5"} Jul 06 12:08:38.987033 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.986659 2581 scope.go:117] "RemoveContainer" containerID="7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86" Jul 06 12:08:38.995373 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.995355 2581 scope.go:117] "RemoveContainer" containerID="7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86" Jul 06 12:08:38.995625 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:08:38.995608 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86\": container with ID starting with 7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86 not found: ID does not exist" containerID="7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86" Jul 06 12:08:38.995669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:38.995634 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86"} err="failed to get container status \"7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86\": rpc error: code = NotFound desc = could not find container \"7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86\": container with ID starting with 7c4bb4e761cce8a2b7eb505b0d0b05938b455cc64a8a6b35da073ba358388c86 not found: ID does not exist" Jul 06 12:08:39.008890 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:39.008848 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fc7f98c6-488v8"] Jul 06 12:08:39.015712 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:39.015685 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fc7f98c6-488v8"] Jul 06 12:08:39.876611 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:39.876579 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="419f63a3-c04b-405e-bcea-cdd67803ef81" path="/var/lib/kubelet/pods/419f63a3-c04b-405e-bcea-cdd67803ef81/volumes" Jul 06 12:08:54.417089 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.417055 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j"] Jul 06 12:08:54.417567 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.417375 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419f63a3-c04b-405e-bcea-cdd67803ef81" containerName="console" Jul 06 12:08:54.417567 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.417386 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="419f63a3-c04b-405e-bcea-cdd67803ef81" containerName="console" Jul 06 12:08:54.417567 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.417448 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="419f63a3-c04b-405e-bcea-cdd67803ef81" containerName="console" Jul 06 12:08:54.421911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.421893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.424729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.424705 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 12:08:54.425379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.425363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d4x2c\"" Jul 06 12:08:54.425919 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.425904 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 12:08:54.433294 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.433270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j"] Jul 06 12:08:54.509222 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.509191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.509326 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.509230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4dz\" (UniqueName: \"kubernetes.io/projected/4561d510-f520-41a8-8207-3e425270fa99-kube-api-access-km4dz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.509326 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.509266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.609528 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.609508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.609606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.609553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.609606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.609576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4dz\" (UniqueName: \"kubernetes.io/projected/4561d510-f520-41a8-8207-3e425270fa99-kube-api-access-km4dz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.609872 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.609856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.609942 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.609924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.619001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.618977 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4dz\" (UniqueName: \"kubernetes.io/projected/4561d510-f520-41a8-8207-3e425270fa99-kube-api-access-km4dz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.731666 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.731608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:08:54.863001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:54.862972 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j"] Jul 06 12:08:54.867581 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:08:54.867557 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4561d510_f520_41a8_8207_3e425270fa99.slice/crio-41b9e79d266f3dd89ab9fcd1ded0f2d4a282cbfdcd70183045e6cc9d86e1baf2 WatchSource:0}: Error finding container 41b9e79d266f3dd89ab9fcd1ded0f2d4a282cbfdcd70183045e6cc9d86e1baf2: Status 404 returned error can't find the container with id 41b9e79d266f3dd89ab9fcd1ded0f2d4a282cbfdcd70183045e6cc9d86e1baf2 Jul 06 12:08:55.050235 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:08:55.050205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" event={"ID":"4561d510-f520-41a8-8207-3e425270fa99","Type":"ContainerStarted","Data":"41b9e79d266f3dd89ab9fcd1ded0f2d4a282cbfdcd70183045e6cc9d86e1baf2"} Jul 06 12:09:03.085324 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:03.085288 2581 generic.go:356] "Generic (PLEG): container finished" podID="4561d510-f520-41a8-8207-3e425270fa99" containerID="a91438e4bc9ad623f02806fc701332b0851aac7d8c5b63a9d3a89b24fd409996" exitCode=0 Jul 06 12:09:03.085712 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:03.085360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" event={"ID":"4561d510-f520-41a8-8207-3e425270fa99","Type":"ContainerDied","Data":"a91438e4bc9ad623f02806fc701332b0851aac7d8c5b63a9d3a89b24fd409996"} Jul 06 12:09:06.099142 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:06.099105 2581 generic.go:356] "Generic (PLEG): container finished" podID="4561d510-f520-41a8-8207-3e425270fa99" containerID="9361ede0124d1c84a1a701495341dd1c880e4c463eb6a6649ac10ecea4cf858b" exitCode=0 Jul 06 12:09:06.099496 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:06.099197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" event={"ID":"4561d510-f520-41a8-8207-3e425270fa99","Type":"ContainerDied","Data":"9361ede0124d1c84a1a701495341dd1c880e4c463eb6a6649ac10ecea4cf858b"} Jul 06 12:09:14.141723 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:14.141693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" event={"ID":"4561d510-f520-41a8-8207-3e425270fa99","Type":"ContainerStarted","Data":"4a8de9f3ce2fdd6e17d67be701694ec4f2a5e5e93ab10a751a10ae87ef94315b"} Jul 06 12:09:14.168446 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:14.168403 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" podStartSLOduration=2.8921143860000003 podStartE2EDuration="20.168386738s" totalImagesPullingTime="17.276272352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:08:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:09:14.167495077 +0000 UTC m=+298.888483919" watchObservedRunningTime="2026-07-06 12:09:14.168386738 +0000 UTC m=+298.889375579" Jul 06 12:09:15.147728 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:15.147697 2581 generic.go:356] "Generic (PLEG): container finished" podID="4561d510-f520-41a8-8207-3e425270fa99" containerID="4a8de9f3ce2fdd6e17d67be701694ec4f2a5e5e93ab10a751a10ae87ef94315b" exitCode=0 Jul 06 12:09:15.148090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:15.147764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" event={"ID":"4561d510-f520-41a8-8207-3e425270fa99","Type":"ContainerDied","Data":"4a8de9f3ce2fdd6e17d67be701694ec4f2a5e5e93ab10a751a10ae87ef94315b"} Jul 06 12:09:15.708454 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:15.708432 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 12:09:16.288357 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.288334 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:09:16.378909 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.378884 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km4dz\" (UniqueName: \"kubernetes.io/projected/4561d510-f520-41a8-8207-3e425270fa99-kube-api-access-km4dz\") pod \"4561d510-f520-41a8-8207-3e425270fa99\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " Jul 06 12:09:16.379044 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.378927 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-util\") pod \"4561d510-f520-41a8-8207-3e425270fa99\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " Jul 06 12:09:16.379044 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.378958 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-bundle\") pod \"4561d510-f520-41a8-8207-3e425270fa99\" (UID: \"4561d510-f520-41a8-8207-3e425270fa99\") " Jul 06 12:09:16.379601 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.379580 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-bundle" (OuterVolumeSpecName: "bundle") pod "4561d510-f520-41a8-8207-3e425270fa99" (UID: "4561d510-f520-41a8-8207-3e425270fa99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:09:16.381047 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.381022 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4561d510-f520-41a8-8207-3e425270fa99-kube-api-access-km4dz" (OuterVolumeSpecName: "kube-api-access-km4dz") pod "4561d510-f520-41a8-8207-3e425270fa99" (UID: "4561d510-f520-41a8-8207-3e425270fa99"). InnerVolumeSpecName "kube-api-access-km4dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:09:16.383924 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.383900 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-util" (OuterVolumeSpecName: "util") pod "4561d510-f520-41a8-8207-3e425270fa99" (UID: "4561d510-f520-41a8-8207-3e425270fa99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:09:16.480444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.480398 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km4dz\" (UniqueName: \"kubernetes.io/projected/4561d510-f520-41a8-8207-3e425270fa99-kube-api-access-km4dz\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:16.480444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.480417 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:16.480444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:16.480429 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4561d510-f520-41a8-8207-3e425270fa99-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:17.157178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:17.157146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" event={"ID":"4561d510-f520-41a8-8207-3e425270fa99","Type":"ContainerDied","Data":"41b9e79d266f3dd89ab9fcd1ded0f2d4a282cbfdcd70183045e6cc9d86e1baf2"} Jul 06 12:09:17.157178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:17.157178 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407tz7j" Jul 06 12:09:17.157369 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:17.157195 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41b9e79d266f3dd89ab9fcd1ded0f2d4a282cbfdcd70183045e6cc9d86e1baf2" Jul 06 12:09:22.977536 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977494 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv"] Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977884 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="pull" Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977906 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="pull" Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977933 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="util" Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977941 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="util" Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977952 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="extract" Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.977966 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="extract" Jul 06 12:09:22.978029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.978032 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4561d510-f520-41a8-8207-3e425270fa99" containerName="extract" Jul 06 12:09:22.980768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.980749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:22.986910 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.986885 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 12:09:22.987380 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.987364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:09:22.991665 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:22.991644 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ghfvq\"" Jul 06 12:09:23.004463 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.004445 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv"] Jul 06 12:09:23.129013 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.128984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9jk\" (UniqueName: \"kubernetes.io/projected/7ecbc6e2-1503-4923-96eb-087aec08cc6a-kube-api-access-dz9jk\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dzv\" (UID: \"7ecbc6e2-1503-4923-96eb-087aec08cc6a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.129140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.129029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ecbc6e2-1503-4923-96eb-087aec08cc6a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dzv\" (UID: \"7ecbc6e2-1503-4923-96eb-087aec08cc6a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.229710 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.229647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9jk\" (UniqueName: \"kubernetes.io/projected/7ecbc6e2-1503-4923-96eb-087aec08cc6a-kube-api-access-dz9jk\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dzv\" (UID: \"7ecbc6e2-1503-4923-96eb-087aec08cc6a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.229710 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.229689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ecbc6e2-1503-4923-96eb-087aec08cc6a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dzv\" (UID: \"7ecbc6e2-1503-4923-96eb-087aec08cc6a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.230046 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.230030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ecbc6e2-1503-4923-96eb-087aec08cc6a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dzv\" (UID: \"7ecbc6e2-1503-4923-96eb-087aec08cc6a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.243072 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.243042 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9jk\" (UniqueName: \"kubernetes.io/projected/7ecbc6e2-1503-4923-96eb-087aec08cc6a-kube-api-access-dz9jk\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dzv\" (UID: \"7ecbc6e2-1503-4923-96eb-087aec08cc6a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.292903 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.292885 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" Jul 06 12:09:23.433987 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.433965 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv"] Jul 06 12:09:23.436210 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:09:23.436180 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecbc6e2_1503_4923_96eb_087aec08cc6a.slice/crio-c6596d61877b8fa865779ebdd63b3a7ffbadf499b85205adfbb3b085006c69dc WatchSource:0}: Error finding container c6596d61877b8fa865779ebdd63b3a7ffbadf499b85205adfbb3b085006c69dc: Status 404 returned error can't find the container with id c6596d61877b8fa865779ebdd63b3a7ffbadf499b85205adfbb3b085006c69dc Jul 06 12:09:23.438674 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:23.438659 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:09:24.185731 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:24.185694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" event={"ID":"7ecbc6e2-1503-4923-96eb-087aec08cc6a","Type":"ContainerStarted","Data":"c6596d61877b8fa865779ebdd63b3a7ffbadf499b85205adfbb3b085006c69dc"} Jul 06 12:09:26.194759 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.194720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" event={"ID":"7ecbc6e2-1503-4923-96eb-087aec08cc6a","Type":"ContainerStarted","Data":"77daea1eae02b4989379783f16c292ac851d26647ef4cbd27b5c57fedc35df4f"} Jul 06 12:09:26.228065 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.228018 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dzv" podStartSLOduration=2.48212571 podStartE2EDuration="4.228003099s" totalImagesPullingTime="1.745877389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:09:26.225840177 +0000 UTC m=+310.946829016" watchObservedRunningTime="2026-07-06 12:09:26.228003099 +0000 UTC m=+310.948991987" Jul 06 12:09:26.803595 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.803563 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6"] Jul 06 12:09:26.807140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.807124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:26.811663 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.811640 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d4x2c\"" Jul 06 12:09:26.811789 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.811739 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 12:09:26.812585 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.812568 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 12:09:26.823120 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.823099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6"] Jul 06 12:09:26.958075 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.958049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:26.958184 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.958104 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:26.958184 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:26.958124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k979r\" (UniqueName: \"kubernetes.io/projected/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-kube-api-access-k979r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.058466 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.058406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.058466 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.058460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.058595 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.058565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k979r\" (UniqueName: \"kubernetes.io/projected/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-kube-api-access-k979r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.058759 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.058745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.058832 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.058790 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.067408 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.067389 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k979r\" (UniqueName: \"kubernetes.io/projected/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-kube-api-access-k979r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.116912 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.116890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:27.265942 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:27.265919 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6"] Jul 06 12:09:27.268934 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:09:27.268910 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd0e82d_a936_4ebc_bb15_ea9b4be52995.slice/crio-80a4cb383c89b042fe8fcdd1f67c859af959b80b78b6a1e1af93fdeb705ca2e2 WatchSource:0}: Error finding container 80a4cb383c89b042fe8fcdd1f67c859af959b80b78b6a1e1af93fdeb705ca2e2: Status 404 returned error can't find the container with id 80a4cb383c89b042fe8fcdd1f67c859af959b80b78b6a1e1af93fdeb705ca2e2 Jul 06 12:09:28.205071 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:28.205043 2581 generic.go:356] "Generic (PLEG): container finished" podID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerID="35006e0e87b0d5151919ee561bdd3d8ed97321d88a01b6eb9be83e380fcbaf42" exitCode=0 Jul 06 12:09:28.205195 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:28.205136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" event={"ID":"6fd0e82d-a936-4ebc-bb15-ea9b4be52995","Type":"ContainerDied","Data":"35006e0e87b0d5151919ee561bdd3d8ed97321d88a01b6eb9be83e380fcbaf42"} Jul 06 12:09:28.205195 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:28.205184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" event={"ID":"6fd0e82d-a936-4ebc-bb15-ea9b4be52995","Type":"ContainerStarted","Data":"80a4cb383c89b042fe8fcdd1f67c859af959b80b78b6a1e1af93fdeb705ca2e2"} Jul 06 12:09:30.216001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.215926 2581 generic.go:356] "Generic (PLEG): container finished" podID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerID="6b30058367e6e3eea8baaecfd77dc4a07e82fdbde210063c54d246e3b84bcb01" exitCode=0 Jul 06 12:09:30.216339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.216002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" event={"ID":"6fd0e82d-a936-4ebc-bb15-ea9b4be52995","Type":"ContainerDied","Data":"6b30058367e6e3eea8baaecfd77dc4a07e82fdbde210063c54d246e3b84bcb01"} Jul 06 12:09:30.472343 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.472283 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv"] Jul 06 12:09:30.475488 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.475475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.480664 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.480642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 12:09:30.480664 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.480659 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dxtb8\"" Jul 06 12:09:30.481406 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.481392 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 12:09:30.497898 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.497872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv"] Jul 06 12:09:30.592263 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.592234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s585t\" (UniqueName: \"kubernetes.io/projected/e10fe08e-451c-434d-8d16-1431b6e2990c-kube-api-access-s585t\") pod \"cert-manager-cainjector-559cdd8c87-w4rjv\" (UID: \"e10fe08e-451c-434d-8d16-1431b6e2990c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.592407 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.592295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e10fe08e-451c-434d-8d16-1431b6e2990c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w4rjv\" (UID: \"e10fe08e-451c-434d-8d16-1431b6e2990c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.693269 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.693242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s585t\" (UniqueName: \"kubernetes.io/projected/e10fe08e-451c-434d-8d16-1431b6e2990c-kube-api-access-s585t\") pod \"cert-manager-cainjector-559cdd8c87-w4rjv\" (UID: \"e10fe08e-451c-434d-8d16-1431b6e2990c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.693395 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.693283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e10fe08e-451c-434d-8d16-1431b6e2990c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w4rjv\" (UID: \"e10fe08e-451c-434d-8d16-1431b6e2990c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.707920 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.707893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s585t\" (UniqueName: \"kubernetes.io/projected/e10fe08e-451c-434d-8d16-1431b6e2990c-kube-api-access-s585t\") pod \"cert-manager-cainjector-559cdd8c87-w4rjv\" (UID: \"e10fe08e-451c-434d-8d16-1431b6e2990c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.710091 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.710069 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e10fe08e-451c-434d-8d16-1431b6e2990c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w4rjv\" (UID: \"e10fe08e-451c-434d-8d16-1431b6e2990c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.797300 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.797282 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" Jul 06 12:09:30.928504 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:30.928473 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv"] Jul 06 12:09:30.933468 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:09:30.933445 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode10fe08e_451c_434d_8d16_1431b6e2990c.slice/crio-69ebc19eb318165bce0209d018341e62af9bf6d635d5509c9774bcdb0a41cb4f WatchSource:0}: Error finding container 69ebc19eb318165bce0209d018341e62af9bf6d635d5509c9774bcdb0a41cb4f: Status 404 returned error can't find the container with id 69ebc19eb318165bce0209d018341e62af9bf6d635d5509c9774bcdb0a41cb4f Jul 06 12:09:31.222707 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:31.222636 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" event={"ID":"e10fe08e-451c-434d-8d16-1431b6e2990c","Type":"ContainerStarted","Data":"69ebc19eb318165bce0209d018341e62af9bf6d635d5509c9774bcdb0a41cb4f"} Jul 06 12:09:31.224732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:31.224707 2581 generic.go:356] "Generic (PLEG): container finished" podID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerID="65d897036fcd4d8e4f83fb0f70f1ecdab2ed81b2814df20b4d0827130d02f08a" exitCode=0 Jul 06 12:09:31.224846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:31.224755 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" event={"ID":"6fd0e82d-a936-4ebc-bb15-ea9b4be52995","Type":"ContainerDied","Data":"65d897036fcd4d8e4f83fb0f70f1ecdab2ed81b2814df20b4d0827130d02f08a"} Jul 06 12:09:32.358266 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.358241 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:32.507166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.507107 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-util\") pod \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " Jul 06 12:09:32.507279 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.507172 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-bundle\") pod \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " Jul 06 12:09:32.507279 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.507213 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k979r\" (UniqueName: \"kubernetes.io/projected/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-kube-api-access-k979r\") pod \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\" (UID: \"6fd0e82d-a936-4ebc-bb15-ea9b4be52995\") " Jul 06 12:09:32.507543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.507521 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-bundle" (OuterVolumeSpecName: "bundle") pod "6fd0e82d-a936-4ebc-bb15-ea9b4be52995" (UID: "6fd0e82d-a936-4ebc-bb15-ea9b4be52995"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:09:32.509367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.509331 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-kube-api-access-k979r" (OuterVolumeSpecName: "kube-api-access-k979r") pod "6fd0e82d-a936-4ebc-bb15-ea9b4be52995" (UID: "6fd0e82d-a936-4ebc-bb15-ea9b4be52995"). InnerVolumeSpecName "kube-api-access-k979r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:09:32.580119 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.580080 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-util" (OuterVolumeSpecName: "util") pod "6fd0e82d-a936-4ebc-bb15-ea9b4be52995" (UID: "6fd0e82d-a936-4ebc-bb15-ea9b4be52995"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:09:32.608368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.608347 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:32.608368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.608367 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k979r\" (UniqueName: \"kubernetes.io/projected/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-kube-api-access-k979r\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:32.608502 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:32.608376 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fd0e82d-a936-4ebc-bb15-ea9b4be52995-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:33.235817 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:33.235770 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" Jul 06 12:09:33.236060 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:33.235770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7p6z6" event={"ID":"6fd0e82d-a936-4ebc-bb15-ea9b4be52995","Type":"ContainerDied","Data":"80a4cb383c89b042fe8fcdd1f67c859af959b80b78b6a1e1af93fdeb705ca2e2"} Jul 06 12:09:33.236060 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:33.235920 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80a4cb383c89b042fe8fcdd1f67c859af959b80b78b6a1e1af93fdeb705ca2e2" Jul 06 12:09:35.115509 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115489 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h28n5"] Jul 06 12:09:35.115857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115842 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="pull" Jul 06 12:09:35.115911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115858 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="pull" Jul 06 12:09:35.115911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115877 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="extract" Jul 06 12:09:35.115911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115883 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="extract" Jul 06 12:09:35.115911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115894 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="util" Jul 06 12:09:35.115911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115899 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="util" Jul 06 12:09:35.116051 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.115949 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd0e82d-a936-4ebc-bb15-ea9b4be52995" containerName="extract" Jul 06 12:09:35.118879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.118862 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.122507 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.122329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mqdjn\"" Jul 06 12:09:35.134368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.134348 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h28n5"] Jul 06 12:09:35.227147 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.227117 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjnd\" (UniqueName: \"kubernetes.io/projected/7c8e2842-d008-46dd-b607-53fe81cfcf38-kube-api-access-zwjnd\") pod \"cert-manager-webhook-6486ffd997-h28n5\" (UID: \"7c8e2842-d008-46dd-b607-53fe81cfcf38\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.227147 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.227150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c8e2842-d008-46dd-b607-53fe81cfcf38-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h28n5\" (UID: \"7c8e2842-d008-46dd-b607-53fe81cfcf38\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.246675 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.246650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" event={"ID":"e10fe08e-451c-434d-8d16-1431b6e2990c","Type":"ContainerStarted","Data":"0d6d425c13ab3e4e2e26996fcea3eca83bbe7e355ce1ca4683ddfee5987aa891"} Jul 06 12:09:35.267504 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.267461 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w4rjv" podStartSLOduration=1.0938329 podStartE2EDuration="5.267443202s" totalImagesPullingTime="4.173610302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:09:35.266247382 +0000 UTC m=+319.987236223" watchObservedRunningTime="2026-07-06 12:09:35.267443202 +0000 UTC m=+319.988432042" Jul 06 12:09:35.328285 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.328259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjnd\" (UniqueName: \"kubernetes.io/projected/7c8e2842-d008-46dd-b607-53fe81cfcf38-kube-api-access-zwjnd\") pod \"cert-manager-webhook-6486ffd997-h28n5\" (UID: \"7c8e2842-d008-46dd-b607-53fe81cfcf38\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.328442 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.328301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c8e2842-d008-46dd-b607-53fe81cfcf38-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h28n5\" (UID: \"7c8e2842-d008-46dd-b607-53fe81cfcf38\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.338078 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.338050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjnd\" (UniqueName: \"kubernetes.io/projected/7c8e2842-d008-46dd-b607-53fe81cfcf38-kube-api-access-zwjnd\") pod \"cert-manager-webhook-6486ffd997-h28n5\" (UID: \"7c8e2842-d008-46dd-b607-53fe81cfcf38\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.338562 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.338544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c8e2842-d008-46dd-b607-53fe81cfcf38-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h28n5\" (UID: \"7c8e2842-d008-46dd-b607-53fe81cfcf38\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.445296 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.445218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:35.580177 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:35.580147 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h28n5"] Jul 06 12:09:35.582821 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:09:35.582764 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c8e2842_d008_46dd_b607_53fe81cfcf38.slice/crio-9ac37b35ef33c3beaed80162ab1c0d7bb22bbf19c7786109433adcda083e3dec WatchSource:0}: Error finding container 9ac37b35ef33c3beaed80162ab1c0d7bb22bbf19c7786109433adcda083e3dec: Status 404 returned error can't find the container with id 9ac37b35ef33c3beaed80162ab1c0d7bb22bbf19c7786109433adcda083e3dec Jul 06 12:09:36.252922 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:36.252886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" event={"ID":"7c8e2842-d008-46dd-b607-53fe81cfcf38","Type":"ContainerStarted","Data":"601941a1d8d73401607d883964d647dbff338909b92d72ea080f77539c58a51a"} Jul 06 12:09:36.253284 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:36.252931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" event={"ID":"7c8e2842-d008-46dd-b607-53fe81cfcf38","Type":"ContainerStarted","Data":"9ac37b35ef33c3beaed80162ab1c0d7bb22bbf19c7786109433adcda083e3dec"} Jul 06 12:09:36.276915 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:36.276872 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" podStartSLOduration=1.276853958 podStartE2EDuration="1.276853958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:09:36.275397216 +0000 UTC m=+320.996386057" watchObservedRunningTime="2026-07-06 12:09:36.276853958 +0000 UTC m=+320.997842798" Jul 06 12:09:37.250747 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.250713 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lwzcj"] Jul 06 12:09:37.254053 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.254030 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.256468 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.256447 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4r5xx\"" Jul 06 12:09:37.258235 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.258217 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:37.265504 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.265481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lwzcj"] Jul 06 12:09:37.347755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.347723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/7b778257-806c-4c1d-9acd-ebdadcd5aa9a-kube-api-access-rhmgq\") pod \"cert-manager-55b4d954d5-lwzcj\" (UID: \"7b778257-806c-4c1d-9acd-ebdadcd5aa9a\") " pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.347881 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.347756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b778257-806c-4c1d-9acd-ebdadcd5aa9a-bound-sa-token\") pod \"cert-manager-55b4d954d5-lwzcj\" (UID: \"7b778257-806c-4c1d-9acd-ebdadcd5aa9a\") " pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.449016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.448991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/7b778257-806c-4c1d-9acd-ebdadcd5aa9a-kube-api-access-rhmgq\") pod \"cert-manager-55b4d954d5-lwzcj\" (UID: \"7b778257-806c-4c1d-9acd-ebdadcd5aa9a\") " pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.449097 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.449021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b778257-806c-4c1d-9acd-ebdadcd5aa9a-bound-sa-token\") pod \"cert-manager-55b4d954d5-lwzcj\" (UID: \"7b778257-806c-4c1d-9acd-ebdadcd5aa9a\") " pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.458533 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.458506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b778257-806c-4c1d-9acd-ebdadcd5aa9a-bound-sa-token\") pod \"cert-manager-55b4d954d5-lwzcj\" (UID: \"7b778257-806c-4c1d-9acd-ebdadcd5aa9a\") " pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.458698 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.458678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/7b778257-806c-4c1d-9acd-ebdadcd5aa9a-kube-api-access-rhmgq\") pod \"cert-manager-55b4d954d5-lwzcj\" (UID: \"7b778257-806c-4c1d-9acd-ebdadcd5aa9a\") " pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.564694 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.564670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lwzcj" Jul 06 12:09:37.697865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:37.697841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lwzcj"] Jul 06 12:09:37.701252 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:09:37.701223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b778257_806c_4c1d_9acd_ebdadcd5aa9a.slice/crio-e40dafa881d362212493391ef61b76b3fa82277c6724678bd0a25cf8b626a772 WatchSource:0}: Error finding container e40dafa881d362212493391ef61b76b3fa82277c6724678bd0a25cf8b626a772: Status 404 returned error can't find the container with id e40dafa881d362212493391ef61b76b3fa82277c6724678bd0a25cf8b626a772 Jul 06 12:09:38.264352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:38.264316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lwzcj" event={"ID":"7b778257-806c-4c1d-9acd-ebdadcd5aa9a","Type":"ContainerStarted","Data":"e5e240d9d05c4e30b47ecadb50aed2a27d119efe0ecbaf7fdcc628b07e4c6007"} Jul 06 12:09:38.264352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:38.264357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lwzcj" event={"ID":"7b778257-806c-4c1d-9acd-ebdadcd5aa9a","Type":"ContainerStarted","Data":"e40dafa881d362212493391ef61b76b3fa82277c6724678bd0a25cf8b626a772"} Jul 06 12:09:38.284717 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:38.284662 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lwzcj" podStartSLOduration=1.284649501 podStartE2EDuration="1.284649501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:09:38.282360988 +0000 UTC m=+323.003349826" watchObservedRunningTime="2026-07-06 12:09:38.284649501 +0000 UTC m=+323.005638342" Jul 06 12:09:43.266268 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:43.266242 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h28n5" Jul 06 12:09:44.557970 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.557942 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf"] Jul 06 12:09:44.563357 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.563340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.566163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.566143 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 12:09:44.566304 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.566181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 12:09:44.566954 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.566938 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d4x2c\"" Jul 06 12:09:44.571713 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.571691 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf"] Jul 06 12:09:44.703494 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.703465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.703609 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.703524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.703609 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.703551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcr5\" (UniqueName: \"kubernetes.io/projected/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-kube-api-access-5pcr5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.804109 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.804082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.804216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.804138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.804216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.804167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcr5\" (UniqueName: \"kubernetes.io/projected/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-kube-api-access-5pcr5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.804455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.804434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.804524 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.804477 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.813029 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.812979 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcr5\" (UniqueName: \"kubernetes.io/projected/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-kube-api-access-5pcr5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:44.874391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:44.874374 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:45.006058 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:45.006037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf"] Jul 06 12:09:45.008599 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:09:45.008576 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9db792c_1626_4a6b_95b2_78a21ebeaf2a.slice/crio-e152e52f0c21c198cca5c32f5b4917e3b0a2fe3599b9db7ea46800e336b8527d WatchSource:0}: Error finding container e152e52f0c21c198cca5c32f5b4917e3b0a2fe3599b9db7ea46800e336b8527d: Status 404 returned error can't find the container with id e152e52f0c21c198cca5c32f5b4917e3b0a2fe3599b9db7ea46800e336b8527d Jul 06 12:09:45.298507 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:45.298474 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerID="71f347611e369007a7e1179e327ca794760d0e145ebe1f2ef03cfe8e86775392" exitCode=0 Jul 06 12:09:45.298632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:45.298519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" event={"ID":"f9db792c-1626-4a6b-95b2-78a21ebeaf2a","Type":"ContainerDied","Data":"71f347611e369007a7e1179e327ca794760d0e145ebe1f2ef03cfe8e86775392"} Jul 06 12:09:45.298632 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:45.298561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" event={"ID":"f9db792c-1626-4a6b-95b2-78a21ebeaf2a","Type":"ContainerStarted","Data":"e152e52f0c21c198cca5c32f5b4917e3b0a2fe3599b9db7ea46800e336b8527d"} Jul 06 12:09:47.308738 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:47.308703 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerID="b0722eba1139a230879aad363b73a7f0f18662f84f5cec8adf8aa75d501a0a4f" exitCode=0 Jul 06 12:09:47.309122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:47.308791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" event={"ID":"f9db792c-1626-4a6b-95b2-78a21ebeaf2a","Type":"ContainerDied","Data":"b0722eba1139a230879aad363b73a7f0f18662f84f5cec8adf8aa75d501a0a4f"} Jul 06 12:09:48.317486 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:48.317459 2581 generic.go:356] "Generic (PLEG): container finished" podID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerID="ea4a1abc9940ebae6ae454a88f3c6b3754bd03e8d024b732fdf3728de422d528" exitCode=0 Jul 06 12:09:48.317936 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:48.317500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" event={"ID":"f9db792c-1626-4a6b-95b2-78a21ebeaf2a","Type":"ContainerDied","Data":"ea4a1abc9940ebae6ae454a88f3c6b3754bd03e8d024b732fdf3728de422d528"} Jul 06 12:09:49.445107 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.445080 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:49.642183 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.642128 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-bundle\") pod \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " Jul 06 12:09:49.642183 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.642175 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pcr5\" (UniqueName: \"kubernetes.io/projected/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-kube-api-access-5pcr5\") pod \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " Jul 06 12:09:49.642352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.642195 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-util\") pod \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\" (UID: \"f9db792c-1626-4a6b-95b2-78a21ebeaf2a\") " Jul 06 12:09:49.642857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.642832 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-bundle" (OuterVolumeSpecName: "bundle") pod "f9db792c-1626-4a6b-95b2-78a21ebeaf2a" (UID: "f9db792c-1626-4a6b-95b2-78a21ebeaf2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:09:49.644081 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.644058 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-kube-api-access-5pcr5" (OuterVolumeSpecName: "kube-api-access-5pcr5") pod "f9db792c-1626-4a6b-95b2-78a21ebeaf2a" (UID: "f9db792c-1626-4a6b-95b2-78a21ebeaf2a"). InnerVolumeSpecName "kube-api-access-5pcr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:09:49.647961 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.647917 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-util" (OuterVolumeSpecName: "util") pod "f9db792c-1626-4a6b-95b2-78a21ebeaf2a" (UID: "f9db792c-1626-4a6b-95b2-78a21ebeaf2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:09:49.743263 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.743234 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:49.743263 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.743258 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:49.743385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:49.743272 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pcr5\" (UniqueName: \"kubernetes.io/projected/f9db792c-1626-4a6b-95b2-78a21ebeaf2a-kube-api-access-5pcr5\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:09:50.327573 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:50.327549 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" Jul 06 12:09:50.327724 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:50.327549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrz7zf" event={"ID":"f9db792c-1626-4a6b-95b2-78a21ebeaf2a","Type":"ContainerDied","Data":"e152e52f0c21c198cca5c32f5b4917e3b0a2fe3599b9db7ea46800e336b8527d"} Jul 06 12:09:50.327724 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:09:50.327670 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e152e52f0c21c198cca5c32f5b4917e3b0a2fe3599b9db7ea46800e336b8527d" Jul 06 12:10:04.643188 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643150 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd"] Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643619 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="util" Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643634 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="util" Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643654 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="extract" Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643660 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="extract" Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643672 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="pull" Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643681 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="pull" Jul 06 12:10:04.643743 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.643740 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9db792c-1626-4a6b-95b2-78a21ebeaf2a" containerName="extract" Jul 06 12:10:04.647690 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.647671 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.651852 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.651830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pdvvq\"" Jul 06 12:10:04.651949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.651886 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 12:10:04.652040 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.652021 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 12:10:04.654334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.654312 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 12:10:04.655268 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.655252 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 12:10:04.677735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.677707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd"] Jul 06 12:10:04.755735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.755715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bqst\" (UniqueName: \"kubernetes.io/projected/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-kube-api-access-9bqst\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.755861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.755745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.755861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.755821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.755861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.755839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.755970 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.755867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.857056 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.857035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.857145 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.857060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.857145 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.857084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.857145 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.857102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bqst\" (UniqueName: \"kubernetes.io/projected/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-kube-api-access-9bqst\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.857145 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.857121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.857472 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.857450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.859382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.859361 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.859470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.859427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.859642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.859622 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.878281 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.878261 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bqst\" (UniqueName: \"kubernetes.io/projected/47a15c9b-2ef9-4268-bc99-f4c289f7dfdd-kube-api-access-9bqst\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-9xnnd\" (UID: \"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:04.957899 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:04.957846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:05.126162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:05.126136 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd"] Jul 06 12:10:05.127919 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:10:05.127894 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a15c9b_2ef9_4268_bc99_f4c289f7dfdd.slice/crio-eef050e6cecc28fe5b610c0a6539ec97093d907aac391e3bfb215831db6f9d9a WatchSource:0}: Error finding container eef050e6cecc28fe5b610c0a6539ec97093d907aac391e3bfb215831db6f9d9a: Status 404 returned error can't find the container with id eef050e6cecc28fe5b610c0a6539ec97093d907aac391e3bfb215831db6f9d9a Jul 06 12:10:05.396725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:05.396696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" event={"ID":"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd","Type":"ContainerStarted","Data":"eef050e6cecc28fe5b610c0a6539ec97093d907aac391e3bfb215831db6f9d9a"} Jul 06 12:10:09.417039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:09.416999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" event={"ID":"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd","Type":"ContainerStarted","Data":"1dcd1fa4d5fc150f27391b7b097b7b89d474d646b376e09b29d96d2932fbd2ab"} Jul 06 12:10:10.423384 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:10.423350 2581 generic.go:356] "Generic (PLEG): container finished" podID="47a15c9b-2ef9-4268-bc99-f4c289f7dfdd" containerID="1dcd1fa4d5fc150f27391b7b097b7b89d474d646b376e09b29d96d2932fbd2ab" exitCode=0 Jul 06 12:10:10.423781 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:10.423439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" event={"ID":"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd","Type":"ContainerDied","Data":"1dcd1fa4d5fc150f27391b7b097b7b89d474d646b376e09b29d96d2932fbd2ab"} Jul 06 12:10:11.430150 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:11.430117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" event={"ID":"47a15c9b-2ef9-4268-bc99-f4c289f7dfdd","Type":"ContainerStarted","Data":"3f01defb7ccf100e6f96553680f57ca33bcf2814f13a2244c279f687aa30e1c0"} Jul 06 12:10:11.430567 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:11.430246 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:11.473092 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:11.473045 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" podStartSLOduration=2.6885208240000003 podStartE2EDuration="7.473030067s" totalImagesPullingTime="3.763060488s" totalInitContainerRuntime="1.021448755s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:11.467229391 +0000 UTC m=+356.188218252" watchObservedRunningTime="2026-07-06 12:10:11.473030067 +0000 UTC m=+356.194018908" Jul 06 12:10:22.437305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:22.437274 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-9xnnd" Jul 06 12:10:25.174707 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.174675 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x"] Jul 06 12:10:25.184667 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.184646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.187972 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.187950 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 12:10:25.188088 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.187952 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gqstz\"" Jul 06 12:10:25.188754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.188737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 12:10:25.202056 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.202036 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x"] Jul 06 12:10:25.311391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.311368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e41a0e-6f9e-41cf-9adc-9de75f603725-tls-certs\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.311513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.311418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07e41a0e-6f9e-41cf-9adc-9de75f603725-tmp\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.311513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.311444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57zpr\" (UniqueName: \"kubernetes.io/projected/07e41a0e-6f9e-41cf-9adc-9de75f603725-kube-api-access-57zpr\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.412464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.412438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07e41a0e-6f9e-41cf-9adc-9de75f603725-tmp\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.412564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.412466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57zpr\" (UniqueName: \"kubernetes.io/projected/07e41a0e-6f9e-41cf-9adc-9de75f603725-kube-api-access-57zpr\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.412564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.412512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e41a0e-6f9e-41cf-9adc-9de75f603725-tls-certs\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.414697 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.414676 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07e41a0e-6f9e-41cf-9adc-9de75f603725-tmp\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.414920 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.414903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e41a0e-6f9e-41cf-9adc-9de75f603725-tls-certs\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.429372 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.429316 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57zpr\" (UniqueName: \"kubernetes.io/projected/07e41a0e-6f9e-41cf-9adc-9de75f603725-kube-api-access-57zpr\") pod \"kube-auth-proxy-5db79c56f9-6dn4x\" (UID: \"07e41a0e-6f9e-41cf-9adc-9de75f603725\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.494515 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.494492 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" Jul 06 12:10:25.639564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:25.639539 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x"] Jul 06 12:10:25.642219 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:10:25.642183 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e41a0e_6f9e_41cf_9adc_9de75f603725.slice/crio-5047edeeef5d9022dcdc56ea8ab39590b94571c5010f7f0a9e0dd170d4fa3d66 WatchSource:0}: Error finding container 5047edeeef5d9022dcdc56ea8ab39590b94571c5010f7f0a9e0dd170d4fa3d66: Status 404 returned error can't find the container with id 5047edeeef5d9022dcdc56ea8ab39590b94571c5010f7f0a9e0dd170d4fa3d66 Jul 06 12:10:26.500222 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:26.500188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" event={"ID":"07e41a0e-6f9e-41cf-9adc-9de75f603725","Type":"ContainerStarted","Data":"5047edeeef5d9022dcdc56ea8ab39590b94571c5010f7f0a9e0dd170d4fa3d66"} Jul 06 12:10:29.516985 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:29.516943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" event={"ID":"07e41a0e-6f9e-41cf-9adc-9de75f603725","Type":"ContainerStarted","Data":"03ffc80c04e4549d1cbe0e472cb9c92d3ede02d1bcdde71dd9f98eb2e3ae387d"} Jul 06 12:10:29.536291 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:29.536239 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-6dn4x" podStartSLOduration=1.244069687 podStartE2EDuration="4.536212078s" totalImagesPullingTime="3.292142391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:29.535963931 +0000 UTC m=+374.256952771" watchObservedRunningTime="2026-07-06 12:10:29.536212078 +0000 UTC m=+374.257200923" Jul 06 12:10:34.297939 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.297909 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9"] Jul 06 12:10:34.301382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.301367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.307595 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.307576 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4jmvr\"" Jul 06 12:10:34.308189 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.308137 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 12:10:34.386517 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386622 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386622 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386622 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e4be61-3d57-475c-bc5a-e75809101820-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386727 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4gs\" (UniqueName: \"kubernetes.io/projected/e6e4be61-3d57-475c-bc5a-e75809101820-kube-api-access-rl4gs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386727 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386727 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386727 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e4be61-3d57-475c-bc5a-e75809101820-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.386879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.386732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e4be61-3d57-475c-bc5a-e75809101820-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.487999 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.487978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488120 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488120 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488120 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e4be61-3d57-475c-bc5a-e75809101820-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488299 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4gs\" (UniqueName: \"kubernetes.io/projected/e6e4be61-3d57-475c-bc5a-e75809101820-kube-api-access-rl4gs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488299 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488299 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e4be61-3d57-475c-bc5a-e75809101820-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e4be61-3d57-475c-bc5a-e75809101820-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.488621 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.488582 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.489092 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.489068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.489177 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.489071 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e4be61-3d57-475c-bc5a-e75809101820-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.490257 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.490237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e4be61-3d57-475c-bc5a-e75809101820-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.490685 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.490667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e4be61-3d57-475c-bc5a-e75809101820-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.502279 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.502258 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9"] Jul 06 12:10:34.533581 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.533559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e4be61-3d57-475c-bc5a-e75809101820-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.566107 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.566050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4gs\" (UniqueName: \"kubernetes.io/projected/e6e4be61-3d57-475c-bc5a-e75809101820-kube-api-access-rl4gs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jn9\" (UID: \"e6e4be61-3d57-475c-bc5a-e75809101820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.611540 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.611522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:34.762658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:34.762635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9"] Jul 06 12:10:34.764871 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:10:34.764847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e4be61_3d57_475c_bc5a_e75809101820.slice/crio-d498ae6af48ed96860427f9a57d71da644110b95beee68eef07b9b545ca6fcdd WatchSource:0}: Error finding container d498ae6af48ed96860427f9a57d71da644110b95beee68eef07b9b545ca6fcdd: Status 404 returned error can't find the container with id d498ae6af48ed96860427f9a57d71da644110b95beee68eef07b9b545ca6fcdd Jul 06 12:10:35.547821 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:35.547780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" event={"ID":"e6e4be61-3d57-475c-bc5a-e75809101820","Type":"ContainerStarted","Data":"d498ae6af48ed96860427f9a57d71da644110b95beee68eef07b9b545ca6fcdd"} Jul 06 12:10:36.416531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.416500 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj"] Jul 06 12:10:36.420349 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.420314 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.425750 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.425720 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 12:10:36.425927 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.425735 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 12:10:36.426111 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.426086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 12:10:36.427106 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.427082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tv9s8\"" Jul 06 12:10:36.427106 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.427100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 12:10:36.427301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.427266 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 12:10:36.434481 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.434460 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj"] Jul 06 12:10:36.507984 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.507955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c7a7e07-858e-41e6-a647-3aa2960c09c0-manager-config\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.508136 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.508017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgldw\" (UniqueName: \"kubernetes.io/projected/2c7a7e07-858e-41e6-a647-3aa2960c09c0-kube-api-access-bgldw\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.508136 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.508098 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c7a7e07-858e-41e6-a647-3aa2960c09c0-cert\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.508246 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.508166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c7a7e07-858e-41e6-a647-3aa2960c09c0-metrics-cert\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.609395 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.609360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c7a7e07-858e-41e6-a647-3aa2960c09c0-manager-config\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.610023 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.609429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgldw\" (UniqueName: \"kubernetes.io/projected/2c7a7e07-858e-41e6-a647-3aa2960c09c0-kube-api-access-bgldw\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.610023 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.609464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c7a7e07-858e-41e6-a647-3aa2960c09c0-cert\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.610023 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.609518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c7a7e07-858e-41e6-a647-3aa2960c09c0-metrics-cert\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.610216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.610190 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c7a7e07-858e-41e6-a647-3aa2960c09c0-manager-config\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.612616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.612592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c7a7e07-858e-41e6-a647-3aa2960c09c0-metrics-cert\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.613564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.613524 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c7a7e07-858e-41e6-a647-3aa2960c09c0-cert\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.619443 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.619421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgldw\" (UniqueName: \"kubernetes.io/projected/2c7a7e07-858e-41e6-a647-3aa2960c09c0-kube-api-access-bgldw\") pod \"lws-controller-manager-7d8dd6c8b8-8ncdj\" (UID: \"2c7a7e07-858e-41e6-a647-3aa2960c09c0\") " pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.732845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.732758 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:36.930149 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:36.930118 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj"] Jul 06 12:10:37.788876 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:10:37.788843 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7a7e07_858e_41e6_a647_3aa2960c09c0.slice/crio-41ba6000b872f3e8f779cd435df8fe331641d4e4e1a9a0ed9361f908eaa34744 WatchSource:0}: Error finding container 41ba6000b872f3e8f779cd435df8fe331641d4e4e1a9a0ed9361f908eaa34744: Status 404 returned error can't find the container with id 41ba6000b872f3e8f779cd435df8fe331641d4e4e1a9a0ed9361f908eaa34744 Jul 06 12:10:37.850703 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:37.850668 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:10:37.850788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:37.850740 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:10:37.850788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:37.850766 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:10:38.574448 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:38.574410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" event={"ID":"e6e4be61-3d57-475c-bc5a-e75809101820","Type":"ContainerStarted","Data":"40d1a0e8f3669e1cd828174c7a2cebed302dc6ab62f8dce6f45980d1465c3fda"} Jul 06 12:10:38.575875 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:38.575846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" event={"ID":"2c7a7e07-858e-41e6-a647-3aa2960c09c0","Type":"ContainerStarted","Data":"41ba6000b872f3e8f779cd435df8fe331641d4e4e1a9a0ed9361f908eaa34744"} Jul 06 12:10:38.614867 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:38.613161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:38.620149 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:38.620090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:38.713031 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:38.712984 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" podStartSLOduration=1.629270695 podStartE2EDuration="4.712964583s" totalImagesPullingTime="3.083693888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:38.652254125 +0000 UTC m=+383.373242948" watchObservedRunningTime="2026-07-06 12:10:38.712964583 +0000 UTC m=+383.433953422" Jul 06 12:10:39.582577 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:39.582494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" event={"ID":"2c7a7e07-858e-41e6-a647-3aa2960c09c0","Type":"ContainerStarted","Data":"4ea084895e7789356cf88af332f0a96511fb642932104f3b853a86a825203133"} Jul 06 12:10:39.583095 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:39.582761 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:39.583095 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:39.582818 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:10:39.583478 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:39.583461 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jn9" Jul 06 12:10:39.673293 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:39.673239 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" podStartSLOduration=2.19632641 podStartE2EDuration="3.67322111s" totalImagesPullingTime="1.4768947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:39.673076813 +0000 UTC m=+384.394065652" watchObservedRunningTime="2026-07-06 12:10:39.67322111 +0000 UTC m=+384.394209951" Jul 06 12:10:50.589500 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:10:50.589464 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d8dd6c8b8-8ncdj" Jul 06 12:11:41.804340 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.804148 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v"] Jul 06 12:11:41.808532 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.808511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:41.813498 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.813474 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 12:11:41.813599 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.813534 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fbzvp\"" Jul 06 12:11:41.814184 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.814165 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 12:11:41.820346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.820328 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v"] Jul 06 12:11:41.904072 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.904050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pswxs\" (UniqueName: \"kubernetes.io/projected/ec853eca-a12c-40ed-957e-64e98abf66f9-kube-api-access-pswxs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:41.904181 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.904077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:41.904181 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:41.904144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.004576 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.004548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.004697 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.004622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pswxs\" (UniqueName: \"kubernetes.io/projected/ec853eca-a12c-40ed-957e-64e98abf66f9-kube-api-access-pswxs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.004697 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.004650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.004942 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.004921 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.005017 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.004999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.014814 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.014786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pswxs\" (UniqueName: \"kubernetes.io/projected/ec853eca-a12c-40ed-957e-64e98abf66f9-kube-api-access-pswxs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.117917 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.117861 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:42.175459 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.175429 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw"] Jul 06 12:11:42.179420 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.179275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.190465 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.190444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw"] Jul 06 12:11:42.257971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.257949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v"] Jul 06 12:11:42.259381 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:11:42.259360 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec853eca_a12c_40ed_957e_64e98abf66f9.slice/crio-cf60ac4b02f281db34ecc71b927fe4556706a736c08845df56cf047a9eaf72a4 WatchSource:0}: Error finding container cf60ac4b02f281db34ecc71b927fe4556706a736c08845df56cf047a9eaf72a4: Status 404 returned error can't find the container with id cf60ac4b02f281db34ecc71b927fe4556706a736c08845df56cf047a9eaf72a4 Jul 06 12:11:42.307597 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.307574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68cfg\" (UniqueName: \"kubernetes.io/projected/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-kube-api-access-68cfg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.307688 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.307610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.307688 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.307628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.408545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.408492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68cfg\" (UniqueName: \"kubernetes.io/projected/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-kube-api-access-68cfg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.408545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.408534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.408545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.408553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.408937 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.408915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.408986 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.408945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.417487 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.417462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68cfg\" (UniqueName: \"kubernetes.io/projected/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-kube-api-access-68cfg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.492102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.492081 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:42.575567 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.575540 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7"] Jul 06 12:11:42.580427 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.580407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.589340 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.589315 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7"] Jul 06 12:11:42.626821 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.626755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw"] Jul 06 12:11:42.629271 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:11:42.629241 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c1ad52_2317_4895_bae1_8cf9d65f7f4c.slice/crio-9a0742d03c6cbfaabfb1b156710d57e3c64ef2c8e43986e3c6bed110d22d7be6 WatchSource:0}: Error finding container 9a0742d03c6cbfaabfb1b156710d57e3c64ef2c8e43986e3c6bed110d22d7be6: Status 404 returned error can't find the container with id 9a0742d03c6cbfaabfb1b156710d57e3c64ef2c8e43986e3c6bed110d22d7be6 Jul 06 12:11:42.711325 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.711300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.711447 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.711369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbc4m\" (UniqueName: \"kubernetes.io/projected/80023010-bca5-4a48-a3c5-7ac39741f0ad-kube-api-access-tbc4m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.711447 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.711413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.812548 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.812525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbc4m\" (UniqueName: \"kubernetes.io/projected/80023010-bca5-4a48-a3c5-7ac39741f0ad-kube-api-access-tbc4m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.812877 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.812572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.812877 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.812620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.812963 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.812931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.813009 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.812960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.821644 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.821626 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbc4m\" (UniqueName: \"kubernetes.io/projected/80023010-bca5-4a48-a3c5-7ac39741f0ad-kube-api-access-tbc4m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.892741 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.892717 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:42.905684 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.905661 2581 generic.go:356] "Generic (PLEG): container finished" podID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerID="72e9dead838e23cdd0f01f79cfdb7d7b4298fff3d8d2e2e47f862ec1cf0e401b" exitCode=0 Jul 06 12:11:42.905842 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.905746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" event={"ID":"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c","Type":"ContainerDied","Data":"72e9dead838e23cdd0f01f79cfdb7d7b4298fff3d8d2e2e47f862ec1cf0e401b"} Jul 06 12:11:42.905842 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.905812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" event={"ID":"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c","Type":"ContainerStarted","Data":"9a0742d03c6cbfaabfb1b156710d57e3c64ef2c8e43986e3c6bed110d22d7be6"} Jul 06 12:11:42.907479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.907461 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerID="fb3d27c708ca4d118d9901572c6adbc4bec5f2a94969448ff3e0e07183f47900" exitCode=0 Jul 06 12:11:42.907600 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.907522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" event={"ID":"ec853eca-a12c-40ed-957e-64e98abf66f9","Type":"ContainerDied","Data":"fb3d27c708ca4d118d9901572c6adbc4bec5f2a94969448ff3e0e07183f47900"} Jul 06 12:11:42.907600 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.907570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" event={"ID":"ec853eca-a12c-40ed-957e-64e98abf66f9","Type":"ContainerStarted","Data":"cf60ac4b02f281db34ecc71b927fe4556706a736c08845df56cf047a9eaf72a4"} Jul 06 12:11:42.978245 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.978220 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv"] Jul 06 12:11:42.982857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.982833 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:42.994537 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:42.994514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv"] Jul 06 12:11:43.034344 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.034327 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7"] Jul 06 12:11:43.036371 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:11:43.036349 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80023010_bca5_4a48_a3c5_7ac39741f0ad.slice/crio-a6096ef557f5e0239e0c5fdd18268a76ca76265c870659bb5c0ebd63736eed85 WatchSource:0}: Error finding container a6096ef557f5e0239e0c5fdd18268a76ca76265c870659bb5c0ebd63736eed85: Status 404 returned error can't find the container with id a6096ef557f5e0239e0c5fdd18268a76ca76265c870659bb5c0ebd63736eed85 Jul 06 12:11:43.114862 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.114835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.114993 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.114885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9qn\" (UniqueName: \"kubernetes.io/projected/f132afbe-a3cf-4607-8ba8-68115b353f01-kube-api-access-8q9qn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.114993 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.114905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.215513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.215457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.215623 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.215510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9qn\" (UniqueName: \"kubernetes.io/projected/f132afbe-a3cf-4607-8ba8-68115b353f01-kube-api-access-8q9qn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.215623 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.215539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.215850 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.215833 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.215950 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.215928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.226775 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.226750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9qn\" (UniqueName: \"kubernetes.io/projected/f132afbe-a3cf-4607-8ba8-68115b353f01-kube-api-access-8q9qn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.293901 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.293878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:43.424002 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.423978 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv"] Jul 06 12:11:43.425693 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:11:43.425665 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf132afbe_a3cf_4607_8ba8_68115b353f01.slice/crio-dcb141d6413d7e2d2402e5914701784f1e922701961177184baa752c00085316 WatchSource:0}: Error finding container dcb141d6413d7e2d2402e5914701784f1e922701961177184baa752c00085316: Status 404 returned error can't find the container with id dcb141d6413d7e2d2402e5914701784f1e922701961177184baa752c00085316 Jul 06 12:11:43.914782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.914750 2581 generic.go:356] "Generic (PLEG): container finished" podID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerID="71e4d4378111689b7bdbd7b552dda8a3a59b3d8bddc8a003d3608f6f8171af14" exitCode=0 Jul 06 12:11:43.915208 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.914841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" event={"ID":"80023010-bca5-4a48-a3c5-7ac39741f0ad","Type":"ContainerDied","Data":"71e4d4378111689b7bdbd7b552dda8a3a59b3d8bddc8a003d3608f6f8171af14"} Jul 06 12:11:43.915208 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.914898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" event={"ID":"80023010-bca5-4a48-a3c5-7ac39741f0ad","Type":"ContainerStarted","Data":"a6096ef557f5e0239e0c5fdd18268a76ca76265c870659bb5c0ebd63736eed85"} Jul 06 12:11:43.916756 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.916727 2581 generic.go:356] "Generic (PLEG): container finished" podID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerID="e4c1a314239aaf2042460182649aa70749f61a52ea192853438cd04c5ae21c8a" exitCode=0 Jul 06 12:11:43.916911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.916824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" event={"ID":"f132afbe-a3cf-4607-8ba8-68115b353f01","Type":"ContainerDied","Data":"e4c1a314239aaf2042460182649aa70749f61a52ea192853438cd04c5ae21c8a"} Jul 06 12:11:43.916911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:43.916870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" event={"ID":"f132afbe-a3cf-4607-8ba8-68115b353f01","Type":"ContainerStarted","Data":"dcb141d6413d7e2d2402e5914701784f1e922701961177184baa752c00085316"} Jul 06 12:11:44.923476 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:44.923445 2581 generic.go:356] "Generic (PLEG): container finished" podID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerID="ed9edd79bd4e5ee663d52299ebf0251ca612cfbfdcb293a22f8ecb98ff31ef7a" exitCode=0 Jul 06 12:11:44.923881 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:44.923518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" event={"ID":"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c","Type":"ContainerDied","Data":"ed9edd79bd4e5ee663d52299ebf0251ca612cfbfdcb293a22f8ecb98ff31ef7a"} Jul 06 12:11:44.925444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:44.925423 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerID="f7e4476fad0ee58e0f5dbe6931828b434486d2535d20fa33ee2f6e3f8378b2c6" exitCode=0 Jul 06 12:11:44.925534 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:44.925514 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" event={"ID":"ec853eca-a12c-40ed-957e-64e98abf66f9","Type":"ContainerDied","Data":"f7e4476fad0ee58e0f5dbe6931828b434486d2535d20fa33ee2f6e3f8378b2c6"} Jul 06 12:11:45.932541 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.932509 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerID="270f35896820e0ac6d55c25733d9e0a79a250858d978f00d771226e8e321881b" exitCode=0 Jul 06 12:11:45.932916 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.932575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" event={"ID":"ec853eca-a12c-40ed-957e-64e98abf66f9","Type":"ContainerDied","Data":"270f35896820e0ac6d55c25733d9e0a79a250858d978f00d771226e8e321881b"} Jul 06 12:11:45.934336 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.934308 2581 generic.go:356] "Generic (PLEG): container finished" podID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerID="643fce14f4fae2e227729f82dcf7bfb61f1eef02d5d595276f6c79d3ddf6c323" exitCode=0 Jul 06 12:11:45.934467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.934391 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" event={"ID":"80023010-bca5-4a48-a3c5-7ac39741f0ad","Type":"ContainerDied","Data":"643fce14f4fae2e227729f82dcf7bfb61f1eef02d5d595276f6c79d3ddf6c323"} Jul 06 12:11:45.936190 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.936168 2581 generic.go:356] "Generic (PLEG): container finished" podID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerID="c5f2e920699ee6eca8180f63133ea557e5cb2812baa86d5ddab6579ca4d26940" exitCode=0 Jul 06 12:11:45.936288 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.936252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" event={"ID":"f132afbe-a3cf-4607-8ba8-68115b353f01","Type":"ContainerDied","Data":"c5f2e920699ee6eca8180f63133ea557e5cb2812baa86d5ddab6579ca4d26940"} Jul 06 12:11:45.938442 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.938419 2581 generic.go:356] "Generic (PLEG): container finished" podID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerID="91cf8f75f2754b91568a0ccdecae0182317170bef86b6ff64a3555c319894ff8" exitCode=0 Jul 06 12:11:45.938534 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:45.938462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" event={"ID":"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c","Type":"ContainerDied","Data":"91cf8f75f2754b91568a0ccdecae0182317170bef86b6ff64a3555c319894ff8"} Jul 06 12:11:46.428642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:46.428611 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8557ffd46c-d9pq2"] Jul 06 12:11:46.945653 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:46.945622 2581 generic.go:356] "Generic (PLEG): container finished" podID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerID="245844748c386fe46ba0ab8d88cb479305e8c15ce3756268a98bcaecd9454c1e" exitCode=0 Jul 06 12:11:46.946024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:46.945707 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" event={"ID":"80023010-bca5-4a48-a3c5-7ac39741f0ad","Type":"ContainerDied","Data":"245844748c386fe46ba0ab8d88cb479305e8c15ce3756268a98bcaecd9454c1e"} Jul 06 12:11:46.947658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:46.947635 2581 generic.go:356] "Generic (PLEG): container finished" podID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerID="d769adf2646511b22efff14712a77b50d6e21642e9e0a3bb32a78686217879a6" exitCode=0 Jul 06 12:11:46.947767 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:46.947722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" event={"ID":"f132afbe-a3cf-4607-8ba8-68115b353f01","Type":"ContainerDied","Data":"d769adf2646511b22efff14712a77b50d6e21642e9e0a3bb32a78686217879a6"} Jul 06 12:11:47.104517 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.104495 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:47.107385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.107370 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:47.254683 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.254616 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-bundle\") pod \"ec853eca-a12c-40ed-957e-64e98abf66f9\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " Jul 06 12:11:47.254683 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.254680 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68cfg\" (UniqueName: \"kubernetes.io/projected/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-kube-api-access-68cfg\") pod \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " Jul 06 12:11:47.254866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.254713 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pswxs\" (UniqueName: \"kubernetes.io/projected/ec853eca-a12c-40ed-957e-64e98abf66f9-kube-api-access-pswxs\") pod \"ec853eca-a12c-40ed-957e-64e98abf66f9\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " Jul 06 12:11:47.254866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.254732 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-util\") pod \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " Jul 06 12:11:47.254866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.254766 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-util\") pod \"ec853eca-a12c-40ed-957e-64e98abf66f9\" (UID: \"ec853eca-a12c-40ed-957e-64e98abf66f9\") " Jul 06 12:11:47.254866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.254790 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-bundle\") pod \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\" (UID: \"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c\") " Jul 06 12:11:47.255228 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.255202 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-bundle" (OuterVolumeSpecName: "bundle") pod "ec853eca-a12c-40ed-957e-64e98abf66f9" (UID: "ec853eca-a12c-40ed-957e-64e98abf66f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:47.255591 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.255563 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-bundle" (OuterVolumeSpecName: "bundle") pod "a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" (UID: "a1c1ad52-2317-4895-bae1-8cf9d65f7f4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:47.257074 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.257054 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-kube-api-access-68cfg" (OuterVolumeSpecName: "kube-api-access-68cfg") pod "a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" (UID: "a1c1ad52-2317-4895-bae1-8cf9d65f7f4c"). InnerVolumeSpecName "kube-api-access-68cfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:11:47.257288 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.257266 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec853eca-a12c-40ed-957e-64e98abf66f9-kube-api-access-pswxs" (OuterVolumeSpecName: "kube-api-access-pswxs") pod "ec853eca-a12c-40ed-957e-64e98abf66f9" (UID: "ec853eca-a12c-40ed-957e-64e98abf66f9"). InnerVolumeSpecName "kube-api-access-pswxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:11:47.261090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.261058 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-util" (OuterVolumeSpecName: "util") pod "a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" (UID: "a1c1ad52-2317-4895-bae1-8cf9d65f7f4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:47.261935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.261909 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-util" (OuterVolumeSpecName: "util") pod "ec853eca-a12c-40ed-957e-64e98abf66f9" (UID: "ec853eca-a12c-40ed-957e-64e98abf66f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:47.356216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.356186 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68cfg\" (UniqueName: \"kubernetes.io/projected/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-kube-api-access-68cfg\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:47.356216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.356217 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pswxs\" (UniqueName: \"kubernetes.io/projected/ec853eca-a12c-40ed-957e-64e98abf66f9-kube-api-access-pswxs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:47.356318 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.356226 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:47.356318 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.356236 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:47.356318 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.356244 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1c1ad52-2317-4895-bae1-8cf9d65f7f4c-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:47.356318 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.356251 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec853eca-a12c-40ed-957e-64e98abf66f9-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:47.954021 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.953997 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" Jul 06 12:11:47.954345 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.954032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v" event={"ID":"ec853eca-a12c-40ed-957e-64e98abf66f9","Type":"ContainerDied","Data":"cf60ac4b02f281db34ecc71b927fe4556706a736c08845df56cf047a9eaf72a4"} Jul 06 12:11:47.954345 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.954078 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf60ac4b02f281db34ecc71b927fe4556706a736c08845df56cf047a9eaf72a4" Jul 06 12:11:47.956251 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.956229 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" Jul 06 12:11:47.956347 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.956246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw" event={"ID":"a1c1ad52-2317-4895-bae1-8cf9d65f7f4c","Type":"ContainerDied","Data":"9a0742d03c6cbfaabfb1b156710d57e3c64ef2c8e43986e3c6bed110d22d7be6"} Jul 06 12:11:47.956347 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:47.956282 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a0742d03c6cbfaabfb1b156710d57e3c64ef2c8e43986e3c6bed110d22d7be6" Jul 06 12:11:48.114586 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.114566 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:48.116584 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.116566 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:48.264092 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264018 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-util\") pod \"80023010-bca5-4a48-a3c5-7ac39741f0ad\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " Jul 06 12:11:48.264092 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-bundle\") pod \"80023010-bca5-4a48-a3c5-7ac39741f0ad\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " Jul 06 12:11:48.264280 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264105 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbc4m\" (UniqueName: \"kubernetes.io/projected/80023010-bca5-4a48-a3c5-7ac39741f0ad-kube-api-access-tbc4m\") pod \"80023010-bca5-4a48-a3c5-7ac39741f0ad\" (UID: \"80023010-bca5-4a48-a3c5-7ac39741f0ad\") " Jul 06 12:11:48.264280 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264121 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-bundle\") pod \"f132afbe-a3cf-4607-8ba8-68115b353f01\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " Jul 06 12:11:48.264280 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264184 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q9qn\" (UniqueName: \"kubernetes.io/projected/f132afbe-a3cf-4607-8ba8-68115b353f01-kube-api-access-8q9qn\") pod \"f132afbe-a3cf-4607-8ba8-68115b353f01\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " Jul 06 12:11:48.264280 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264217 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-util\") pod \"f132afbe-a3cf-4607-8ba8-68115b353f01\" (UID: \"f132afbe-a3cf-4607-8ba8-68115b353f01\") " Jul 06 12:11:48.264794 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264765 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-bundle" (OuterVolumeSpecName: "bundle") pod "f132afbe-a3cf-4607-8ba8-68115b353f01" (UID: "f132afbe-a3cf-4607-8ba8-68115b353f01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:48.264957 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.264850 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-bundle" (OuterVolumeSpecName: "bundle") pod "80023010-bca5-4a48-a3c5-7ac39741f0ad" (UID: "80023010-bca5-4a48-a3c5-7ac39741f0ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:48.266424 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.266403 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f132afbe-a3cf-4607-8ba8-68115b353f01-kube-api-access-8q9qn" (OuterVolumeSpecName: "kube-api-access-8q9qn") pod "f132afbe-a3cf-4607-8ba8-68115b353f01" (UID: "f132afbe-a3cf-4607-8ba8-68115b353f01"). InnerVolumeSpecName "kube-api-access-8q9qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:11:48.266537 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.266522 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80023010-bca5-4a48-a3c5-7ac39741f0ad-kube-api-access-tbc4m" (OuterVolumeSpecName: "kube-api-access-tbc4m") pod "80023010-bca5-4a48-a3c5-7ac39741f0ad" (UID: "80023010-bca5-4a48-a3c5-7ac39741f0ad"). InnerVolumeSpecName "kube-api-access-tbc4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:11:48.270606 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.270582 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-util" (OuterVolumeSpecName: "util") pod "f132afbe-a3cf-4607-8ba8-68115b353f01" (UID: "f132afbe-a3cf-4607-8ba8-68115b353f01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:48.278928 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.278906 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-util" (OuterVolumeSpecName: "util") pod "80023010-bca5-4a48-a3c5-7ac39741f0ad" (UID: "80023010-bca5-4a48-a3c5-7ac39741f0ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:11:48.365023 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.364999 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:48.365023 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.365020 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbc4m\" (UniqueName: \"kubernetes.io/projected/80023010-bca5-4a48-a3c5-7ac39741f0ad-kube-api-access-tbc4m\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:48.365153 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.365031 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:48.365153 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.365039 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q9qn\" (UniqueName: \"kubernetes.io/projected/f132afbe-a3cf-4607-8ba8-68115b353f01-kube-api-access-8q9qn\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:48.365153 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.365048 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f132afbe-a3cf-4607-8ba8-68115b353f01-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:48.365153 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.365055 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80023010-bca5-4a48-a3c5-7ac39741f0ad-util\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:11:48.964060 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.964031 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" Jul 06 12:11:48.964060 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.964046 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7" event={"ID":"80023010-bca5-4a48-a3c5-7ac39741f0ad","Type":"ContainerDied","Data":"a6096ef557f5e0239e0c5fdd18268a76ca76265c870659bb5c0ebd63736eed85"} Jul 06 12:11:48.964521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.964096 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6096ef557f5e0239e0c5fdd18268a76ca76265c870659bb5c0ebd63736eed85" Jul 06 12:11:48.966004 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.965985 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" Jul 06 12:11:48.966144 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.965986 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv" event={"ID":"f132afbe-a3cf-4607-8ba8-68115b353f01","Type":"ContainerDied","Data":"dcb141d6413d7e2d2402e5914701784f1e922701961177184baa752c00085316"} Jul 06 12:11:48.966144 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:11:48.966092 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcb141d6413d7e2d2402e5914701784f1e922701961177184baa752c00085316" Jul 06 12:12:11.449477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.449439 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8557ffd46c-d9pq2" podUID="d42667d8-049c-4c59-999e-bb529182ad35" containerName="console" containerID="cri-o://a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717" gracePeriod=15 Jul 06 12:12:11.694418 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.694397 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:12:11.750249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750198 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-trusted-ca-bundle\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750233 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-service-ca\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750390 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750261 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-oauth-config\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750390 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750290 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-oauth-serving-cert\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750390 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750317 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-serving-cert\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750525 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750482 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-console-config\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750577 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750536 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh8nl\" (UniqueName: \"kubernetes.io/projected/d42667d8-049c-4c59-999e-bb529182ad35-kube-api-access-dh8nl\") pod \"d42667d8-049c-4c59-999e-bb529182ad35\" (UID: \"d42667d8-049c-4c59-999e-bb529182ad35\") " Jul 06 12:12:11.750687 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750572 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:12:11.750744 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750712 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-service-ca" (OuterVolumeSpecName: "service-ca") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:12:11.750795 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750772 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:12:11.750878 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750812 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-console-config" (OuterVolumeSpecName: "console-config") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:12:11.750936 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750915 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-console-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:11.750936 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750927 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-trusted-ca-bundle\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:11.751037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750937 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-service-ca\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:11.751037 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.750945 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42667d8-049c-4c59-999e-bb529182ad35-oauth-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:11.752561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.752534 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42667d8-049c-4c59-999e-bb529182ad35-kube-api-access-dh8nl" (OuterVolumeSpecName: "kube-api-access-dh8nl") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "kube-api-access-dh8nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:12:11.752643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.752610 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:12:11.752854 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.752836 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d42667d8-049c-4c59-999e-bb529182ad35" (UID: "d42667d8-049c-4c59-999e-bb529182ad35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:12:11.851430 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.851406 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh8nl\" (UniqueName: \"kubernetes.io/projected/d42667d8-049c-4c59-999e-bb529182ad35-kube-api-access-dh8nl\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:11.851430 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.851426 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-oauth-config\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:11.851567 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:11.851436 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42667d8-049c-4c59-999e-bb529182ad35-console-serving-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:12:12.083174 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.083146 2581 generic.go:356] "Generic (PLEG): container finished" podID="d42667d8-049c-4c59-999e-bb529182ad35" containerID="a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717" exitCode=0 Jul 06 12:12:12.083261 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.083194 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8557ffd46c-d9pq2" Jul 06 12:12:12.083261 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.083218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8557ffd46c-d9pq2" event={"ID":"d42667d8-049c-4c59-999e-bb529182ad35","Type":"ContainerDied","Data":"a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717"} Jul 06 12:12:12.083261 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.083252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8557ffd46c-d9pq2" event={"ID":"d42667d8-049c-4c59-999e-bb529182ad35","Type":"ContainerDied","Data":"005fa35b58250bf6eec6e58054abb74006006b669a3e5f1465468df7b8413fd1"} Jul 06 12:12:12.083372 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.083270 2581 scope.go:117] "RemoveContainer" containerID="a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717" Jul 06 12:12:12.091694 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.091680 2581 scope.go:117] "RemoveContainer" containerID="a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717" Jul 06 12:12:12.091994 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:12:12.091977 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717\": container with ID starting with a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717 not found: ID does not exist" containerID="a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717" Jul 06 12:12:12.092045 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.092000 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717"} err="failed to get container status \"a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717\": rpc error: code = NotFound desc = could not find container \"a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717\": container with ID starting with a21da5db3723edbb8ebb981735b39e4c02f01bce16dfb13f616d93c730157717 not found: ID does not exist" Jul 06 12:12:12.113556 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.113527 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8557ffd46c-d9pq2"] Jul 06 12:12:12.115659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:12.115641 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8557ffd46c-d9pq2"] Jul 06 12:12:13.879094 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:12:13.879058 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42667d8-049c-4c59-999e-bb529182ad35" path="/var/lib/kubelet/pods/d42667d8-049c-4c59-999e-bb529182ad35/volumes" Jul 06 12:13:09.780587 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780516 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r97m7"] Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780850 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780864 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780879 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780884 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780890 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780897 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780903 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780907 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780914 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780918 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780927 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780932 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780938 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780943 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780948 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780953 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780958 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780963 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="extract" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780970 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780975 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780983 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780988 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="util" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780994 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42667d8-049c-4c59-999e-bb529182ad35" containerName="console" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.780998 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42667d8-049c-4c59-999e-bb529182ad35" containerName="console" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781005 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="pull" Jul 06 12:13:09.781011 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781010 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="pull" Jul 06 12:13:09.781729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781072 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec853eca-a12c-40ed-957e-64e98abf66f9" containerName="extract" Jul 06 12:13:09.781729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781080 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="80023010-bca5-4a48-a3c5-7ac39741f0ad" containerName="extract" Jul 06 12:13:09.781729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781087 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f132afbe-a3cf-4607-8ba8-68115b353f01" containerName="extract" Jul 06 12:13:09.781729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781094 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c1ad52-2317-4895-bae1-8cf9d65f7f4c" containerName="extract" Jul 06 12:13:09.781729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.781099 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42667d8-049c-4c59-999e-bb529182ad35" containerName="console" Jul 06 12:13:09.783952 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.783932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:09.786231 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.786207 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-czjhk\"" Jul 06 12:13:09.787187 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.787169 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 12:13:09.787276 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.787228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 12:13:09.790317 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.790298 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r97m7"] Jul 06 12:13:09.876210 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.876192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwbxr\" (UniqueName: \"kubernetes.io/projected/3b26867a-43db-4ade-9d9d-288e7e7aa307-kube-api-access-cwbxr\") pod \"authorino-58cd955675-r97m7\" (UID: \"3b26867a-43db-4ade-9d9d-288e7e7aa307\") " pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:09.919533 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.919509 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ctm4v"] Jul 06 12:13:09.922753 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.922737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:09.928484 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.928464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ctm4v"] Jul 06 12:13:09.977371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.977348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbxr\" (UniqueName: \"kubernetes.io/projected/3b26867a-43db-4ade-9d9d-288e7e7aa307-kube-api-access-cwbxr\") pod \"authorino-58cd955675-r97m7\" (UID: \"3b26867a-43db-4ade-9d9d-288e7e7aa307\") " pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:09.985497 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:09.985478 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwbxr\" (UniqueName: \"kubernetes.io/projected/3b26867a-43db-4ade-9d9d-288e7e7aa307-kube-api-access-cwbxr\") pod \"authorino-58cd955675-r97m7\" (UID: \"3b26867a-43db-4ade-9d9d-288e7e7aa307\") " pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:10.078592 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.078540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpr2x\" (UniqueName: \"kubernetes.io/projected/22eccff8-7751-4650-9266-7411ffd8b4dd-kube-api-access-hpr2x\") pod \"authorino-75d556bd77-ctm4v\" (UID: \"22eccff8-7751-4650-9266-7411ffd8b4dd\") " pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:10.093676 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.093657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:10.179610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.179574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpr2x\" (UniqueName: \"kubernetes.io/projected/22eccff8-7751-4650-9266-7411ffd8b4dd-kube-api-access-hpr2x\") pod \"authorino-75d556bd77-ctm4v\" (UID: \"22eccff8-7751-4650-9266-7411ffd8b4dd\") " pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:10.189999 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.189973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpr2x\" (UniqueName: \"kubernetes.io/projected/22eccff8-7751-4650-9266-7411ffd8b4dd-kube-api-access-hpr2x\") pod \"authorino-75d556bd77-ctm4v\" (UID: \"22eccff8-7751-4650-9266-7411ffd8b4dd\") " pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:10.224504 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.224487 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r97m7"] Jul 06 12:13:10.226612 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:13:10.226592 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b26867a_43db_4ade_9d9d_288e7e7aa307.slice/crio-2b128fa9969a465f116303af6734c27212e1199c87b1c56e26a781663826b7e9 WatchSource:0}: Error finding container 2b128fa9969a465f116303af6734c27212e1199c87b1c56e26a781663826b7e9: Status 404 returned error can't find the container with id 2b128fa9969a465f116303af6734c27212e1199c87b1c56e26a781663826b7e9 Jul 06 12:13:10.232055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.232039 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:10.357004 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.356978 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ctm4v"] Jul 06 12:13:10.358702 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:13:10.358681 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22eccff8_7751_4650_9266_7411ffd8b4dd.slice/crio-e8c043dad86597443108045134e1b0bcc037de33fc6465a5e259467bd013347f WatchSource:0}: Error finding container e8c043dad86597443108045134e1b0bcc037de33fc6465a5e259467bd013347f: Status 404 returned error can't find the container with id e8c043dad86597443108045134e1b0bcc037de33fc6465a5e259467bd013347f Jul 06 12:13:10.363472 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:10.363449 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r97m7" event={"ID":"3b26867a-43db-4ade-9d9d-288e7e7aa307","Type":"ContainerStarted","Data":"2b128fa9969a465f116303af6734c27212e1199c87b1c56e26a781663826b7e9"} Jul 06 12:13:11.378759 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:11.378678 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ctm4v" event={"ID":"22eccff8-7751-4650-9266-7411ffd8b4dd","Type":"ContainerStarted","Data":"e8c043dad86597443108045134e1b0bcc037de33fc6465a5e259467bd013347f"} Jul 06 12:13:14.397582 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:14.397546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r97m7" event={"ID":"3b26867a-43db-4ade-9d9d-288e7e7aa307","Type":"ContainerStarted","Data":"e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f"} Jul 06 12:13:14.398968 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:14.398939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ctm4v" event={"ID":"22eccff8-7751-4650-9266-7411ffd8b4dd","Type":"ContainerStarted","Data":"0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665"} Jul 06 12:13:14.419429 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:14.419389 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r97m7" podStartSLOduration=2.00591806 podStartE2EDuration="5.41937449s" totalImagesPullingTime="3.41345643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:14.416573222 +0000 UTC m=+539.137562061" watchObservedRunningTime="2026-07-06 12:13:14.41937449 +0000 UTC m=+539.140363355" Jul 06 12:13:14.433662 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:14.433620 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ctm4v" podStartSLOduration=2.141783179 podStartE2EDuration="5.433609683s" totalImagesPullingTime="3.291826504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:14.433130542 +0000 UTC m=+539.154119381" watchObservedRunningTime="2026-07-06 12:13:14.433609683 +0000 UTC m=+539.154598544" Jul 06 12:13:14.465583 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:14.465554 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r97m7"] Jul 06 12:13:16.407939 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:16.407900 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r97m7" podUID="3b26867a-43db-4ade-9d9d-288e7e7aa307" containerName="authorino" containerID="cri-o://e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f" gracePeriod=30 Jul 06 12:13:16.645171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:16.645151 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:16.739661 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:16.739592 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwbxr\" (UniqueName: \"kubernetes.io/projected/3b26867a-43db-4ade-9d9d-288e7e7aa307-kube-api-access-cwbxr\") pod \"3b26867a-43db-4ade-9d9d-288e7e7aa307\" (UID: \"3b26867a-43db-4ade-9d9d-288e7e7aa307\") " Jul 06 12:13:16.741356 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:16.741324 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b26867a-43db-4ade-9d9d-288e7e7aa307-kube-api-access-cwbxr" (OuterVolumeSpecName: "kube-api-access-cwbxr") pod "3b26867a-43db-4ade-9d9d-288e7e7aa307" (UID: "3b26867a-43db-4ade-9d9d-288e7e7aa307"). InnerVolumeSpecName "kube-api-access-cwbxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:13:16.840643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:16.840622 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwbxr\" (UniqueName: \"kubernetes.io/projected/3b26867a-43db-4ade-9d9d-288e7e7aa307-kube-api-access-cwbxr\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:13:17.413531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.413501 2581 generic.go:356] "Generic (PLEG): container finished" podID="3b26867a-43db-4ade-9d9d-288e7e7aa307" containerID="e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f" exitCode=0 Jul 06 12:13:17.413845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.413538 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r97m7" Jul 06 12:13:17.413845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.413574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r97m7" event={"ID":"3b26867a-43db-4ade-9d9d-288e7e7aa307","Type":"ContainerDied","Data":"e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f"} Jul 06 12:13:17.413845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.413606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r97m7" event={"ID":"3b26867a-43db-4ade-9d9d-288e7e7aa307","Type":"ContainerDied","Data":"2b128fa9969a465f116303af6734c27212e1199c87b1c56e26a781663826b7e9"} Jul 06 12:13:17.413845 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.413624 2581 scope.go:117] "RemoveContainer" containerID="e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f" Jul 06 12:13:17.422132 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.422105 2581 scope.go:117] "RemoveContainer" containerID="e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f" Jul 06 12:13:17.422348 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:13:17.422329 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f\": container with ID starting with e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f not found: ID does not exist" containerID="e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f" Jul 06 12:13:17.422394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.422356 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f"} err="failed to get container status \"e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f\": rpc error: code = NotFound desc = could not find container \"e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f\": container with ID starting with e48e87443d64860e5f4902efdcb8a54c0faeea37fb5e1db31ba2e54d50d7f35f not found: ID does not exist" Jul 06 12:13:17.434681 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.434653 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r97m7"] Jul 06 12:13:17.438964 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.438944 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r97m7"] Jul 06 12:13:17.877818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:17.877782 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b26867a-43db-4ade-9d9d-288e7e7aa307" path="/var/lib/kubelet/pods/3b26867a-43db-4ade-9d9d-288e7e7aa307/volumes" Jul 06 12:13:37.310734 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.310696 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vct5"] Jul 06 12:13:37.311261 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.311245 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b26867a-43db-4ade-9d9d-288e7e7aa307" containerName="authorino" Jul 06 12:13:37.311321 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.311264 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b26867a-43db-4ade-9d9d-288e7e7aa307" containerName="authorino" Jul 06 12:13:37.311356 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.311340 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b26867a-43db-4ade-9d9d-288e7e7aa307" containerName="authorino" Jul 06 12:13:37.316713 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.316691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:37.321232 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.321212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vct5"] Jul 06 12:13:37.388910 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.388882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6r5m\" (UniqueName: \"kubernetes.io/projected/013682a8-d19c-4f88-b25c-6fb96125843c-kube-api-access-j6r5m\") pod \"authorino-5d4b67c446-2vct5\" (UID: \"013682a8-d19c-4f88-b25c-6fb96125843c\") " pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:37.490185 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.490158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6r5m\" (UniqueName: \"kubernetes.io/projected/013682a8-d19c-4f88-b25c-6fb96125843c-kube-api-access-j6r5m\") pod \"authorino-5d4b67c446-2vct5\" (UID: \"013682a8-d19c-4f88-b25c-6fb96125843c\") " pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:37.499146 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.499126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6r5m\" (UniqueName: \"kubernetes.io/projected/013682a8-d19c-4f88-b25c-6fb96125843c-kube-api-access-j6r5m\") pod \"authorino-5d4b67c446-2vct5\" (UID: \"013682a8-d19c-4f88-b25c-6fb96125843c\") " pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:37.551337 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.551311 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vct5"] Jul 06 12:13:37.551551 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.551540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:37.582121 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.582090 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8695c48659-8pgnh"] Jul 06 12:13:37.586228 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.586207 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:37.596871 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.596845 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8695c48659-8pgnh"] Jul 06 12:13:37.688372 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.688341 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vct5"] Jul 06 12:13:37.689871 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:13:37.689846 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod013682a8_d19c_4f88_b25c_6fb96125843c.slice/crio-97e6352575792c2f15dc6937c00bd6868350970269553590efb1c63cd07e99c9 WatchSource:0}: Error finding container 97e6352575792c2f15dc6937c00bd6868350970269553590efb1c63cd07e99c9: Status 404 returned error can't find the container with id 97e6352575792c2f15dc6937c00bd6868350970269553590efb1c63cd07e99c9 Jul 06 12:13:37.691109 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.691087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp5jw\" (UniqueName: \"kubernetes.io/projected/99d675a3-fdea-446c-857c-6be94aef929f-kube-api-access-bp5jw\") pod \"authorino-8695c48659-8pgnh\" (UID: \"99d675a3-fdea-446c-857c-6be94aef929f\") " pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:37.792156 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.792123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp5jw\" (UniqueName: \"kubernetes.io/projected/99d675a3-fdea-446c-857c-6be94aef929f-kube-api-access-bp5jw\") pod \"authorino-8695c48659-8pgnh\" (UID: \"99d675a3-fdea-446c-857c-6be94aef929f\") " pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:37.801428 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.801406 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp5jw\" (UniqueName: \"kubernetes.io/projected/99d675a3-fdea-446c-857c-6be94aef929f-kube-api-access-bp5jw\") pod \"authorino-8695c48659-8pgnh\" (UID: \"99d675a3-fdea-446c-857c-6be94aef929f\") " pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:37.850137 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.850067 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8695c48659-8pgnh"] Jul 06 12:13:37.850316 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.850305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:37.886171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.883581 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d7dc68659-vb646"] Jul 06 12:13:37.889209 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.889176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:37.893001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.892973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 12:13:37.896314 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.896289 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d7dc68659-vb646"] Jul 06 12:13:37.987111 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.987082 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8695c48659-8pgnh"] Jul 06 12:13:37.988692 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:13:37.988662 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99d675a3_fdea_446c_857c_6be94aef929f.slice/crio-2bed0b9a622beec9e0f4b920ba6f2c47220486ee09a4db51fdf74c2c4b09d1c0 WatchSource:0}: Error finding container 2bed0b9a622beec9e0f4b920ba6f2c47220486ee09a4db51fdf74c2c4b09d1c0: Status 404 returned error can't find the container with id 2bed0b9a622beec9e0f4b920ba6f2c47220486ee09a4db51fdf74c2c4b09d1c0 Jul 06 12:13:37.993790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.993772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a51b152-60a2-4dc4-8854-c1d73b0de01c-tls-cert\") pod \"authorino-d7dc68659-vb646\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:37.993876 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:37.993850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjh8q\" (UniqueName: \"kubernetes.io/projected/1a51b152-60a2-4dc4-8854-c1d73b0de01c-kube-api-access-xjh8q\") pod \"authorino-d7dc68659-vb646\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:38.094996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.094971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a51b152-60a2-4dc4-8854-c1d73b0de01c-tls-cert\") pod \"authorino-d7dc68659-vb646\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:38.095109 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.095032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjh8q\" (UniqueName: \"kubernetes.io/projected/1a51b152-60a2-4dc4-8854-c1d73b0de01c-kube-api-access-xjh8q\") pod \"authorino-d7dc68659-vb646\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:38.097325 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.097297 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a51b152-60a2-4dc4-8854-c1d73b0de01c-tls-cert\") pod \"authorino-d7dc68659-vb646\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:38.103659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.103611 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjh8q\" (UniqueName: \"kubernetes.io/projected/1a51b152-60a2-4dc4-8854-c1d73b0de01c-kube-api-access-xjh8q\") pod \"authorino-d7dc68659-vb646\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:38.202582 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.202546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:13:38.335491 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.335467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d7dc68659-vb646"] Jul 06 12:13:38.337063 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:13:38.337036 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a51b152_60a2_4dc4_8854_c1d73b0de01c.slice/crio-f3249e010945c78bb72046d8751b4978dbf27d725ececf9d1277e726b9cde291 WatchSource:0}: Error finding container f3249e010945c78bb72046d8751b4978dbf27d725ececf9d1277e726b9cde291: Status 404 returned error can't find the container with id f3249e010945c78bb72046d8751b4978dbf27d725ececf9d1277e726b9cde291 Jul 06 12:13:38.521650 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.521613 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vct5" event={"ID":"013682a8-d19c-4f88-b25c-6fb96125843c","Type":"ContainerStarted","Data":"4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934"} Jul 06 12:13:38.521819 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.521660 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vct5" event={"ID":"013682a8-d19c-4f88-b25c-6fb96125843c","Type":"ContainerStarted","Data":"97e6352575792c2f15dc6937c00bd6868350970269553590efb1c63cd07e99c9"} Jul 06 12:13:38.521819 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.521664 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2vct5" podUID="013682a8-d19c-4f88-b25c-6fb96125843c" containerName="authorino" containerID="cri-o://4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934" gracePeriod=30 Jul 06 12:13:38.522940 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.522919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7dc68659-vb646" event={"ID":"1a51b152-60a2-4dc4-8854-c1d73b0de01c","Type":"ContainerStarted","Data":"f3249e010945c78bb72046d8751b4978dbf27d725ececf9d1277e726b9cde291"} Jul 06 12:13:38.524450 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.524423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8695c48659-8pgnh" event={"ID":"99d675a3-fdea-446c-857c-6be94aef929f","Type":"ContainerStarted","Data":"b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89"} Jul 06 12:13:38.524561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.524463 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8695c48659-8pgnh" event={"ID":"99d675a3-fdea-446c-857c-6be94aef929f","Type":"ContainerStarted","Data":"2bed0b9a622beec9e0f4b920ba6f2c47220486ee09a4db51fdf74c2c4b09d1c0"} Jul 06 12:13:38.524561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.524530 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8695c48659-8pgnh" podUID="99d675a3-fdea-446c-857c-6be94aef929f" containerName="authorino" containerID="cri-o://b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89" gracePeriod=30 Jul 06 12:13:38.547437 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.547396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2vct5" podStartSLOduration=1.1327292469999999 podStartE2EDuration="1.547379771s" totalImagesPullingTime="414.650524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:38.546258816 +0000 UTC m=+563.267247657" watchObservedRunningTime="2026-07-06 12:13:38.547379771 +0000 UTC m=+563.268368610" Jul 06 12:13:38.568598 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.568562 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8695c48659-8pgnh" podStartSLOduration=1.19750925 podStartE2EDuration="1.568547783s" totalImagesPullingTime="371.038533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:38.567858886 +0000 UTC m=+563.288847729" watchObservedRunningTime="2026-07-06 12:13:38.568547783 +0000 UTC m=+563.289536964" Jul 06 12:13:38.788378 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.788357 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:38.791065 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.791049 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:38.902295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.902266 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6r5m\" (UniqueName: \"kubernetes.io/projected/013682a8-d19c-4f88-b25c-6fb96125843c-kube-api-access-j6r5m\") pod \"013682a8-d19c-4f88-b25c-6fb96125843c\" (UID: \"013682a8-d19c-4f88-b25c-6fb96125843c\") " Jul 06 12:13:38.902426 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.902312 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp5jw\" (UniqueName: \"kubernetes.io/projected/99d675a3-fdea-446c-857c-6be94aef929f-kube-api-access-bp5jw\") pod \"99d675a3-fdea-446c-857c-6be94aef929f\" (UID: \"99d675a3-fdea-446c-857c-6be94aef929f\") " Jul 06 12:13:38.904145 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.904118 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013682a8-d19c-4f88-b25c-6fb96125843c-kube-api-access-j6r5m" (OuterVolumeSpecName: "kube-api-access-j6r5m") pod "013682a8-d19c-4f88-b25c-6fb96125843c" (UID: "013682a8-d19c-4f88-b25c-6fb96125843c"). InnerVolumeSpecName "kube-api-access-j6r5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:13:38.904248 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:38.904227 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99d675a3-fdea-446c-857c-6be94aef929f-kube-api-access-bp5jw" (OuterVolumeSpecName: "kube-api-access-bp5jw") pod "99d675a3-fdea-446c-857c-6be94aef929f" (UID: "99d675a3-fdea-446c-857c-6be94aef929f"). InnerVolumeSpecName "kube-api-access-bp5jw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:13:39.003846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.003788 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6r5m\" (UniqueName: \"kubernetes.io/projected/013682a8-d19c-4f88-b25c-6fb96125843c-kube-api-access-j6r5m\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:13:39.003846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.003839 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp5jw\" (UniqueName: \"kubernetes.io/projected/99d675a3-fdea-446c-857c-6be94aef929f-kube-api-access-bp5jw\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:13:39.532411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.532379 2581 generic.go:356] "Generic (PLEG): container finished" podID="013682a8-d19c-4f88-b25c-6fb96125843c" containerID="4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934" exitCode=0 Jul 06 12:13:39.532864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.532428 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2vct5" Jul 06 12:13:39.532864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.532461 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vct5" event={"ID":"013682a8-d19c-4f88-b25c-6fb96125843c","Type":"ContainerDied","Data":"4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934"} Jul 06 12:13:39.532864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.532508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2vct5" event={"ID":"013682a8-d19c-4f88-b25c-6fb96125843c","Type":"ContainerDied","Data":"97e6352575792c2f15dc6937c00bd6868350970269553590efb1c63cd07e99c9"} Jul 06 12:13:39.532864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.532533 2581 scope.go:117] "RemoveContainer" containerID="4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934" Jul 06 12:13:39.534046 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.534023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7dc68659-vb646" event={"ID":"1a51b152-60a2-4dc4-8854-c1d73b0de01c","Type":"ContainerStarted","Data":"1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287"} Jul 06 12:13:39.535382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.535364 2581 generic.go:356] "Generic (PLEG): container finished" podID="99d675a3-fdea-446c-857c-6be94aef929f" containerID="b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89" exitCode=0 Jul 06 12:13:39.535464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.535390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8695c48659-8pgnh" event={"ID":"99d675a3-fdea-446c-857c-6be94aef929f","Type":"ContainerDied","Data":"b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89"} Jul 06 12:13:39.535464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.535410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8695c48659-8pgnh" event={"ID":"99d675a3-fdea-446c-857c-6be94aef929f","Type":"ContainerDied","Data":"2bed0b9a622beec9e0f4b920ba6f2c47220486ee09a4db51fdf74c2c4b09d1c0"} Jul 06 12:13:39.535464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.535411 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8695c48659-8pgnh" Jul 06 12:13:39.542367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.542355 2581 scope.go:117] "RemoveContainer" containerID="4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934" Jul 06 12:13:39.542656 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:13:39.542639 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934\": container with ID starting with 4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934 not found: ID does not exist" containerID="4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934" Jul 06 12:13:39.542699 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.542663 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934"} err="failed to get container status \"4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934\": rpc error: code = NotFound desc = could not find container \"4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934\": container with ID starting with 4a060033c061f8b94b12735e4b08481e43a55f0219873f715b3a651792e8c934 not found: ID does not exist" Jul 06 12:13:39.542699 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.542680 2581 scope.go:117] "RemoveContainer" containerID="b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89" Jul 06 12:13:39.550610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.550596 2581 scope.go:117] "RemoveContainer" containerID="b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89" Jul 06 12:13:39.550865 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:13:39.550845 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89\": container with ID starting with b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89 not found: ID does not exist" containerID="b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89" Jul 06 12:13:39.550932 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.550870 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89"} err="failed to get container status \"b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89\": rpc error: code = NotFound desc = could not find container \"b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89\": container with ID starting with b24ab7445b0329875ca3ec9310b9c2a7c13769f77e49fefb6ec2f8783b1d0d89 not found: ID does not exist" Jul 06 12:13:39.560939 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.560901 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d7dc68659-vb646" podStartSLOduration=2.066441359 podStartE2EDuration="2.560889232s" totalImagesPullingTime="494.447873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:39.559620495 +0000 UTC m=+564.280609337" watchObservedRunningTime="2026-07-06 12:13:39.560889232 +0000 UTC m=+564.281878089" Jul 06 12:13:39.575054 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.575033 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vct5"] Jul 06 12:13:39.579995 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.579973 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2vct5"] Jul 06 12:13:39.590921 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.590897 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8695c48659-8pgnh"] Jul 06 12:13:39.593582 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.593558 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ctm4v"] Jul 06 12:13:39.593762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.593738 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ctm4v" podUID="22eccff8-7751-4650-9266-7411ffd8b4dd" containerName="authorino" containerID="cri-o://0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665" gracePeriod=30 Jul 06 12:13:39.595648 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.595623 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8695c48659-8pgnh"] Jul 06 12:13:39.832067 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.832047 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:39.877749 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.877716 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="013682a8-d19c-4f88-b25c-6fb96125843c" path="/var/lib/kubelet/pods/013682a8-d19c-4f88-b25c-6fb96125843c/volumes" Jul 06 12:13:39.878066 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.878052 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99d675a3-fdea-446c-857c-6be94aef929f" path="/var/lib/kubelet/pods/99d675a3-fdea-446c-857c-6be94aef929f/volumes" Jul 06 12:13:39.910981 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.910955 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpr2x\" (UniqueName: \"kubernetes.io/projected/22eccff8-7751-4650-9266-7411ffd8b4dd-kube-api-access-hpr2x\") pod \"22eccff8-7751-4650-9266-7411ffd8b4dd\" (UID: \"22eccff8-7751-4650-9266-7411ffd8b4dd\") " Jul 06 12:13:39.912946 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:39.912921 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22eccff8-7751-4650-9266-7411ffd8b4dd-kube-api-access-hpr2x" (OuterVolumeSpecName: "kube-api-access-hpr2x") pod "22eccff8-7751-4650-9266-7411ffd8b4dd" (UID: "22eccff8-7751-4650-9266-7411ffd8b4dd"). InnerVolumeSpecName "kube-api-access-hpr2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:13:40.011697 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.011662 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpr2x\" (UniqueName: \"kubernetes.io/projected/22eccff8-7751-4650-9266-7411ffd8b4dd-kube-api-access-hpr2x\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:13:40.543260 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.543228 2581 generic.go:356] "Generic (PLEG): container finished" podID="22eccff8-7751-4650-9266-7411ffd8b4dd" containerID="0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665" exitCode=0 Jul 06 12:13:40.543725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.543258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ctm4v" event={"ID":"22eccff8-7751-4650-9266-7411ffd8b4dd","Type":"ContainerDied","Data":"0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665"} Jul 06 12:13:40.543725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.543278 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ctm4v" Jul 06 12:13:40.543725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.543303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ctm4v" event={"ID":"22eccff8-7751-4650-9266-7411ffd8b4dd","Type":"ContainerDied","Data":"e8c043dad86597443108045134e1b0bcc037de33fc6465a5e259467bd013347f"} Jul 06 12:13:40.543725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.543319 2581 scope.go:117] "RemoveContainer" containerID="0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665" Jul 06 12:13:40.560157 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.560136 2581 scope.go:117] "RemoveContainer" containerID="0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665" Jul 06 12:13:40.560553 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:13:40.560529 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665\": container with ID starting with 0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665 not found: ID does not exist" containerID="0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665" Jul 06 12:13:40.560643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.560555 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665"} err="failed to get container status \"0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665\": rpc error: code = NotFound desc = could not find container \"0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665\": container with ID starting with 0287e516f4ce525cbc8b1b75323d55a5eee685dbd1ddf81043841e7965134665 not found: ID does not exist" Jul 06 12:13:40.589270 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.589242 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ctm4v"] Jul 06 12:13:40.597500 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:40.597475 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ctm4v"] Jul 06 12:13:41.877973 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:13:41.877941 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22eccff8-7751-4650-9266-7411ffd8b4dd" path="/var/lib/kubelet/pods/22eccff8-7751-4650-9266-7411ffd8b4dd/volumes" Jul 06 12:14:47.594847 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.594753 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w"] Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595125 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="013682a8-d19c-4f88-b25c-6fb96125843c" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595138 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="013682a8-d19c-4f88-b25c-6fb96125843c" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595148 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d675a3-fdea-446c-857c-6be94aef929f" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595153 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d675a3-fdea-446c-857c-6be94aef929f" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595175 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22eccff8-7751-4650-9266-7411ffd8b4dd" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595180 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="22eccff8-7751-4650-9266-7411ffd8b4dd" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595227 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="22eccff8-7751-4650-9266-7411ffd8b4dd" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595238 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="013682a8-d19c-4f88-b25c-6fb96125843c" containerName="authorino" Jul 06 12:14:47.597253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.595244 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d675a3-fdea-446c-857c-6be94aef929f" containerName="authorino" Jul 06 12:14:47.598188 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.598172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.603055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.603030 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 12:14:47.604654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.604632 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d6kxf\"" Jul 06 12:14:47.604753 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.604665 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 12:14:47.607488 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.607471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 12:14:47.621382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.621361 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w"] Jul 06 12:14:47.663226 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.663205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c6aadfd-2233-45fe-a5bd-58aad59e3800-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.663322 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.663244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgcb\" (UniqueName: \"kubernetes.io/projected/5c6aadfd-2233-45fe-a5bd-58aad59e3800-kube-api-access-6rgcb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.663322 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.663270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.663413 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.663323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.663413 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.663343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.663413 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.663379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.763976 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.763952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c6aadfd-2233-45fe-a5bd-58aad59e3800-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.763984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgcb\" (UniqueName: \"kubernetes.io/projected/5c6aadfd-2233-45fe-a5bd-58aad59e3800-kube-api-access-6rgcb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764285 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764535 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764505 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764518 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.764640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.764543 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.766355 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.766336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c6aadfd-2233-45fe-a5bd-58aad59e3800-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.766513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.766498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c6aadfd-2233-45fe-a5bd-58aad59e3800-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.772889 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.772867 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgcb\" (UniqueName: \"kubernetes.io/projected/5c6aadfd-2233-45fe-a5bd-58aad59e3800-kube-api-access-6rgcb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w\" (UID: \"5c6aadfd-2233-45fe-a5bd-58aad59e3800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:47.907925 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:47.907860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:48.056352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:48.056327 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w"] Jul 06 12:14:48.058594 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:14:48.058566 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6aadfd_2233_45fe_a5bd_58aad59e3800.slice/crio-7a55611a66302d1160971ecee4cce80cf3adb654b3f5c837c1e52c2842a2abbe WatchSource:0}: Error finding container 7a55611a66302d1160971ecee4cce80cf3adb654b3f5c837c1e52c2842a2abbe: Status 404 returned error can't find the container with id 7a55611a66302d1160971ecee4cce80cf3adb654b3f5c837c1e52c2842a2abbe Jul 06 12:14:48.059965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:48.059944 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:14:48.905763 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:48.905729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" event={"ID":"5c6aadfd-2233-45fe-a5bd-58aad59e3800","Type":"ContainerStarted","Data":"7a55611a66302d1160971ecee4cce80cf3adb654b3f5c837c1e52c2842a2abbe"} Jul 06 12:14:49.912093 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:49.912061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" event={"ID":"5c6aadfd-2233-45fe-a5bd-58aad59e3800","Type":"ContainerStarted","Data":"12db9c7b25fb673d9e2b10586b6db6635c3e8134a5c9e034303336d820ccd732"} Jul 06 12:14:49.934525 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:49.934480 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" podStartSLOduration=1.748815982 podStartE2EDuration="2.934466732s" totalImagesPullingTime="1.18565075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:14:49.932974617 +0000 UTC m=+634.653963459" watchObservedRunningTime="2026-07-06 12:14:49.934466732 +0000 UTC m=+634.655455572" Jul 06 12:14:57.908773 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:57.908740 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:57.909214 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:57.908786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:57.920940 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:57.920917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:14:57.963898 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:14:57.963872 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w" Jul 06 12:15:00.149652 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.149617 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722335-f9q7w"] Jul 06 12:15:00.153422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.153396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:00.155988 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.155971 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lfnhn\"" Jul 06 12:15:00.160152 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.160130 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722335-f9q7w"] Jul 06 12:15:00.254818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.254763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmm7t\" (UniqueName: \"kubernetes.io/projected/ef9318ae-6170-4673-9ef1-145a408cda5f-kube-api-access-fmm7t\") pod \"maas-api-key-cleanup-29722335-f9q7w\" (UID: \"ef9318ae-6170-4673-9ef1-145a408cda5f\") " pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:00.356078 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.356048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmm7t\" (UniqueName: \"kubernetes.io/projected/ef9318ae-6170-4673-9ef1-145a408cda5f-kube-api-access-fmm7t\") pod \"maas-api-key-cleanup-29722335-f9q7w\" (UID: \"ef9318ae-6170-4673-9ef1-145a408cda5f\") " pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:00.365420 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.365386 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmm7t\" (UniqueName: \"kubernetes.io/projected/ef9318ae-6170-4673-9ef1-145a408cda5f-kube-api-access-fmm7t\") pod \"maas-api-key-cleanup-29722335-f9q7w\" (UID: \"ef9318ae-6170-4673-9ef1-145a408cda5f\") " pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:00.467603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.467546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:00.600448 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.600278 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722335-f9q7w"] Jul 06 12:15:00.603102 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:15:00.603077 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9318ae_6170_4673_9ef1_145a408cda5f.slice/crio-9d1a24b8dd958635e14381a23f193db3c1bcf59ba1cd73926c9e452c29534151 WatchSource:0}: Error finding container 9d1a24b8dd958635e14381a23f193db3c1bcf59ba1cd73926c9e452c29534151: Status 404 returned error can't find the container with id 9d1a24b8dd958635e14381a23f193db3c1bcf59ba1cd73926c9e452c29534151 Jul 06 12:15:00.968901 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:00.968870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" event={"ID":"ef9318ae-6170-4673-9ef1-145a408cda5f","Type":"ContainerStarted","Data":"9d1a24b8dd958635e14381a23f193db3c1bcf59ba1cd73926c9e452c29534151"} Jul 06 12:15:03.986161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:03.986131 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef9318ae-6170-4673-9ef1-145a408cda5f" containerID="dfbbcca5bb02fae462fb5d9933040ac711ab4ce728d6134c1a319ffb9fddc6d4" exitCode=0 Jul 06 12:15:03.986541 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:03.986189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" event={"ID":"ef9318ae-6170-4673-9ef1-145a408cda5f","Type":"ContainerDied","Data":"dfbbcca5bb02fae462fb5d9933040ac711ab4ce728d6134c1a319ffb9fddc6d4"} Jul 06 12:15:05.120681 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.120659 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:05.200246 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.200220 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmm7t\" (UniqueName: \"kubernetes.io/projected/ef9318ae-6170-4673-9ef1-145a408cda5f-kube-api-access-fmm7t\") pod \"ef9318ae-6170-4673-9ef1-145a408cda5f\" (UID: \"ef9318ae-6170-4673-9ef1-145a408cda5f\") " Jul 06 12:15:05.202339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.202309 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef9318ae-6170-4673-9ef1-145a408cda5f-kube-api-access-fmm7t" (OuterVolumeSpecName: "kube-api-access-fmm7t") pod "ef9318ae-6170-4673-9ef1-145a408cda5f" (UID: "ef9318ae-6170-4673-9ef1-145a408cda5f"). InnerVolumeSpecName "kube-api-access-fmm7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:15:05.301416 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.301395 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmm7t\" (UniqueName: \"kubernetes.io/projected/ef9318ae-6170-4673-9ef1-145a408cda5f-kube-api-access-fmm7t\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:15:05.997492 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.997469 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" Jul 06 12:15:05.997638 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.997500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722335-f9q7w" event={"ID":"ef9318ae-6170-4673-9ef1-145a408cda5f","Type":"ContainerDied","Data":"9d1a24b8dd958635e14381a23f193db3c1bcf59ba1cd73926c9e452c29534151"} Jul 06 12:15:05.997638 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:05.997540 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d1a24b8dd958635e14381a23f193db3c1bcf59ba1cd73926c9e452c29534151" Jul 06 12:15:21.017391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.017351 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq"] Jul 06 12:15:21.017926 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.017906 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9318ae-6170-4673-9ef1-145a408cda5f" containerName="cleanup" Jul 06 12:15:21.017979 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.017930 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9318ae-6170-4673-9ef1-145a408cda5f" containerName="cleanup" Jul 06 12:15:21.018070 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.018058 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef9318ae-6170-4673-9ef1-145a408cda5f" containerName="cleanup" Jul 06 12:15:21.021287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.021270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.024032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.024010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 12:15:21.043038 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.043011 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq"] Jul 06 12:15:21.122426 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.122389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhr4z\" (UniqueName: \"kubernetes.io/projected/769dd4dd-8770-444e-b325-c95d00d2dd33-kube-api-access-vhr4z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.122426 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.122429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.122654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.122458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.122654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.122499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.122654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.122547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769dd4dd-8770-444e-b325-c95d00d2dd33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.122654 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.122564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.223739 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.223704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769dd4dd-8770-444e-b325-c95d00d2dd33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.223739 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.223739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224019 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.223779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhr4z\" (UniqueName: \"kubernetes.io/projected/769dd4dd-8770-444e-b325-c95d00d2dd33-kube-api-access-vhr4z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224019 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.223828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224019 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.223868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224019 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.223902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224235 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.224209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224235 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.224224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.224307 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.224281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.226163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.226139 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769dd4dd-8770-444e-b325-c95d00d2dd33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.226331 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.226314 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769dd4dd-8770-444e-b325-c95d00d2dd33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.232898 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.232872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhr4z\" (UniqueName: \"kubernetes.io/projected/769dd4dd-8770-444e-b325-c95d00d2dd33-kube-api-access-vhr4z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq\" (UID: \"769dd4dd-8770-444e-b325-c95d00d2dd33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.332382 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.332283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:21.475732 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:21.475703 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq"] Jul 06 12:15:21.477908 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:15:21.477870 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769dd4dd_8770_444e_b325_c95d00d2dd33.slice/crio-401ba52b4c8c32c6b0bbb197ffcb79d03cddc961036e5c13a54999a49426d943 WatchSource:0}: Error finding container 401ba52b4c8c32c6b0bbb197ffcb79d03cddc961036e5c13a54999a49426d943: Status 404 returned error can't find the container with id 401ba52b4c8c32c6b0bbb197ffcb79d03cddc961036e5c13a54999a49426d943 Jul 06 12:15:22.080587 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:22.080552 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" event={"ID":"769dd4dd-8770-444e-b325-c95d00d2dd33","Type":"ContainerStarted","Data":"f635ba7fae32db561952918f2e6da72d622297c121529932a5d3d49fff50f861"} Jul 06 12:15:22.081040 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:22.080609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" event={"ID":"769dd4dd-8770-444e-b325-c95d00d2dd33","Type":"ContainerStarted","Data":"401ba52b4c8c32c6b0bbb197ffcb79d03cddc961036e5c13a54999a49426d943"} Jul 06 12:15:22.103849 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:22.103785 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" podStartSLOduration=1.845760641 podStartE2EDuration="2.103769859s" totalImagesPullingTime="258.009218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:15:22.101830425 +0000 UTC m=+666.822819262" watchObservedRunningTime="2026-07-06 12:15:22.103769859 +0000 UTC m=+666.824758699" Jul 06 12:15:31.332750 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:31.332715 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:31.333349 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:31.332915 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:31.345052 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:31.345028 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:15:32.147233 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:15:32.147204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq" Jul 06 12:16:33.881866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:33.881779 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-98d94454b-gzzkr"] Jul 06 12:16:33.885323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:33.885306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:33.897385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:33.897358 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-98d94454b-gzzkr"] Jul 06 12:16:33.991879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:33.991780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c751487e-7ae0-4636-86bf-09f539af0f2b-tls-cert\") pod \"authorino-98d94454b-gzzkr\" (UID: \"c751487e-7ae0-4636-86bf-09f539af0f2b\") " pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:33.991879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:33.991892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4hpk\" (UniqueName: \"kubernetes.io/projected/c751487e-7ae0-4636-86bf-09f539af0f2b-kube-api-access-z4hpk\") pod \"authorino-98d94454b-gzzkr\" (UID: \"c751487e-7ae0-4636-86bf-09f539af0f2b\") " pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:34.093407 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.093366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c751487e-7ae0-4636-86bf-09f539af0f2b-tls-cert\") pod \"authorino-98d94454b-gzzkr\" (UID: \"c751487e-7ae0-4636-86bf-09f539af0f2b\") " pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:34.093407 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.093412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4hpk\" (UniqueName: \"kubernetes.io/projected/c751487e-7ae0-4636-86bf-09f539af0f2b-kube-api-access-z4hpk\") pod \"authorino-98d94454b-gzzkr\" (UID: \"c751487e-7ae0-4636-86bf-09f539af0f2b\") " pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:34.095880 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.095856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c751487e-7ae0-4636-86bf-09f539af0f2b-tls-cert\") pod \"authorino-98d94454b-gzzkr\" (UID: \"c751487e-7ae0-4636-86bf-09f539af0f2b\") " pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:34.105295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.105271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4hpk\" (UniqueName: \"kubernetes.io/projected/c751487e-7ae0-4636-86bf-09f539af0f2b-kube-api-access-z4hpk\") pod \"authorino-98d94454b-gzzkr\" (UID: \"c751487e-7ae0-4636-86bf-09f539af0f2b\") " pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:34.194586 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.194480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98d94454b-gzzkr" Jul 06 12:16:34.335831 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.335793 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-98d94454b-gzzkr"] Jul 06 12:16:34.338375 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:16:34.338348 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc751487e_7ae0_4636_86bf_09f539af0f2b.slice/crio-ae4fe8468fe364c8c289268f4eedf366cbf2f0ed51bed9463ff9e743e39d76c9 WatchSource:0}: Error finding container ae4fe8468fe364c8c289268f4eedf366cbf2f0ed51bed9463ff9e743e39d76c9: Status 404 returned error can't find the container with id ae4fe8468fe364c8c289268f4eedf366cbf2f0ed51bed9463ff9e743e39d76c9 Jul 06 12:16:34.470978 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:34.470896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98d94454b-gzzkr" event={"ID":"c751487e-7ae0-4636-86bf-09f539af0f2b","Type":"ContainerStarted","Data":"ae4fe8468fe364c8c289268f4eedf366cbf2f0ed51bed9463ff9e743e39d76c9"} Jul 06 12:16:35.483789 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:35.483742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98d94454b-gzzkr" event={"ID":"c751487e-7ae0-4636-86bf-09f539af0f2b","Type":"ContainerStarted","Data":"840a65dc97c4df8c83f499de6ed0a948ac8d6b1a42388087b5abe0c9f6ed7821"} Jul 06 12:16:35.741033 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:35.740926 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-98d94454b-gzzkr" podStartSLOduration=2.314766456 podStartE2EDuration="2.74090603s" totalImagesPullingTime="426.139574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:16:35.688213186 +0000 UTC m=+740.409202004" watchObservedRunningTime="2026-07-06 12:16:35.74090603 +0000 UTC m=+740.461894925" Jul 06 12:16:36.045528 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.045489 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d7dc68659-vb646"] Jul 06 12:16:36.045707 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.045678 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-d7dc68659-vb646" podUID="1a51b152-60a2-4dc4-8854-c1d73b0de01c" containerName="authorino" containerID="cri-o://1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287" gracePeriod=30 Jul 06 12:16:36.320478 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.320449 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:16:36.414348 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.414306 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjh8q\" (UniqueName: \"kubernetes.io/projected/1a51b152-60a2-4dc4-8854-c1d73b0de01c-kube-api-access-xjh8q\") pod \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " Jul 06 12:16:36.414603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.414585 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a51b152-60a2-4dc4-8854-c1d73b0de01c-tls-cert\") pod \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\" (UID: \"1a51b152-60a2-4dc4-8854-c1d73b0de01c\") " Jul 06 12:16:36.417556 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.417522 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a51b152-60a2-4dc4-8854-c1d73b0de01c-kube-api-access-xjh8q" (OuterVolumeSpecName: "kube-api-access-xjh8q") pod "1a51b152-60a2-4dc4-8854-c1d73b0de01c" (UID: "1a51b152-60a2-4dc4-8854-c1d73b0de01c"). InnerVolumeSpecName "kube-api-access-xjh8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:16:36.428135 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.428107 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a51b152-60a2-4dc4-8854-c1d73b0de01c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1a51b152-60a2-4dc4-8854-c1d73b0de01c" (UID: "1a51b152-60a2-4dc4-8854-c1d73b0de01c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 12:16:36.489874 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.489835 2581 generic.go:356] "Generic (PLEG): container finished" podID="1a51b152-60a2-4dc4-8854-c1d73b0de01c" containerID="1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287" exitCode=0 Jul 06 12:16:36.490305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.489917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7dc68659-vb646" event={"ID":"1a51b152-60a2-4dc4-8854-c1d73b0de01c","Type":"ContainerDied","Data":"1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287"} Jul 06 12:16:36.490305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.489960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7dc68659-vb646" event={"ID":"1a51b152-60a2-4dc4-8854-c1d73b0de01c","Type":"ContainerDied","Data":"f3249e010945c78bb72046d8751b4978dbf27d725ececf9d1277e726b9cde291"} Jul 06 12:16:36.490305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.489979 2581 scope.go:117] "RemoveContainer" containerID="1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287" Jul 06 12:16:36.490305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.490062 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7dc68659-vb646" Jul 06 12:16:36.501558 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.501537 2581 scope.go:117] "RemoveContainer" containerID="1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287" Jul 06 12:16:36.502043 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:16:36.502019 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287\": container with ID starting with 1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287 not found: ID does not exist" containerID="1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287" Jul 06 12:16:36.502154 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.502049 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287"} err="failed to get container status \"1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287\": rpc error: code = NotFound desc = could not find container \"1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287\": container with ID starting with 1da78f293e926c19b0cf516c8df29d9a233ff599bc448079b618b268012c6287 not found: ID does not exist" Jul 06 12:16:36.515463 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.515438 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjh8q\" (UniqueName: \"kubernetes.io/projected/1a51b152-60a2-4dc4-8854-c1d73b0de01c-kube-api-access-xjh8q\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:16:36.515463 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.515462 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1a51b152-60a2-4dc4-8854-c1d73b0de01c-tls-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:16:36.669659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.669569 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d7dc68659-vb646"] Jul 06 12:16:36.689599 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:36.689566 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d7dc68659-vb646"] Jul 06 12:16:37.878781 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:16:37.878749 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a51b152-60a2-4dc4-8854-c1d73b0de01c" path="/var/lib/kubelet/pods/1a51b152-60a2-4dc4-8854-c1d73b0de01c/volumes" Jul 06 12:30:00.158435 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.158405 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722350-jqx4p"] Jul 06 12:30:00.158926 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.158751 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a51b152-60a2-4dc4-8854-c1d73b0de01c" containerName="authorino" Jul 06 12:30:00.158926 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.158762 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a51b152-60a2-4dc4-8854-c1d73b0de01c" containerName="authorino" Jul 06 12:30:00.158926 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.158836 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a51b152-60a2-4dc4-8854-c1d73b0de01c" containerName="authorino" Jul 06 12:30:00.161897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.161879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:00.168501 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.168476 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lfnhn\"" Jul 06 12:30:00.195564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.195542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722350-jqx4p"] Jul 06 12:30:00.220143 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.220119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjxms\" (UniqueName: \"kubernetes.io/projected/1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81-kube-api-access-kjxms\") pod \"maas-api-key-cleanup-29722350-jqx4p\" (UID: \"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81\") " pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:00.320822 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.320775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjxms\" (UniqueName: \"kubernetes.io/projected/1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81-kube-api-access-kjxms\") pod \"maas-api-key-cleanup-29722350-jqx4p\" (UID: \"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81\") " pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:00.334261 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.334230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjxms\" (UniqueName: \"kubernetes.io/projected/1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81-kube-api-access-kjxms\") pod \"maas-api-key-cleanup-29722350-jqx4p\" (UID: \"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81\") " pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:00.471529 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.471452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:00.610765 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.610740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722350-jqx4p"] Jul 06 12:30:00.612420 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:30:00.612394 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce1b5c3_3c11_4c7d_bbf4_ad316705bc81.slice/crio-ac5c68465f06b6635346ac719be3d9073f17453d83d20b7d9dca4e97c005c2ec WatchSource:0}: Error finding container ac5c68465f06b6635346ac719be3d9073f17453d83d20b7d9dca4e97c005c2ec: Status 404 returned error can't find the container with id ac5c68465f06b6635346ac719be3d9073f17453d83d20b7d9dca4e97c005c2ec Jul 06 12:30:00.665974 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:00.665951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" event={"ID":"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81","Type":"ContainerStarted","Data":"ac5c68465f06b6635346ac719be3d9073f17453d83d20b7d9dca4e97c005c2ec"} Jul 06 12:30:01.672006 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:01.671923 2581 generic.go:356] "Generic (PLEG): container finished" podID="1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81" containerID="ac6d7f2e9fe415fc092ff9e8a050b95b87b838c0bdb19c67af4157261b9543e5" exitCode=0 Jul 06 12:30:01.672006 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:01.671995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" event={"ID":"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81","Type":"ContainerDied","Data":"ac6d7f2e9fe415fc092ff9e8a050b95b87b838c0bdb19c67af4157261b9543e5"} Jul 06 12:30:02.807536 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:02.807514 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:02.850786 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:02.850752 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjxms\" (UniqueName: \"kubernetes.io/projected/1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81-kube-api-access-kjxms\") pod \"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81\" (UID: \"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81\") " Jul 06 12:30:02.852772 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:02.852741 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81-kube-api-access-kjxms" (OuterVolumeSpecName: "kube-api-access-kjxms") pod "1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81" (UID: "1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81"). InnerVolumeSpecName "kube-api-access-kjxms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:02.952481 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:02.952411 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjxms\" (UniqueName: \"kubernetes.io/projected/1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81-kube-api-access-kjxms\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:03.662161 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.662131 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr"] Jul 06 12:30:03.662558 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.662541 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81" containerName="cleanup" Jul 06 12:30:03.662645 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.662561 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81" containerName="cleanup" Jul 06 12:30:03.662701 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.662674 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81" containerName="cleanup" Jul 06 12:30:03.665734 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.665714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.670115 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.670088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-020e6184-openshift-default-dockercfg-5wgp4\"" Jul 06 12:30:03.683373 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.683353 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" Jul 06 12:30:03.683460 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.683394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722350-jqx4p" event={"ID":"1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81","Type":"ContainerDied","Data":"ac5c68465f06b6635346ac719be3d9073f17453d83d20b7d9dca4e97c005c2ec"} Jul 06 12:30:03.683460 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.683433 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac5c68465f06b6635346ac719be3d9073f17453d83d20b7d9dca4e97c005c2ec" Jul 06 12:30:03.759114 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40472a6f-8733-45ed-871f-fb82643b00f5-istiod-ca-cert\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759236 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-data\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759236 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-certs\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759236 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-envoy\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759401 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-credential-socket\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759401 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40472a6f-8733-45ed-871f-fb82643b00f5-istio-podinfo\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759401 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-istio-token\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759401 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbm7z\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-kube-api-access-sbm7z\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.759558 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.759431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-socket\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.776530 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.776510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr"] Jul 06 12:30:03.860049 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-credential-socket\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40472a6f-8733-45ed-871f-fb82643b00f5-istio-podinfo\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-istio-token\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbm7z\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-kube-api-access-sbm7z\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-socket\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40472a6f-8733-45ed-871f-fb82643b00f5-istiod-ca-cert\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-data\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-certs\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-envoy\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-data\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-certs\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860727 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-socket\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.860788 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-credential-socket\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.861085 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.860960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40472a6f-8733-45ed-871f-fb82643b00f5-istiod-ca-cert\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.862424 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.862408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-envoy\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.862501 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.862452 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40472a6f-8733-45ed-871f-fb82643b00f5-istio-podinfo\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.887598 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.887576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbm7z\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-kube-api-access-sbm7z\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.888960 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.888939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-istio-token\") pod \"e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:03.975659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:03.975605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:04.110956 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.110928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr"] Jul 06 12:30:04.111905 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:30:04.111882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40472a6f_8733_45ed_871f_fb82643b00f5.slice/crio-b03c848c6ba8058b0b1c6ed72fa2310642d81ab3cd6b8d389a8b6207da388f00 WatchSource:0}: Error finding container b03c848c6ba8058b0b1c6ed72fa2310642d81ab3cd6b8d389a8b6207da388f00: Status 404 returned error can't find the container with id b03c848c6ba8058b0b1c6ed72fa2310642d81ab3cd6b8d389a8b6207da388f00 Jul 06 12:30:04.113981 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.113951 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:04.114068 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.114015 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:04.114068 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.114043 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:04.691093 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.691056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" event={"ID":"40472a6f-8733-45ed-871f-fb82643b00f5","Type":"ContainerStarted","Data":"2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7"} Jul 06 12:30:04.691257 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.691108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" event={"ID":"40472a6f-8733-45ed-871f-fb82643b00f5","Type":"ContainerStarted","Data":"b03c848c6ba8058b0b1c6ed72fa2310642d81ab3cd6b8d389a8b6207da388f00"} Jul 06 12:30:04.720942 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.720893 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" podStartSLOduration=1.720878132 podStartE2EDuration="1.720878132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:04.719794175 +0000 UTC m=+1549.440783015" watchObservedRunningTime="2026-07-06 12:30:04.720878132 +0000 UTC m=+1549.441866971" Jul 06 12:30:04.975750 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:04.975679 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:05.981241 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:05.981207 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:06.701324 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:06.701292 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:06.702185 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:06.702170 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:13.309999 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:13.309961 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr"] Jul 06 12:30:13.310458 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:13.310191 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" podUID="40472a6f-8733-45ed-871f-fb82643b00f5" containerName="istio-proxy" containerID="cri-o://2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7" gracePeriod=30 Jul 06 12:30:15.561530 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.561504 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:15.669373 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669313 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-envoy\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669373 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669359 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-istio-token\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669416 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-certs\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-socket\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669465 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbm7z\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-kube-api-access-sbm7z\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-credential-socket\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669561 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669549 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40472a6f-8733-45ed-871f-fb82643b00f5-istiod-ca-cert\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669780 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669584 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-data\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669780 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669610 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40472a6f-8733-45ed-871f-fb82643b00f5-istio-podinfo\") pod \"40472a6f-8733-45ed-871f-fb82643b00f5\" (UID: \"40472a6f-8733-45ed-871f-fb82643b00f5\") " Jul 06 12:30:15.669780 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669684 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:15.669918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669899 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:15.669965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.669909 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40472a6f-8733-45ed-871f-fb82643b00f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:30:15.670031 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.670000 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40472a6f-8733-45ed-871f-fb82643b00f5-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.670082 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.670062 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.670082 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.670076 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.670249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.670217 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:15.670565 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.670544 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:15.671651 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.671631 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:15.671729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.671667 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40472a6f-8733-45ed-871f-fb82643b00f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:30:15.671729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.671682 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:15.671967 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.671942 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-kube-api-access-sbm7z" (OuterVolumeSpecName: "kube-api-access-sbm7z") pod "40472a6f-8733-45ed-871f-fb82643b00f5" (UID: "40472a6f-8733-45ed-871f-fb82643b00f5"). InnerVolumeSpecName "kube-api-access-sbm7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:15.756186 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.756159 2581 generic.go:356] "Generic (PLEG): container finished" podID="40472a6f-8733-45ed-871f-fb82643b00f5" containerID="2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7" exitCode=0 Jul 06 12:30:15.756287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.756210 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" Jul 06 12:30:15.756287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.756248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" event={"ID":"40472a6f-8733-45ed-871f-fb82643b00f5","Type":"ContainerDied","Data":"2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7"} Jul 06 12:30:15.756364 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.756297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr" event={"ID":"40472a6f-8733-45ed-871f-fb82643b00f5","Type":"ContainerDied","Data":"b03c848c6ba8058b0b1c6ed72fa2310642d81ab3cd6b8d389a8b6207da388f00"} Jul 06 12:30:15.756364 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.756319 2581 scope.go:117] "RemoveContainer" containerID="2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7" Jul 06 12:30:15.765077 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.765063 2581 scope.go:117] "RemoveContainer" containerID="2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7" Jul 06 12:30:15.765292 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:30:15.765277 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7\": container with ID starting with 2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7 not found: ID does not exist" containerID="2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7" Jul 06 12:30:15.765334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.765301 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7"} err="failed to get container status \"2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7\": rpc error: code = NotFound desc = could not find container \"2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7\": container with ID starting with 2f8b57debd51dadfb83acc7bbfbb3d08bb1fed9d38ef51802cecc8c0f7eafde7 not found: ID does not exist" Jul 06 12:30:15.770686 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.770671 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.770735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.770689 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbm7z\" (UniqueName: \"kubernetes.io/projected/40472a6f-8733-45ed-871f-fb82643b00f5-kube-api-access-sbm7z\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.770735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.770699 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.770735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.770707 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.770735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.770714 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40472a6f-8733-45ed-871f-fb82643b00f5-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.770735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.770721 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40472a6f-8733-45ed-871f-fb82643b00f5-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:15.794032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.794009 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr"] Jul 06 12:30:15.798734 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.798713 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-020e6184-openshift-default-5dd77ff6d7-9rwcr"] Jul 06 12:30:15.878030 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:15.878012 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40472a6f-8733-45ed-871f-fb82643b00f5" path="/var/lib/kubelet/pods/40472a6f-8733-45ed-871f-fb82643b00f5/volumes" Jul 06 12:30:20.758144 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.758109 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6"] Jul 06 12:30:20.758657 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.758637 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40472a6f-8733-45ed-871f-fb82643b00f5" containerName="istio-proxy" Jul 06 12:30:20.758740 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.758660 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40472a6f-8733-45ed-871f-fb82643b00f5" containerName="istio-proxy" Jul 06 12:30:20.758795 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.758766 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40472a6f-8733-45ed-871f-fb82643b00f5" containerName="istio-proxy" Jul 06 12:30:20.761899 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.761878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.767031 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.767013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4ee050e5-openshift-default-dockercfg-lrkpv\"" Jul 06 12:30:20.821197 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.821166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6"] Jul 06 12:30:20.912126 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdln5\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-kube-api-access-bdln5\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-podinfo\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-token\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-credential-socket\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-envoy\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-socket\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912487 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istiod-ca-cert\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912487 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-data\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:20.912487 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:20.912385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-certs\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013063 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.012983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-podinfo\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013063 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-token\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013063 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-credential-socket\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-envoy\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-socket\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istiod-ca-cert\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-data\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-certs\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013334 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdln5\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-kube-api-access-bdln5\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-credential-socket\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-socket\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013747 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-data\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.013841 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.013819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-certs\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.014062 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.014045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istiod-ca-cert\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.015451 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.015435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-podinfo\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.015650 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.015632 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-envoy\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.038413 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.038385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-token\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.038516 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.038500 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdln5\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-kube-api-access-bdln5\") pod \"e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.071760 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.071739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:21.210530 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.210497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6"] Jul 06 12:30:21.218103 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:30:21.218077 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28c37de_c0f5_4572_96ae_a8d1daa1ee46.slice/crio-630f5a5605aa1278ba04f51e70f41d477eab4cec41dac2b9549807172df0048e WatchSource:0}: Error finding container 630f5a5605aa1278ba04f51e70f41d477eab4cec41dac2b9549807172df0048e: Status 404 returned error can't find the container with id 630f5a5605aa1278ba04f51e70f41d477eab4cec41dac2b9549807172df0048e Jul 06 12:30:21.220072 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.220040 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:21.220148 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.220103 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:21.220148 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.220130 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:21.787978 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.787943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" event={"ID":"c28c37de-c0f5-4572-96ae-a8d1daa1ee46","Type":"ContainerStarted","Data":"cc6e7bcbe59a64678ac97fb4a6a2182e96328c9a9276fd2f53dfdb0d1354445c"} Jul 06 12:30:21.788339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:21.788022 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" event={"ID":"c28c37de-c0f5-4572-96ae-a8d1daa1ee46","Type":"ContainerStarted","Data":"630f5a5605aa1278ba04f51e70f41d477eab4cec41dac2b9549807172df0048e"} Jul 06 12:30:22.072220 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:22.072145 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:22.076896 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:22.076874 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:22.151159 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:22.151115 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" podStartSLOduration=2.151099838 podStartE2EDuration="2.151099838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:21.856826029 +0000 UTC m=+1566.577814867" watchObservedRunningTime="2026-07-06 12:30:22.151099838 +0000 UTC m=+1566.872088675" Jul 06 12:30:22.793998 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:22.793969 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:22.794934 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:22.794917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:31.460436 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:31.460401 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6"] Jul 06 12:30:31.460955 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:31.460638 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" podUID="c28c37de-c0f5-4572-96ae-a8d1daa1ee46" containerName="istio-proxy" containerID="cri-o://cc6e7bcbe59a64678ac97fb4a6a2182e96328c9a9276fd2f53dfdb0d1354445c" gracePeriod=30 Jul 06 12:30:32.850226 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:32.850164 2581 generic.go:356] "Generic (PLEG): container finished" podID="c28c37de-c0f5-4572-96ae-a8d1daa1ee46" containerID="cc6e7bcbe59a64678ac97fb4a6a2182e96328c9a9276fd2f53dfdb0d1354445c" exitCode=0 Jul 06 12:30:32.850688 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:32.850268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" event={"ID":"c28c37de-c0f5-4572-96ae-a8d1daa1ee46","Type":"ContainerDied","Data":"cc6e7bcbe59a64678ac97fb4a6a2182e96328c9a9276fd2f53dfdb0d1354445c"} Jul 06 12:30:32.915420 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:32.915370 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:33.010273 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010205 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-data\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010273 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010250 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-socket\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010306 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-token\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010333 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-podinfo\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010359 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-credential-socket\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010382 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-envoy\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istiod-ca-cert\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010705 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010475 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdln5\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-kube-api-access-bdln5\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010705 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010515 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-certs\") pod \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\" (UID: \"c28c37de-c0f5-4572-96ae-a8d1daa1ee46\") " Jul 06 12:30:33.010705 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010588 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:33.010705 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010662 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:33.010952 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010713 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:33.010952 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010901 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.010952 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010919 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.010952 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010916 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:30:33.010952 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.010932 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.011221 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.011024 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-data" (OuterVolumeSpecName: "istio-data") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:33.012686 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.012660 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:30:33.012822 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.012698 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-kube-api-access-bdln5" (OuterVolumeSpecName: "kube-api-access-bdln5") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "kube-api-access-bdln5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:33.012959 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.012938 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:33.013025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.012993 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-token" (OuterVolumeSpecName: "istio-token") pod "c28c37de-c0f5-4572-96ae-a8d1daa1ee46" (UID: "c28c37de-c0f5-4572-96ae-a8d1daa1ee46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:33.112830 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.112786 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdln5\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-kube-api-access-bdln5\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.112918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.112835 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.112918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.112845 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.112918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.112852 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.112918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.112860 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.112918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.112868 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c28c37de-c0f5-4572-96ae-a8d1daa1ee46-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:33.856915 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.856882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" event={"ID":"c28c37de-c0f5-4572-96ae-a8d1daa1ee46","Type":"ContainerDied","Data":"630f5a5605aa1278ba04f51e70f41d477eab4cec41dac2b9549807172df0048e"} Jul 06 12:30:33.857324 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.856920 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6" Jul 06 12:30:33.857324 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.856963 2581 scope.go:117] "RemoveContainer" containerID="cc6e7bcbe59a64678ac97fb4a6a2182e96328c9a9276fd2f53dfdb0d1354445c" Jul 06 12:30:33.893178 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.893153 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6"] Jul 06 12:30:33.901783 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:33.901763 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4ee050e5-openshift-default-d9d564557-nqmr6"] Jul 06 12:30:35.877570 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:35.877543 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c28c37de-c0f5-4572-96ae-a8d1daa1ee46" path="/var/lib/kubelet/pods/c28c37de-c0f5-4572-96ae-a8d1daa1ee46/volumes" Jul 06 12:30:39.202575 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.202548 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk"] Jul 06 12:30:39.202971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.202931 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c28c37de-c0f5-4572-96ae-a8d1daa1ee46" containerName="istio-proxy" Jul 06 12:30:39.202971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.202943 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28c37de-c0f5-4572-96ae-a8d1daa1ee46" containerName="istio-proxy" Jul 06 12:30:39.203052 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.203016 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c28c37de-c0f5-4572-96ae-a8d1daa1ee46" containerName="istio-proxy" Jul 06 12:30:39.207437 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.207419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.210854 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.210835 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7a005a82-openshift-default-dockercfg-q2fnd\"" Jul 06 12:30:39.226071 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.226048 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk"] Jul 06 12:30:39.257329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-token\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-certs\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-podinfo\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7275n\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-kube-api-access-7275n\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257470 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198c1ce7-9106-4362-9e05-3fba09ac6026-istiod-ca-cert\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-socket\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-credential-socket\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-data\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.257613 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.257599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-envoy\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358410 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-socket\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358552 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-credential-socket\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358552 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-data\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358552 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-envoy\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358552 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-token\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-certs\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-podinfo\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7275n\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-kube-api-access-7275n\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358720 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198c1ce7-9106-4362-9e05-3fba09ac6026-istiod-ca-cert\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.358917 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.358895 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-socket\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.359086 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.359065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-certs\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.359159 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.359087 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-data\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.359159 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.359143 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-credential-socket\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.359466 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.359451 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198c1ce7-9106-4362-9e05-3fba09ac6026-istiod-ca-cert\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.360843 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.360821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-envoy\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.361236 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.361217 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-podinfo\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.377323 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.377302 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-token\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.377610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.377591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7275n\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-kube-api-access-7275n\") pod \"e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.519456 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.519434 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:39.663681 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:30:39.663653 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198c1ce7_9106_4362_9e05_3fba09ac6026.slice/crio-e27dfa056fb1d89abfdbbc008c218e10e1ed48a25bc722233efbc3857ebbc136 WatchSource:0}: Error finding container e27dfa056fb1d89abfdbbc008c218e10e1ed48a25bc722233efbc3857ebbc136: Status 404 returned error can't find the container with id e27dfa056fb1d89abfdbbc008c218e10e1ed48a25bc722233efbc3857ebbc136 Jul 06 12:30:39.663793 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.663689 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk"] Jul 06 12:30:39.665660 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.665627 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:39.665758 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.665693 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:39.665758 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.665720 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:30:39.895251 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.895160 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" event={"ID":"198c1ce7-9106-4362-9e05-3fba09ac6026","Type":"ContainerStarted","Data":"56c0aab906614170d2e6bbce64b44f4de0cfbc982b40098af4011dc2d6b75dc9"} Jul 06 12:30:39.895251 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.895219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" event={"ID":"198c1ce7-9106-4362-9e05-3fba09ac6026","Type":"ContainerStarted","Data":"e27dfa056fb1d89abfdbbc008c218e10e1ed48a25bc722233efbc3857ebbc136"} Jul 06 12:30:39.951332 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:39.951286 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" podStartSLOduration=0.95126982 podStartE2EDuration="951.26982ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:39.950614158 +0000 UTC m=+1584.671602998" watchObservedRunningTime="2026-07-06 12:30:39.95126982 +0000 UTC m=+1584.672258659" Jul 06 12:30:40.520025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:40.519990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:40.525652 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:40.525628 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:40.900215 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:40.900127 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:40.901132 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:40.901115 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:48.315071 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:48.315034 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk"] Jul 06 12:30:48.315535 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:48.315239 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" podUID="198c1ce7-9106-4362-9e05-3fba09ac6026" containerName="istio-proxy" containerID="cri-o://56c0aab906614170d2e6bbce64b44f4de0cfbc982b40098af4011dc2d6b75dc9" gracePeriod=30 Jul 06 12:30:49.950653 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:49.950627 2581 generic.go:356] "Generic (PLEG): container finished" podID="198c1ce7-9106-4362-9e05-3fba09ac6026" containerID="56c0aab906614170d2e6bbce64b44f4de0cfbc982b40098af4011dc2d6b75dc9" exitCode=0 Jul 06 12:30:49.951006 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:49.950680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" event={"ID":"198c1ce7-9106-4362-9e05-3fba09ac6026","Type":"ContainerDied","Data":"56c0aab906614170d2e6bbce64b44f4de0cfbc982b40098af4011dc2d6b75dc9"} Jul 06 12:30:50.068616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.068562 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:50.156738 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156709 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7275n\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-kube-api-access-7275n\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.156933 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-data\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.156933 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156771 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-credential-socket\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.156933 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156865 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-podinfo\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.156933 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156893 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-token\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.156933 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156925 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-certs\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.157186 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156948 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-envoy\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.157186 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.156985 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-socket\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.157186 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157026 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198c1ce7-9106-4362-9e05-3fba09ac6026-istiod-ca-cert\") pod \"198c1ce7-9106-4362-9e05-3fba09ac6026\" (UID: \"198c1ce7-9106-4362-9e05-3fba09ac6026\") " Jul 06 12:30:50.157341 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157281 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:50.157729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157412 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.157729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157674 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:50.157729 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157578 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198c1ce7-9106-4362-9e05-3fba09ac6026-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:30:50.157999 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157761 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:50.157999 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.157770 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-data" (OuterVolumeSpecName: "istio-data") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:50.159439 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.159409 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:30:50.159439 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.159425 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-kube-api-access-7275n" (OuterVolumeSpecName: "kube-api-access-7275n") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "kube-api-access-7275n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:50.159588 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.159441 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:30:50.159643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.159615 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-token" (OuterVolumeSpecName: "istio-token") pod "198c1ce7-9106-4362-9e05-3fba09ac6026" (UID: "198c1ce7-9106-4362-9e05-3fba09ac6026"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:30:50.258604 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258571 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/198c1ce7-9106-4362-9e05-3fba09ac6026-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258604 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258598 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7275n\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-kube-api-access-7275n\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258604 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258610 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258618 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258627 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258634 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258641 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.258864 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.258651 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/198c1ce7-9106-4362-9e05-3fba09ac6026-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:30:50.956897 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.956869 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" Jul 06 12:30:50.957329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.956911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk" event={"ID":"198c1ce7-9106-4362-9e05-3fba09ac6026","Type":"ContainerDied","Data":"e27dfa056fb1d89abfdbbc008c218e10e1ed48a25bc722233efbc3857ebbc136"} Jul 06 12:30:50.957329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.956981 2581 scope.go:117] "RemoveContainer" containerID="56c0aab906614170d2e6bbce64b44f4de0cfbc982b40098af4011dc2d6b75dc9" Jul 06 12:30:50.986766 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.986744 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk"] Jul 06 12:30:50.992381 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:50.992361 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7a005a82-openshift-default-849fbfdfbc-k8frk"] Jul 06 12:30:51.882234 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:30:51.882205 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198c1ce7-9106-4362-9e05-3fba09ac6026" path="/var/lib/kubelet/pods/198c1ce7-9106-4362-9e05-3fba09ac6026/volumes" Jul 06 12:32:36.583687 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.583647 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8"] Jul 06 12:32:36.584603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.584578 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198c1ce7-9106-4362-9e05-3fba09ac6026" containerName="istio-proxy" Jul 06 12:32:36.584703 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.584607 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="198c1ce7-9106-4362-9e05-3fba09ac6026" containerName="istio-proxy" Jul 06 12:32:36.584874 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.584858 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="198c1ce7-9106-4362-9e05-3fba09ac6026" containerName="istio-proxy" Jul 06 12:32:36.590851 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.590825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.595326 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.595303 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5931b72e-openshift-default-dockercfg-lxfn5\"" Jul 06 12:32:36.621906 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.621882 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8"] Jul 06 12:32:36.652231 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-credential-socket\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-data\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff021a8-1785-433d-b860-c91de91ce211-istio-podinfo\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652368 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-istio-token\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652480 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff021a8-1785-433d-b860-c91de91ce211-istiod-ca-cert\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652480 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtsc\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-kube-api-access-kwtsc\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-socket\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-certs\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.652545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.652521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-envoy\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-socket\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753477 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-certs\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-envoy\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-credential-socket\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-data\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff021a8-1785-433d-b860-c91de91ce211-istio-podinfo\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-istio-token\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.753733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff021a8-1785-433d-b860-c91de91ce211-istiod-ca-cert\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.754090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtsc\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-kube-api-access-kwtsc\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.754090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753900 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-socket\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.754090 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.753975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-certs\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.754271 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.754162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-credential-socket\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.754343 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.754276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-data\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.754736 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.754712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff021a8-1785-433d-b860-c91de91ce211-istiod-ca-cert\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.756131 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.756109 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-envoy\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.756386 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.756369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff021a8-1785-433d-b860-c91de91ce211-istio-podinfo\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.762958 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.762936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtsc\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-kube-api-access-kwtsc\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.764288 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.764266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-istio-token\") pod \"e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:36.902071 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:36.901995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:37.044629 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.044604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8"] Jul 06 12:32:37.045423 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:32:37.045401 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff021a8_1785_433d_b860_c91de91ce211.slice/crio-93b487dfffe8b85bc3aa4d4c7c0757d5d268bbf1679c98c358cf273a80a65994 WatchSource:0}: Error finding container 93b487dfffe8b85bc3aa4d4c7c0757d5d268bbf1679c98c358cf273a80a65994: Status 404 returned error can't find the container with id 93b487dfffe8b85bc3aa4d4c7c0757d5d268bbf1679c98c358cf273a80a65994 Jul 06 12:32:37.047675 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.047630 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:32:37.047750 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.047729 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:32:37.047789 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.047773 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:32:37.498291 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.498259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" event={"ID":"aff021a8-1785-433d-b860-c91de91ce211","Type":"ContainerStarted","Data":"a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9"} Jul 06 12:32:37.498468 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.498307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" event={"ID":"aff021a8-1785-433d-b860-c91de91ce211","Type":"ContainerStarted","Data":"93b487dfffe8b85bc3aa4d4c7c0757d5d268bbf1679c98c358cf273a80a65994"} Jul 06 12:32:37.535101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.535047 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podStartSLOduration=1.535031174 podStartE2EDuration="1.535031174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:37.53371185 +0000 UTC m=+1702.254700693" watchObservedRunningTime="2026-07-06 12:32:37.535031174 +0000 UTC m=+1702.256020013" Jul 06 12:32:37.902196 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:37.902168 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:38.907783 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:38.907749 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:39.507857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:39.507832 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:39.508716 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:39.508692 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:54.509258 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.509223 2581 patch_prober.go:28] interesting pod/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 12:32:54.509658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.509276 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 12:32:54.593583 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.593551 2581 generic.go:356] "Generic (PLEG): container finished" podID="aff021a8-1785-433d-b860-c91de91ce211" containerID="a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9" exitCode=0 Jul 06 12:32:54.593772 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.593627 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" event={"ID":"aff021a8-1785-433d-b860-c91de91ce211","Type":"ContainerDied","Data":"a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9"} Jul 06 12:32:54.594061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.594046 2581 scope.go:117] "RemoveContainer" containerID="a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9" Jul 06 12:32:54.595056 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.595027 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:32:54.595174 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.595140 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:32:54.595238 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:54.595193 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:32:55.604032 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:55.603986 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" event={"ID":"aff021a8-1785-433d-b860-c91de91ce211","Type":"ContainerStarted","Data":"8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233"} Jul 06 12:32:55.903131 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:55.903038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:55.903496 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:55.903403 2581 patch_prober.go:28] interesting pod/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 12:32:55.903675 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:55.903651 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 12:32:56.902894 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:56.902857 2581 patch_prober.go:28] interesting pod/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 12:32:56.903469 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:56.903438 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 12:32:57.902611 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:57.902571 2581 patch_prober.go:28] interesting pod/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 12:32:57.902835 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:57.902636 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 12:32:58.903201 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:58.903161 2581 patch_prober.go:28] interesting pod/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 12:32:58.903699 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:58.903229 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 12:32:59.906872 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:59.906840 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:59.907238 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:59.907224 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:32:59.907838 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:32:59.907820 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:33:00.811124 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:00.811094 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8"] Jul 06 12:33:01.640959 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:01.640921 2581 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" secret="" err="secret \"e2e-mt-5931b72e-openshift-default-dockercfg-lxfn5\" not found" Jul 06 12:33:02.646618 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:02.646578 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" containerID="cri-o://8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233" gracePeriod=30 Jul 06 12:33:07.911548 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.911479 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:33:07.927869 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.927841 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff021a8-1785-433d-b860-c91de91ce211-istiod-ca-cert\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928017 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.927889 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-credential-socket\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928017 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.927922 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff021a8-1785-433d-b860-c91de91ce211-istio-podinfo\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928017 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.927947 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-data\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928017 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.927974 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-certs\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928017 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-istio-token\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928293 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928047 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-envoy\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928293 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928104 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-socket\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928293 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928168 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwtsc\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-kube-api-access-kwtsc\") pod \"aff021a8-1785-433d-b860-c91de91ce211\" (UID: \"aff021a8-1785-433d-b860-c91de91ce211\") " Jul 06 12:33:07.928439 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928358 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:33:07.928439 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928378 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff021a8-1785-433d-b860-c91de91ce211-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:33:07.928543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928485 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff021a8-1785-433d-b860-c91de91ce211-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:07.928543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928503 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:07.928630 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928564 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:33:07.928630 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.928588 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:33:07.929214 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.929183 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-data" (OuterVolumeSpecName: "istio-data") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:33:07.930336 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.930313 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aff021a8-1785-433d-b860-c91de91ce211-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:33:07.930429 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.930342 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:33:07.930474 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.930452 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-istio-token" (OuterVolumeSpecName: "istio-token") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:33:07.930513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:07.930477 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-kube-api-access-kwtsc" (OuterVolumeSpecName: "kube-api-access-kwtsc") pod "aff021a8-1785-433d-b860-c91de91ce211" (UID: "aff021a8-1785-433d-b860-c91de91ce211"). InnerVolumeSpecName "kube-api-access-kwtsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:33:08.029786 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029751 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.029786 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029783 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff021a8-1785-433d-b860-c91de91ce211-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.030005 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029793 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.030005 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029834 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.030005 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029841 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.030005 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029849 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff021a8-1785-433d-b860-c91de91ce211-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.030005 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.029857 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwtsc\" (UniqueName: \"kubernetes.io/projected/aff021a8-1785-433d-b860-c91de91ce211-kube-api-access-kwtsc\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:33:08.680634 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.680600 2581 generic.go:356] "Generic (PLEG): container finished" podID="aff021a8-1785-433d-b860-c91de91ce211" containerID="8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233" exitCode=0 Jul 06 12:33:08.680634 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.680638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" event={"ID":"aff021a8-1785-433d-b860-c91de91ce211","Type":"ContainerDied","Data":"8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233"} Jul 06 12:33:08.680918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.680654 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" Jul 06 12:33:08.680918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.680683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8" event={"ID":"aff021a8-1785-433d-b860-c91de91ce211","Type":"ContainerDied","Data":"93b487dfffe8b85bc3aa4d4c7c0757d5d268bbf1679c98c358cf273a80a65994"} Jul 06 12:33:08.680918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.680706 2581 scope.go:117] "RemoveContainer" containerID="8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233" Jul 06 12:33:08.692935 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.692898 2581 scope.go:117] "RemoveContainer" containerID="a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9" Jul 06 12:33:08.701955 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.701935 2581 scope.go:117] "RemoveContainer" containerID="8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233" Jul 06 12:33:08.702270 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:33:08.702251 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233\": container with ID starting with 8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233 not found: ID does not exist" containerID="8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233" Jul 06 12:33:08.702318 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.702280 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233"} err="failed to get container status \"8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233\": rpc error: code = NotFound desc = could not find container \"8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233\": container with ID starting with 8d2ab3afd9faa4d8fb8376562e6809d39fe3814ec58f79977a6c38f3a1f72233 not found: ID does not exist" Jul 06 12:33:08.702318 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.702299 2581 scope.go:117] "RemoveContainer" containerID="a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9" Jul 06 12:33:08.702589 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:33:08.702567 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9\": container with ID starting with a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9 not found: ID does not exist" containerID="a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9" Jul 06 12:33:08.702655 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.702595 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9"} err="failed to get container status \"a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9\": rpc error: code = NotFound desc = could not find container \"a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9\": container with ID starting with a526f109c3fb762e08e1dd530c91fcd9c7ac794e9a01c0cf913c7016033ad5e9 not found: ID does not exist" Jul 06 12:33:08.728549 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.728513 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8"] Jul 06 12:33:08.734249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:08.734223 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5931b72e-openshift-default-8978997f9-q8rv8"] Jul 06 12:33:09.878048 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:09.878015 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff021a8-1785-433d-b860-c91de91ce211" path="/var/lib/kubelet/pods/aff021a8-1785-433d-b860-c91de91ce211/volumes" Jul 06 12:33:21.667106 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667072 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk"] Jul 06 12:33:21.667511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667449 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" Jul 06 12:33:21.667511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667460 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" Jul 06 12:33:21.667511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667477 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" Jul 06 12:33:21.667511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667483 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" Jul 06 12:33:21.667647 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667545 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" Jul 06 12:33:21.667647 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.667556 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff021a8-1785-433d-b860-c91de91ce211" containerName="istio-proxy" Jul 06 12:33:21.670386 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.670366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.677394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.677365 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-acc0dc0f-openshift-default-dockercfg-2bwjv\"" Jul 06 12:33:21.751572 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-token\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.751768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istiod-ca-cert\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.751768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbjlh\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-kube-api-access-sbjlh\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.751768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-data\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.751768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-certs\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.752026 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-socket\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.752026 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-credential-socket\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.752026 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-envoy\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.752026 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.751966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-podinfo\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.796669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.796633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk"] Jul 06 12:33:21.852791 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.852755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-credential-socket\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.852986 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.852822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-envoy\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.852986 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.852853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-podinfo\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.852986 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.852897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-token\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.853162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.853016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istiod-ca-cert\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.853162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.853057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbjlh\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-kube-api-access-sbjlh\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.853162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.853130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-data\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.853162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.853158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-certs\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.853383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.853212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-socket\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.853651 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.853625 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-socket\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.854111 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.854082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istiod-ca-cert\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.854218 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.854119 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-certs\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.854287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.854242 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-data\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.854287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.854279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-credential-socket\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.855446 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.855415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-envoy\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.856115 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.856092 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-podinfo\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.882410 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.882379 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbjlh\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-kube-api-access-sbjlh\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.885880 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.885855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-token\") pod \"e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:21.982954 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:21.982870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:22.137251 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.137210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk"] Jul 06 12:33:22.139509 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:33:22.139478 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e35eda2_10ed_4aa0_ad50_ef287fde9c80.slice/crio-39a3e3bf5acb3a4668d526524576a2abfc62be95802f317883ebccfbdeffafd7 WatchSource:0}: Error finding container 39a3e3bf5acb3a4668d526524576a2abfc62be95802f317883ebccfbdeffafd7: Status 404 returned error can't find the container with id 39a3e3bf5acb3a4668d526524576a2abfc62be95802f317883ebccfbdeffafd7 Jul 06 12:33:22.141643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.141612 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:33:22.141713 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.141679 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:33:22.141713 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.141709 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:33:22.761873 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.761833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" event={"ID":"7e35eda2-10ed-4aa0-ad50-ef287fde9c80","Type":"ContainerStarted","Data":"fdcd8742375f84c9ae89f78000b8e4a66676f72fc830278b30fb08253ca4339f"} Jul 06 12:33:22.762269 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.761901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" event={"ID":"7e35eda2-10ed-4aa0-ad50-ef287fde9c80","Type":"ContainerStarted","Data":"39a3e3bf5acb3a4668d526524576a2abfc62be95802f317883ebccfbdeffafd7"} Jul 06 12:33:22.791623 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.791568 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podStartSLOduration=1.7915518270000002 podStartE2EDuration="1.791551827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:33:22.789156354 +0000 UTC m=+1747.510145196" watchObservedRunningTime="2026-07-06 12:33:22.791551827 +0000 UTC m=+1747.512540667" Jul 06 12:33:22.983639 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:22.983602 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:23.988449 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:23.988419 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:24.772627 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:24.772590 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:24.773380 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:24.773362 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:35.842284 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:35.842252 2581 generic.go:356] "Generic (PLEG): container finished" podID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerID="fdcd8742375f84c9ae89f78000b8e4a66676f72fc830278b30fb08253ca4339f" exitCode=0 Jul 06 12:33:35.842824 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:35.842332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" event={"ID":"7e35eda2-10ed-4aa0-ad50-ef287fde9c80","Type":"ContainerDied","Data":"fdcd8742375f84c9ae89f78000b8e4a66676f72fc830278b30fb08253ca4339f"} Jul 06 12:33:35.842908 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:35.842860 2581 scope.go:117] "RemoveContainer" containerID="fdcd8742375f84c9ae89f78000b8e4a66676f72fc830278b30fb08253ca4339f" Jul 06 12:33:35.843861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:35.843832 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:33:35.843933 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:35.843898 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:33:35.843971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:35.843930 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:33:36.856608 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:36.856576 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" event={"ID":"7e35eda2-10ed-4aa0-ad50-ef287fde9c80","Type":"ContainerStarted","Data":"8bce39b9b6d1185f065e51d0f75406c838122f9501423e90c71c03e0be009272"} Jul 06 12:33:36.983285 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:36.983253 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:36.984473 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:36.984443 2581 patch_prober.go:28] interesting pod/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 12:33:36.984605 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:36.984496 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 12:33:37.983760 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:37.983728 2581 patch_prober.go:28] interesting pod/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 12:33:37.984176 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:37.983777 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 12:33:38.983172 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:38.983136 2581 patch_prober.go:28] interesting pod/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 12:33:38.983351 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:38.983203 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 12:33:39.772680 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:39.772647 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:39.983735 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:39.983703 2581 patch_prober.go:28] interesting pod/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 12:33:39.983914 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:39.983762 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 12:33:40.987378 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:40.987351 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:33:40.988467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:33:40.988451 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:34:52.103447 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:52.103414 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk"] Jul 06 12:34:52.103954 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:52.103655 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" containerID="cri-o://8bce39b9b6d1185f065e51d0f75406c838122f9501423e90c71c03e0be009272" gracePeriod=30 Jul 06 12:34:55.990392 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:55.990356 2581 patch_prober.go:28] interesting pod/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 12:34:55.990786 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:55.990417 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 12:34:57.284968 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.284930 2581 generic.go:356] "Generic (PLEG): container finished" podID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerID="8bce39b9b6d1185f065e51d0f75406c838122f9501423e90c71c03e0be009272" exitCode=0 Jul 06 12:34:57.285402 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.285126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" event={"ID":"7e35eda2-10ed-4aa0-ad50-ef287fde9c80","Type":"ContainerDied","Data":"8bce39b9b6d1185f065e51d0f75406c838122f9501423e90c71c03e0be009272"} Jul 06 12:34:57.285402 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.285230 2581 scope.go:117] "RemoveContainer" containerID="fdcd8742375f84c9ae89f78000b8e4a66676f72fc830278b30fb08253ca4339f" Jul 06 12:34:57.359296 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.359274 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:34:57.435756 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.435701 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbjlh\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-kube-api-access-sbjlh\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.435756 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.435748 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-token\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.435973 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.435767 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-data\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.435973 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.435820 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istiod-ca-cert\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.435973 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.435918 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-certs\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.435973 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.435954 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-socket\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.436195 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-podinfo\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.436195 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-credential-socket\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.436195 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436108 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-envoy\") pod \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\" (UID: \"7e35eda2-10ed-4aa0-ad50-ef287fde9c80\") " Jul 06 12:34:57.436359 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436205 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:34:57.436416 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436369 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:34:57.436571 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436553 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.436764 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436751 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.436925 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436625 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:34:57.437078 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436641 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:34:57.437078 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.436669 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:34:57.438421 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.438368 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:34:57.438618 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.438593 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-kube-api-access-sbjlh" (OuterVolumeSpecName: "kube-api-access-sbjlh") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "kube-api-access-sbjlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:34:57.438690 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.438618 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:34:57.439861 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.439840 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e35eda2-10ed-4aa0-ad50-ef287fde9c80" (UID: "7e35eda2-10ed-4aa0-ad50-ef287fde9c80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:34:57.537637 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537603 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.537754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537639 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.537754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537654 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.537754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537666 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.537754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537678 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.537754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537691 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:57.537754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:57.537704 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbjlh\" (UniqueName: \"kubernetes.io/projected/7e35eda2-10ed-4aa0-ad50-ef287fde9c80-kube-api-access-sbjlh\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:34:58.292218 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:58.292187 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" Jul 06 12:34:58.292677 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:58.292240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk" event={"ID":"7e35eda2-10ed-4aa0-ad50-ef287fde9c80","Type":"ContainerDied","Data":"39a3e3bf5acb3a4668d526524576a2abfc62be95802f317883ebccfbdeffafd7"} Jul 06 12:34:58.292677 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:58.292309 2581 scope.go:117] "RemoveContainer" containerID="8bce39b9b6d1185f065e51d0f75406c838122f9501423e90c71c03e0be009272" Jul 06 12:34:58.326757 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:58.326729 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk"] Jul 06 12:34:58.331886 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:58.331864 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-acc0dc0f-openshift-default-8649985887-xf9bk"] Jul 06 12:34:59.879099 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:34:59.879067 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" path="/var/lib/kubelet/pods/7e35eda2-10ed-4aa0-ad50-ef287fde9c80/volumes" Jul 06 12:35:51.292112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292037 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj"] Jul 06 12:35:51.292590 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292574 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" Jul 06 12:35:51.292643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292592 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" Jul 06 12:35:51.292643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292608 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" Jul 06 12:35:51.292643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292613 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" Jul 06 12:35:51.292736 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292671 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" Jul 06 12:35:51.292736 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.292677 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e35eda2-10ed-4aa0-ad50-ef287fde9c80" containerName="istio-proxy" Jul 06 12:35:51.295618 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.295597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.298762 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.298745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-91636e-openshift-default-dockercfg-js2r2\"" Jul 06 12:35:51.315772 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.315742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj"] Jul 06 12:35:51.440918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.440888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsflf\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-kube-api-access-nsflf\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.440918 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.440923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-token\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.440946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-socket\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.440962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-podinfo\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.441006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-envoy\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.441028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-credential-socket\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.441067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-data\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441112 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.441082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd86f904-2d79-45de-a3a1-c1e7aff83188-istiod-ca-cert\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.441300 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.441136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-certs\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsflf\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-kube-api-access-nsflf\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-token\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-socket\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542521 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-podinfo\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-envoy\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-credential-socket\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-data\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd86f904-2d79-45de-a3a1-c1e7aff83188-istiod-ca-cert\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.542856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-certs\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.543139 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.542907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-socket\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.543139 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.543072 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-credential-socket\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.543245 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.543130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-data\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.543245 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.543186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-certs\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.543411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.543390 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd86f904-2d79-45de-a3a1-c1e7aff83188-istiod-ca-cert\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.544892 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.544875 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-envoy\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.545330 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.545314 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-podinfo\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.550966 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.550946 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-token\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.551094 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.551078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsflf\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-kube-api-access-nsflf\") pod \"e2e-inf-a-91636e-openshift-default-dc676897-cdnzj\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.605265 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.605242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:51.759870 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:35:51.759839 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd86f904_2d79_45de_a3a1_c1e7aff83188.slice/crio-685f8cc600ae448ffa1d4715792c154f4e298bfee5ad353318f0ca213e5e1276 WatchSource:0}: Error finding container 685f8cc600ae448ffa1d4715792c154f4e298bfee5ad353318f0ca213e5e1276: Status 404 returned error can't find the container with id 685f8cc600ae448ffa1d4715792c154f4e298bfee5ad353318f0ca213e5e1276 Jul 06 12:35:51.760008 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.759970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj"] Jul 06 12:35:51.762039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.762002 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:35:51.762146 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.762070 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:35:51.762146 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:51.762100 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:35:52.577394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:52.577363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" event={"ID":"bd86f904-2d79-45de-a3a1-c1e7aff83188","Type":"ContainerStarted","Data":"08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a"} Jul 06 12:35:52.577750 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:52.577420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" event={"ID":"bd86f904-2d79-45de-a3a1-c1e7aff83188","Type":"ContainerStarted","Data":"685f8cc600ae448ffa1d4715792c154f4e298bfee5ad353318f0ca213e5e1276"} Jul 06 12:35:52.601110 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:52.601070 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podStartSLOduration=1.601053483 podStartE2EDuration="1.601053483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:35:52.599923943 +0000 UTC m=+1897.320912787" watchObservedRunningTime="2026-07-06 12:35:52.601053483 +0000 UTC m=+1897.322042320" Jul 06 12:35:52.605550 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:52.605534 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:52.610262 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:52.610243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:53.582770 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:53.582741 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:53.583778 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:53.583758 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:35:59.871857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:59.871824 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c"] Jul 06 12:35:59.875668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:59.875649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:35:59.880012 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:59.879991 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-77bda8-openshift-default-dockercfg-9txcg\"" Jul 06 12:35:59.914857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:35:59.914835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c"] Jul 06 12:36:00.012949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.012913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-certs\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.012986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-credential-socket\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-envoy\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d080094-cec9-427a-a033-5ab67c77c62e-istiod-ca-cert\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d080094-cec9-427a-a033-5ab67c77c62e-istio-podinfo\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013140 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-socket\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013410 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-data\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013410 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q79j4\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-kube-api-access-q79j4\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.013410 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.013186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-istio-token\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114155 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-envoy\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114294 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d080094-cec9-427a-a033-5ab67c77c62e-istiod-ca-cert\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114294 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d080094-cec9-427a-a033-5ab67c77c62e-istio-podinfo\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114294 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-socket\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114294 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-data\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114527 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q79j4\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-kube-api-access-q79j4\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114527 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-istio-token\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114527 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-certs\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114527 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-credential-socket\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114825 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114681 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-socket\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.114825 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114737 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-credential-socket\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.115021 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.114999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-data\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.115200 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.115022 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d080094-cec9-427a-a033-5ab67c77c62e-istiod-ca-cert\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.115200 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.115089 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-certs\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.116594 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.116577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-envoy\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.116697 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.116682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d080094-cec9-427a-a033-5ab67c77c62e-istio-podinfo\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.126024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.125971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-istio-token\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.128730 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.128702 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q79j4\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-kube-api-access-q79j4\") pod \"e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.186545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.186528 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:00.352587 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.352559 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c"] Jul 06 12:36:00.353934 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:36:00.353907 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d080094_cec9_427a_a033_5ab67c77c62e.slice/crio-cb486566ab121a0091a71483cd3ed1b61829d573f53e27dd0a580e692bce2e17 WatchSource:0}: Error finding container cb486566ab121a0091a71483cd3ed1b61829d573f53e27dd0a580e692bce2e17: Status 404 returned error can't find the container with id cb486566ab121a0091a71483cd3ed1b61829d573f53e27dd0a580e692bce2e17 Jul 06 12:36:00.356039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.356004 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:00.356163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.356081 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:00.356163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.356124 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:00.627386 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.627355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" event={"ID":"1d080094-cec9-427a-a033-5ab67c77c62e","Type":"ContainerStarted","Data":"fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e"} Jul 06 12:36:00.627550 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.627409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" event={"ID":"1d080094-cec9-427a-a033-5ab67c77c62e","Type":"ContainerStarted","Data":"cb486566ab121a0091a71483cd3ed1b61829d573f53e27dd0a580e692bce2e17"} Jul 06 12:36:00.657642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:00.657527 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" podStartSLOduration=1.657506833 podStartE2EDuration="1.657506833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:36:00.654976464 +0000 UTC m=+1905.375965305" watchObservedRunningTime="2026-07-06 12:36:00.657506833 +0000 UTC m=+1905.378495673" Jul 06 12:36:01.186949 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:01.186917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:01.191738 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:01.191713 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:01.633190 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:01.633162 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:01.634130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:01.634111 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:09.625002 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:09.624955 2581 patch_prober.go:28] interesting pod/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 12:36:09.625404 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:09.625019 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 12:36:10.683302 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:10.683267 2581 generic.go:356] "Generic (PLEG): container finished" podID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerID="08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a" exitCode=0 Jul 06 12:36:10.683781 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:10.683317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" event={"ID":"bd86f904-2d79-45de-a3a1-c1e7aff83188","Type":"ContainerDied","Data":"08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a"} Jul 06 12:36:10.683781 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:10.683726 2581 scope.go:117] "RemoveContainer" containerID="08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a" Jul 06 12:36:10.684778 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:10.684752 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:10.684866 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:10.684836 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:10.684919 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:10.684868 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:11.691675 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:11.691639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" event={"ID":"bd86f904-2d79-45de-a3a1-c1e7aff83188","Type":"ContainerStarted","Data":"2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554"} Jul 06 12:36:12.606084 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:12.606054 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:36:12.606404 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:12.606383 2581 patch_prober.go:28] interesting pod/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 06 12:36:12.606555 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:12.606531 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 06 12:36:13.606655 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:13.606163 2581 patch_prober.go:28] interesting pod/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 06 12:36:13.606655 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:13.606232 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 06 12:36:14.606212 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:14.606171 2581 patch_prober.go:28] interesting pod/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 06 12:36:14.606409 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:14.606239 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 06 12:36:15.605857 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.605747 2581 patch_prober.go:28] interesting pod/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 06 12:36:15.606371 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.605848 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 06 12:36:15.723298 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.723268 2581 generic.go:356] "Generic (PLEG): container finished" podID="1d080094-cec9-427a-a033-5ab67c77c62e" containerID="fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e" exitCode=0 Jul 06 12:36:15.723478 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.723342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" event={"ID":"1d080094-cec9-427a-a033-5ab67c77c62e","Type":"ContainerDied","Data":"fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e"} Jul 06 12:36:15.723823 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.723788 2581 scope.go:117] "RemoveContainer" containerID="fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e" Jul 06 12:36:15.724768 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.724740 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:15.724901 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.724821 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:15.724901 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:15.724855 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:36:16.618377 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:16.618348 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:36:16.618901 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:16.618627 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:36:16.619523 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:16.619500 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:36:16.633486 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:16.633465 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:16.733886 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:16.733845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" event={"ID":"1d080094-cec9-427a-a033-5ab67c77c62e","Type":"ContainerStarted","Data":"dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154"} Jul 06 12:36:17.187096 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:17.187065 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:17.188379 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:17.188351 2581 patch_prober.go:28] interesting pod/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 12:36:17.188507 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:17.188400 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 12:36:18.187704 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:18.187670 2581 patch_prober.go:28] interesting pod/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 12:36:18.188118 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:18.187730 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 12:36:19.187725 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:19.187692 2581 patch_prober.go:28] interesting pod/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 12:36:19.188129 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:19.187742 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 12:36:20.187568 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:20.187529 2581 patch_prober.go:28] interesting pod/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 06 12:36:20.187756 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:20.187590 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 06 12:36:21.190381 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:21.190354 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:21.190887 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:21.190723 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:36:21.191346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:36:21.191326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:37:01.424226 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.424194 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7"] Jul 06 12:37:01.427677 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.427660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.431171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.431149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-f7711f-openshift-default-dockercfg-mwl74\"" Jul 06 12:37:01.465427 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.465403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7"] Jul 06 12:37:01.563016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.562989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-envoy\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563191 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563024 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-data\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563191 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-credential-socket\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563191 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df8f7c62-b704-401c-a9d7-8669da9969c5-istiod-ca-cert\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563191 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87v4w\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-kube-api-access-87v4w\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563373 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-podinfo\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563373 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-token\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563463 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-certs\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.563463 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.563408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-socket\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664492 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df8f7c62-b704-401c-a9d7-8669da9969c5-istiod-ca-cert\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87v4w\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-kube-api-access-87v4w\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-podinfo\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664658 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-token\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-certs\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-socket\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-envoy\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-data\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.664865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.664781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-credential-socket\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.665099 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.665074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-certs\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.665164 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.665142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-socket\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.665222 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.665209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-data\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.665281 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.665210 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df8f7c62-b704-401c-a9d7-8669da9969c5-istiod-ca-cert\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.665333 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.665278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-credential-socket\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.667070 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.667050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-envoy\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.667345 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.667326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-podinfo\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.686954 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.686897 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87v4w\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-kube-api-access-87v4w\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.687667 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.687646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-token\") pod \"e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.737680 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.737659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:01.909520 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.909494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7"] Jul 06 12:37:01.911585 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:37:01.911553 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8f7c62_b704_401c_a9d7_8669da9969c5.slice/crio-ab00c513348390af5a0ec0adb2e9e7376aa1762812f908b222748cda389c6b6d WatchSource:0}: Error finding container ab00c513348390af5a0ec0adb2e9e7376aa1762812f908b222748cda389c6b6d: Status 404 returned error can't find the container with id ab00c513348390af5a0ec0adb2e9e7376aa1762812f908b222748cda389c6b6d Jul 06 12:37:01.913657 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.913627 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:37:01.913717 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.913691 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:37:01.913753 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.913717 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:37:01.980581 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:01.980556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" event={"ID":"df8f7c62-b704-401c-a9d7-8669da9969c5","Type":"ContainerStarted","Data":"ab00c513348390af5a0ec0adb2e9e7376aa1762812f908b222748cda389c6b6d"} Jul 06 12:37:02.987377 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:02.987343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" event={"ID":"df8f7c62-b704-401c-a9d7-8669da9969c5","Type":"ContainerStarted","Data":"548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f"} Jul 06 12:37:03.012381 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:03.012337 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podStartSLOduration=2.012322678 podStartE2EDuration="2.012322678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:37:03.011415206 +0000 UTC m=+1967.732404046" watchObservedRunningTime="2026-07-06 12:37:03.012322678 +0000 UTC m=+1967.733311518" Jul 06 12:37:03.738205 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:03.738175 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:03.743067 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:03.743043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:03.992220 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:03.992134 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:03.993019 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:03.992999 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:28.133453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:28.133421 2581 generic.go:356] "Generic (PLEG): container finished" podID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerID="548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f" exitCode=0 Jul 06 12:37:28.133987 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:28.133499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" event={"ID":"df8f7c62-b704-401c-a9d7-8669da9969c5","Type":"ContainerDied","Data":"548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f"} Jul 06 12:37:28.133987 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:28.133924 2581 scope.go:117] "RemoveContainer" containerID="548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f" Jul 06 12:37:28.134924 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:28.134894 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:37:28.135000 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:28.134981 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:37:28.135047 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:28.135034 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:37:29.141387 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:29.141354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" event={"ID":"df8f7c62-b704-401c-a9d7-8669da9969c5","Type":"ContainerStarted","Data":"1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059"} Jul 06 12:37:29.737867 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:29.737833 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:29.738846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:29.738828 2581 patch_prober.go:28] interesting pod/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 12:37:29.738909 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:29.738869 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 12:37:30.739009 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:30.738972 2581 patch_prober.go:28] interesting pod/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 12:37:30.739381 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:30.739030 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 12:37:31.738700 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:31.738669 2581 patch_prober.go:28] interesting pod/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 12:37:31.738916 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:31.738716 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 12:37:32.739035 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:32.739000 2581 patch_prober.go:28] interesting pod/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 06 12:37:32.739409 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:32.739057 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 06 12:37:33.742118 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:33.742083 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:33.742500 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:33.742468 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:37:33.743220 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:37:33.743201 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:38:32.011636 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:32.011602 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7"] Jul 06 12:38:32.012173 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:32.011820 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" containerID="cri-o://1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059" gracePeriod=30 Jul 06 12:38:33.745191 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:33.745146 2581 patch_prober.go:28] interesting pod/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 12:38:33.745651 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:33.745216 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 12:38:37.267082 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.267053 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:38:37.353422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353329 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df8f7c62-b704-401c-a9d7-8669da9969c5-istiod-ca-cert\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353366 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-certs\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353386 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-token\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353404 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-podinfo\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353432 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-envoy\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353471 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87v4w\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-kube-api-access-87v4w\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353515 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-credential-socket\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353539 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-socket\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353582 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-data\") pod \"df8f7c62-b704-401c-a9d7-8669da9969c5\" (UID: \"df8f7c62-b704-401c-a9d7-8669da9969c5\") " Jul 06 12:38:37.353779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:38:37.354139 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.353832 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df8f7c62-b704-401c-a9d7-8669da9969c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:38:37.354139 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.354113 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df8f7c62-b704-401c-a9d7-8669da9969c5-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.354139 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.354123 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:38:37.354139 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.354135 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.354287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.354137 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:38:37.354592 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.354569 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:38:37.355748 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.355725 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:38:37.355856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.355759 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:38:37.356052 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.356022 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:38:37.356150 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.356052 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-kube-api-access-87v4w" (OuterVolumeSpecName: "kube-api-access-87v4w") pod "df8f7c62-b704-401c-a9d7-8669da9969c5" (UID: "df8f7c62-b704-401c-a9d7-8669da9969c5"). InnerVolumeSpecName "kube-api-access-87v4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:38:37.454754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454714 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.454754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454746 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.454754 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454758 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.455114 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454770 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.455114 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454783 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87v4w\" (UniqueName: \"kubernetes.io/projected/df8f7c62-b704-401c-a9d7-8669da9969c5-kube-api-access-87v4w\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.455114 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454829 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.455114 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.454843 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df8f7c62-b704-401c-a9d7-8669da9969c5-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:38:37.546451 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.546418 2581 generic.go:356] "Generic (PLEG): container finished" podID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerID="1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059" exitCode=0 Jul 06 12:38:37.546635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.546470 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" Jul 06 12:38:37.546635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.546501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" event={"ID":"df8f7c62-b704-401c-a9d7-8669da9969c5","Type":"ContainerDied","Data":"1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059"} Jul 06 12:38:37.546635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.546558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7" event={"ID":"df8f7c62-b704-401c-a9d7-8669da9969c5","Type":"ContainerDied","Data":"ab00c513348390af5a0ec0adb2e9e7376aa1762812f908b222748cda389c6b6d"} Jul 06 12:38:37.546635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.546580 2581 scope.go:117] "RemoveContainer" containerID="1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059" Jul 06 12:38:37.563659 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.563641 2581 scope.go:117] "RemoveContainer" containerID="548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f" Jul 06 12:38:37.572151 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.572131 2581 scope.go:117] "RemoveContainer" containerID="1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059" Jul 06 12:38:37.572408 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:38:37.572385 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059\": container with ID starting with 1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059 not found: ID does not exist" containerID="1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059" Jul 06 12:38:37.572499 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.572415 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059"} err="failed to get container status \"1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059\": rpc error: code = NotFound desc = could not find container \"1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059\": container with ID starting with 1511251121ca394ce85516d0848cbea85848694acf9eb0d77c00e97e715c7059 not found: ID does not exist" Jul 06 12:38:37.572499 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.572435 2581 scope.go:117] "RemoveContainer" containerID="548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f" Jul 06 12:38:37.572677 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:38:37.572659 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f\": container with ID starting with 548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f not found: ID does not exist" containerID="548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f" Jul 06 12:38:37.572731 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.572687 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f"} err="failed to get container status \"548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f\": rpc error: code = NotFound desc = could not find container \"548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f\": container with ID starting with 548da43a40c9cfd307093daa0cb3bd90f9691a6837f7cea8d58024c45b281c1f not found: ID does not exist" Jul 06 12:38:37.579680 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.579653 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7"] Jul 06 12:38:37.584890 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.584865 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-f7711f-openshift-default-65cb54c867-4zzf7"] Jul 06 12:38:37.878506 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:38:37.878476 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" path="/var/lib/kubelet/pods/df8f7c62-b704-401c-a9d7-8669da9969c5/volumes" Jul 06 12:39:18.980731 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:18.980692 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj"] Jul 06 12:39:18.981253 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:18.980939 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" containerID="cri-o://2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554" gracePeriod=30 Jul 06 12:39:24.238882 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.238856 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:39:24.291543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291508 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-envoy\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd86f904-2d79-45de-a3a1-c1e7aff83188-istiod-ca-cert\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291569 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-token\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291586 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-data\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291610 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-socket\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291633 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-certs\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291681 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsflf\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-kube-api-access-nsflf\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291717 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-credential-socket\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.291829 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291760 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-podinfo\") pod \"bd86f904-2d79-45de-a3a1-c1e7aff83188\" (UID: \"bd86f904-2d79-45de-a3a1-c1e7aff83188\") " Jul 06 12:39:24.292204 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.291943 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:24.292204 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.292085 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd86f904-2d79-45de-a3a1-c1e7aff83188-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:39:24.292310 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.292204 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd86f904-2d79-45de-a3a1-c1e7aff83188-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.292310 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.292228 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.292484 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.292447 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:24.292694 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.292646 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:24.292694 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.292660 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:24.294070 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.294045 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:39:24.294267 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.294248 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:24.294341 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.294249 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:39:24.294642 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.294622 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-kube-api-access-nsflf" (OuterVolumeSpecName: "kube-api-access-nsflf") pod "bd86f904-2d79-45de-a3a1-c1e7aff83188" (UID: "bd86f904-2d79-45de-a3a1-c1e7aff83188"). InnerVolumeSpecName "kube-api-access-nsflf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:39:24.393295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393253 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.393295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393286 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.393295 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393299 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.393545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393310 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsflf\" (UniqueName: \"kubernetes.io/projected/bd86f904-2d79-45de-a3a1-c1e7aff83188-kube-api-access-nsflf\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.393545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393324 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.393545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393335 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.393545 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.393345 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd86f904-2d79-45de-a3a1-c1e7aff83188-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:24.808777 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.808740 2581 generic.go:356] "Generic (PLEG): container finished" podID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerID="2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554" exitCode=0 Jul 06 12:39:24.808977 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.808813 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" Jul 06 12:39:24.808977 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.808830 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" event={"ID":"bd86f904-2d79-45de-a3a1-c1e7aff83188","Type":"ContainerDied","Data":"2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554"} Jul 06 12:39:24.808977 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.808885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj" event={"ID":"bd86f904-2d79-45de-a3a1-c1e7aff83188","Type":"ContainerDied","Data":"685f8cc600ae448ffa1d4715792c154f4e298bfee5ad353318f0ca213e5e1276"} Jul 06 12:39:24.808977 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.808908 2581 scope.go:117] "RemoveContainer" containerID="2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554" Jul 06 12:39:24.818733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.818717 2581 scope.go:117] "RemoveContainer" containerID="08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a" Jul 06 12:39:24.826644 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.826627 2581 scope.go:117] "RemoveContainer" containerID="2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554" Jul 06 12:39:24.826911 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:39:24.826891 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554\": container with ID starting with 2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554 not found: ID does not exist" containerID="2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554" Jul 06 12:39:24.826996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.826926 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554"} err="failed to get container status \"2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554\": rpc error: code = NotFound desc = could not find container \"2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554\": container with ID starting with 2dc4b83d0a0f8d3604fc035532b980b66a2fcb542ca830b49565277d4179a554 not found: ID does not exist" Jul 06 12:39:24.826996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.826950 2581 scope.go:117] "RemoveContainer" containerID="08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a" Jul 06 12:39:24.827192 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:39:24.827174 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a\": container with ID starting with 08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a not found: ID does not exist" containerID="08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a" Jul 06 12:39:24.827232 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.827199 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a"} err="failed to get container status \"08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a\": rpc error: code = NotFound desc = could not find container \"08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a\": container with ID starting with 08ab1ba86cd74e4be12f5ed14b87373e40966db15c299a606e709a87ca7e373a not found: ID does not exist" Jul 06 12:39:24.832771 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.832749 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj"] Jul 06 12:39:24.837143 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:24.837124 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-91636e-openshift-default-dc676897-cdnzj"] Jul 06 12:39:25.878922 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:25.878887 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" path="/var/lib/kubelet/pods/bd86f904-2d79-45de-a3a1-c1e7aff83188/volumes" Jul 06 12:39:26.854170 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:26.854134 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c"] Jul 06 12:39:26.854364 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:26.854340 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" containerID="cri-o://dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154" gracePeriod=30 Jul 06 12:39:27.756160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756127 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4"] Jul 06 12:39:27.756569 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756552 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" Jul 06 12:39:27.756616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756570 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" Jul 06 12:39:27.756616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756589 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" Jul 06 12:39:27.756616 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756594 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" Jul 06 12:39:27.756755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756660 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" Jul 06 12:39:27.756755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756669 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" Jul 06 12:39:27.756755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756677 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" Jul 06 12:39:27.756755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.756683 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" Jul 06 12:39:27.761133 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.761117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.764546 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.764523 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e65f56-openshift-default-dockercfg-tp5nb\"" Jul 06 12:39:27.779669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.779646 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4"] Jul 06 12:39:27.826173 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c1082b0-fd49-439b-9d8d-9875526553a5-istiod-ca-cert\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826173 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-credential-socket\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-podinfo\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-certs\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-data\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-socket\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-envoy\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826671 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-token\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.826671 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.826500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhvwg\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-kube-api-access-nhvwg\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927247 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-socket\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-envoy\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-token\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhvwg\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-kube-api-access-nhvwg\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c1082b0-fd49-439b-9d8d-9875526553a5-istiod-ca-cert\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-credential-socket\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927479 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-podinfo\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-certs\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-data\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.927848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927633 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-socket\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.928024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-certs\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.928024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.927935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-data\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.928166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.928139 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-credential-socket\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.928346 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.928329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c1082b0-fd49-439b-9d8d-9875526553a5-istiod-ca-cert\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.929920 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.929892 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-envoy\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.930162 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.930142 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-podinfo\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.935965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.935939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-token\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:27.936050 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:27.936024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhvwg\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-kube-api-access-nhvwg\") pod \"e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:28.071853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.071822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:28.235879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.235854 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4"] Jul 06 12:39:28.237509 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:39:28.237480 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1082b0_fd49_439b_9d8d_9875526553a5.slice/crio-f8aca239cef1b24f7d1dd75b9bc37d1926fd26c59089bbc232b787f061ab5de0 WatchSource:0}: Error finding container f8aca239cef1b24f7d1dd75b9bc37d1926fd26c59089bbc232b787f061ab5de0: Status 404 returned error can't find the container with id f8aca239cef1b24f7d1dd75b9bc37d1926fd26c59089bbc232b787f061ab5de0 Jul 06 12:39:28.239783 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.239744 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:28.239915 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.239845 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:28.239915 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.239894 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:28.835993 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.835954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" event={"ID":"4c1082b0-fd49-439b-9d8d-9875526553a5","Type":"ContainerStarted","Data":"7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb"} Jul 06 12:39:28.836403 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.836011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" event={"ID":"4c1082b0-fd49-439b-9d8d-9875526553a5","Type":"ContainerStarted","Data":"f8aca239cef1b24f7d1dd75b9bc37d1926fd26c59089bbc232b787f061ab5de0"} Jul 06 12:39:28.874101 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:28.874054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podStartSLOduration=1.8740382709999999 podStartE2EDuration="1.874038271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:39:28.871917331 +0000 UTC m=+2113.592906172" watchObservedRunningTime="2026-07-06 12:39:28.874038271 +0000 UTC m=+2113.595027110" Jul 06 12:39:29.072063 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:29.072028 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:29.077298 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:29.077271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:29.842174 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:29.842147 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:29.843070 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:29.843053 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:32.113329 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.113262 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:39:32.168875 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.168841 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-certs\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.168875 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.168880 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-istio-token\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.168914 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-socket\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.168931 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d080094-cec9-427a-a033-5ab67c77c62e-istiod-ca-cert\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.168946 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-data\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.168996 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-credential-socket\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169032 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q79j4\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-kube-api-access-q79j4\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169066 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d080094-cec9-427a-a033-5ab67c77c62e-istio-podinfo\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169122 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169110 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-envoy\") pod \"1d080094-cec9-427a-a033-5ab67c77c62e\" (UID: \"1d080094-cec9-427a-a033-5ab67c77c62e\") " Jul 06 12:39:32.169511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169134 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:32.169511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169257 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:32.169511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169345 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d080094-cec9-427a-a033-5ab67c77c62e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:39:32.169511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169435 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.169511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169452 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.169511 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169466 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d080094-cec9-427a-a033-5ab67c77c62e-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.169852 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169605 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:32.169852 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.169752 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:32.171493 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.171461 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d080094-cec9-427a-a033-5ab67c77c62e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:39:32.171610 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.171533 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:39:32.171716 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.171697 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-kube-api-access-q79j4" (OuterVolumeSpecName: "kube-api-access-q79j4") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "kube-api-access-q79j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:39:32.171776 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.171704 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d080094-cec9-427a-a033-5ab67c77c62e" (UID: "1d080094-cec9-427a-a033-5ab67c77c62e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:39:32.270531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.270502 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.270531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.270528 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.270531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.270536 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.270531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.270547 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q79j4\" (UniqueName: \"kubernetes.io/projected/1d080094-cec9-427a-a033-5ab67c77c62e-kube-api-access-q79j4\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.270841 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.270556 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d080094-cec9-427a-a033-5ab67c77c62e-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.270841 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.270565 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d080094-cec9-427a-a033-5ab67c77c62e-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:39:32.860989 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.860951 2581 generic.go:356] "Generic (PLEG): container finished" podID="1d080094-cec9-427a-a033-5ab67c77c62e" containerID="dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154" exitCode=0 Jul 06 12:39:32.861166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.861000 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" Jul 06 12:39:32.861166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.861041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" event={"ID":"1d080094-cec9-427a-a033-5ab67c77c62e","Type":"ContainerDied","Data":"dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154"} Jul 06 12:39:32.861166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.861101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c" event={"ID":"1d080094-cec9-427a-a033-5ab67c77c62e","Type":"ContainerDied","Data":"cb486566ab121a0091a71483cd3ed1b61829d573f53e27dd0a580e692bce2e17"} Jul 06 12:39:32.861166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.861134 2581 scope.go:117] "RemoveContainer" containerID="dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154" Jul 06 12:39:32.871433 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.871418 2581 scope.go:117] "RemoveContainer" containerID="fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e" Jul 06 12:39:32.879956 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.879937 2581 scope.go:117] "RemoveContainer" containerID="dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154" Jul 06 12:39:32.880188 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:39:32.880169 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154\": container with ID starting with dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154 not found: ID does not exist" containerID="dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154" Jul 06 12:39:32.880248 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.880205 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154"} err="failed to get container status \"dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154\": rpc error: code = NotFound desc = could not find container \"dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154\": container with ID starting with dd8a2435c99a9506e16e7f6e38b3e452cf2c4b24792b23844d3d02151bfa1154 not found: ID does not exist" Jul 06 12:39:32.880248 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.880223 2581 scope.go:117] "RemoveContainer" containerID="fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e" Jul 06 12:39:32.880469 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:39:32.880452 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e\": container with ID starting with fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e not found: ID does not exist" containerID="fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e" Jul 06 12:39:32.880525 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.880478 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e"} err="failed to get container status \"fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e\": rpc error: code = NotFound desc = could not find container \"fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e\": container with ID starting with fda081e3f1250302e5d5d6cf19c16467ea1e658bd4b2bed1780cc1a65dad5d3e not found: ID does not exist" Jul 06 12:39:32.889464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.889442 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c"] Jul 06 12:39:32.893649 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:32.893630 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-77bda8-openshift-default-99ccc4ddf-qfz5c"] Jul 06 12:39:33.877531 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:33.877496 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" path="/var/lib/kubelet/pods/1d080094-cec9-427a-a033-5ab67c77c62e/volumes" Jul 06 12:39:36.329586 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.329550 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s"] Jul 06 12:39:36.329998 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.329956 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" Jul 06 12:39:36.329998 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.329968 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd86f904-2d79-45de-a3a1-c1e7aff83188" containerName="istio-proxy" Jul 06 12:39:36.329998 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.329976 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" Jul 06 12:39:36.329998 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.329982 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" Jul 06 12:39:36.330134 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.330006 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" Jul 06 12:39:36.330134 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.330012 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" Jul 06 12:39:36.330134 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.330021 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" Jul 06 12:39:36.330134 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.330026 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8f7c62-b704-401c-a9d7-8669da9969c5" containerName="istio-proxy" Jul 06 12:39:36.330134 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.330103 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" Jul 06 12:39:36.334713 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.334693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.338432 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.338343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e76514-openshift-default-dockercfg-7xn2m\"" Jul 06 12:39:36.361770 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.361740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s"] Jul 06 12:39:36.409091 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-socket\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-certs\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-podinfo\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djd64\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-kube-api-access-djd64\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-data\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-envoy\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409374 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-token\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409698 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20624e0b-d324-43f8-879a-375cf0e7dd5d-istiod-ca-cert\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.409698 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.409430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-credential-socket\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.510609 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-credential-socket\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.510848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-socket\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.510848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-certs\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.510848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-podinfo\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.510848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djd64\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-kube-api-access-djd64\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.510848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-data\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-envoy\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-token\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.510960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20624e0b-d324-43f8-879a-375cf0e7dd5d-istiod-ca-cert\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.511072 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-credential-socket\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.511087 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-certs\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511431 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.511371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-data\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511633 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.511607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20624e0b-d324-43f8-879a-375cf0e7dd5d-istiod-ca-cert\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.511723 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.511651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-socket\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.513509 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.513489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-envoy\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.513879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.513863 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-podinfo\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.521922 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.521893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-token\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.522353 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.522333 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djd64\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-kube-api-access-djd64\") pod \"e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.652024 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.651934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:36.821010 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.820974 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s"] Jul 06 12:39:36.829213 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:39:36.829184 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20624e0b_d324_43f8_879a_375cf0e7dd5d.slice/crio-3cceb1ea89de7902a377aa93b0ba673ab0b1dd09ec2c55fe322c9750f8a7023c WatchSource:0}: Error finding container 3cceb1ea89de7902a377aa93b0ba673ab0b1dd09ec2c55fe322c9750f8a7023c: Status 404 returned error can't find the container with id 3cceb1ea89de7902a377aa93b0ba673ab0b1dd09ec2c55fe322c9750f8a7023c Jul 06 12:39:36.831455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.831421 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:36.831539 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.831505 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:36.831539 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.831535 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:36.889512 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:36.889232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" event={"ID":"20624e0b-d324-43f8-879a-375cf0e7dd5d","Type":"ContainerStarted","Data":"3cceb1ea89de7902a377aa93b0ba673ab0b1dd09ec2c55fe322c9750f8a7023c"} Jul 06 12:39:37.898179 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:37.898134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" event={"ID":"20624e0b-d324-43f8-879a-375cf0e7dd5d","Type":"ContainerStarted","Data":"4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d"} Jul 06 12:39:37.930198 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:37.930151 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podStartSLOduration=1.9301354179999999 podStartE2EDuration="1.930135418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:39:37.928376044 +0000 UTC m=+2122.649364884" watchObservedRunningTime="2026-07-06 12:39:37.930135418 +0000 UTC m=+2122.651124323" Jul 06 12:39:38.653084 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:38.653041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:38.658216 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:38.658187 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:38.909375 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:38.909276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:38.914277 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:38.914241 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:43.940710 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:43.940679 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerID="7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb" exitCode=0 Jul 06 12:39:43.941102 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:43.940718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" event={"ID":"4c1082b0-fd49-439b-9d8d-9875526553a5","Type":"ContainerDied","Data":"7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb"} Jul 06 12:39:43.941148 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:43.941130 2581 scope.go:117] "RemoveContainer" containerID="7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb" Jul 06 12:39:43.942145 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:43.942113 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:43.942247 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:43.942202 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:43.942311 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:43.942253 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:44.842219 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:44.842181 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:44.948733 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:44.948698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" event={"ID":"4c1082b0-fd49-439b-9d8d-9875526553a5","Type":"ContainerStarted","Data":"287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c"} Jul 06 12:39:45.072669 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:45.072635 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:45.073761 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:45.073727 2581 patch_prober.go:28] interesting pod/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 12:39:45.073925 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:45.073773 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 12:39:46.072367 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:46.072321 2581 patch_prober.go:28] interesting pod/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 12:39:46.072781 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:46.072387 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 12:39:47.072930 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:47.072883 2581 patch_prober.go:28] interesting pod/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 12:39:47.073354 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:47.072957 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 12:39:48.072955 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:48.072916 2581 patch_prober.go:28] interesting pod/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 06 12:39:48.073366 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:48.072973 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 06 12:39:49.077151 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:49.077120 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:49.077556 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:49.077381 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:49.078074 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:49.078058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:39:54.950959 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:54.950915 2581 patch_prober.go:28] interesting pod/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 12:39:54.951386 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:54.950985 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 12:39:56.013385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:56.013356 2581 generic.go:356] "Generic (PLEG): container finished" podID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerID="4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d" exitCode=0 Jul 06 12:39:56.013911 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:56.013435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" event={"ID":"20624e0b-d324-43f8-879a-375cf0e7dd5d","Type":"ContainerDied","Data":"4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d"} Jul 06 12:39:56.013996 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:56.013930 2581 scope.go:117] "RemoveContainer" containerID="4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d" Jul 06 12:39:56.015039 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:56.015001 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:56.015130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:56.015083 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:56.015130 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:56.015115 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:39:57.022300 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:57.022266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" event={"ID":"20624e0b-d324-43f8-879a-375cf0e7dd5d","Type":"ContainerStarted","Data":"5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8"} Jul 06 12:39:57.652863 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:57.652827 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:39:57.653220 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:57.653012 2581 patch_prober.go:28] interesting pod/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 12:39:57.653220 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:57.653064 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 12:39:58.652975 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:58.652937 2581 patch_prober.go:28] interesting pod/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 12:39:58.653385 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:58.653007 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 12:39:59.652363 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:59.652323 2581 patch_prober.go:28] interesting pod/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 12:39:59.652564 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:39:59.652380 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 12:40:00.116249 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:00.116168 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4"] Jul 06 12:40:00.117030 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:00.116998 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" containerID="cri-o://287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c" gracePeriod=30 Jul 06 12:40:00.653235 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:00.653199 2581 patch_prober.go:28] interesting pod/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 06 12:40:00.653425 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:00.653258 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 06 12:40:01.656396 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:01.656366 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:40:01.656763 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:01.656624 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:40:01.657456 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:01.657436 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:40:04.080193 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:04.080156 2581 patch_prober.go:28] interesting pod/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 12:40:04.080592 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:04.080227 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 12:40:05.382197 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.382175 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:40:05.407782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407717 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-socket\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.407782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407749 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-certs\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.407782 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407773 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-data\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c1082b0-fd49-439b-9d8d-9875526553a5-istiod-ca-cert\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407877 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-podinfo\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhvwg\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-kube-api-access-nhvwg\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407958 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-envoy\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.407982 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-token\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408016 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-credential-socket\") pod \"4c1082b0-fd49-439b-9d8d-9875526553a5\" (UID: \"4c1082b0-fd49-439b-9d8d-9875526553a5\") " Jul 06 12:40:05.408061 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408019 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:05.408422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408114 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:05.408422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408318 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:05.408422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408368 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c1082b0-fd49-439b-9d8d-9875526553a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:40:05.408422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408393 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.408422 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408413 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.408668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408429 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.408862 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.408837 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:05.411097 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.411053 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:40:05.411305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.411280 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:05.411305 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.411281 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:40:05.411454 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.411423 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-kube-api-access-nhvwg" (OuterVolumeSpecName: "kube-api-access-nhvwg") pod "4c1082b0-fd49-439b-9d8d-9875526553a5" (UID: "4c1082b0-fd49-439b-9d8d-9875526553a5"). InnerVolumeSpecName "kube-api-access-nhvwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:40:05.508893 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.508861 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.508893 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.508885 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.508893 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.508893 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.508893 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.508901 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c1082b0-fd49-439b-9d8d-9875526553a5-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.509160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.508909 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c1082b0-fd49-439b-9d8d-9875526553a5-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:05.509160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:05.508917 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhvwg\" (UniqueName: \"kubernetes.io/projected/4c1082b0-fd49-439b-9d8d-9875526553a5-kube-api-access-nhvwg\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:06.073300 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.073263 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerID="287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c" exitCode=0 Jul 06 12:40:06.073455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.073310 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" Jul 06 12:40:06.073455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.073352 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" event={"ID":"4c1082b0-fd49-439b-9d8d-9875526553a5","Type":"ContainerDied","Data":"287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c"} Jul 06 12:40:06.073455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.073409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4" event={"ID":"4c1082b0-fd49-439b-9d8d-9875526553a5","Type":"ContainerDied","Data":"f8aca239cef1b24f7d1dd75b9bc37d1926fd26c59089bbc232b787f061ab5de0"} Jul 06 12:40:06.073455 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.073434 2581 scope.go:117] "RemoveContainer" containerID="287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c" Jul 06 12:40:06.084983 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.084962 2581 scope.go:117] "RemoveContainer" containerID="7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb" Jul 06 12:40:06.094349 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.094330 2581 scope.go:117] "RemoveContainer" containerID="287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c" Jul 06 12:40:06.094623 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:40:06.094603 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c\": container with ID starting with 287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c not found: ID does not exist" containerID="287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c" Jul 06 12:40:06.094699 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.094630 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c"} err="failed to get container status \"287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c\": rpc error: code = NotFound desc = could not find container \"287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c\": container with ID starting with 287d9698b9bc8b51c6c84a7fa53fb0fc84299bd70dce73ad9a0cba447cdbbb7c not found: ID does not exist" Jul 06 12:40:06.094699 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.094653 2581 scope.go:117] "RemoveContainer" containerID="7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb" Jul 06 12:40:06.094937 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:40:06.094923 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb\": container with ID starting with 7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb not found: ID does not exist" containerID="7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb" Jul 06 12:40:06.094991 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.094940 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb"} err="failed to get container status \"7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb\": rpc error: code = NotFound desc = could not find container \"7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb\": container with ID starting with 7943db2014afb4d6ed9b30bc81c3eebfcce2c8cb9f472d78cd8969e14e6fcceb not found: ID does not exist" Jul 06 12:40:06.094991 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.094957 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4"] Jul 06 12:40:06.106482 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:06.106451 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e65f56-openshift-default-78b669c977-vzcv4"] Jul 06 12:40:07.877865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:07.877832 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" path="/var/lib/kubelet/pods/4c1082b0-fd49-439b-9d8d-9875526553a5/volumes" Jul 06 12:40:08.111689 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:08.111658 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s"] Jul 06 12:40:08.111930 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:08.111905 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" containerID="cri-o://5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8" gracePeriod=30 Jul 06 12:40:09.061628 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.061600 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc"] Jul 06 12:40:09.062002 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.061988 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" Jul 06 12:40:09.062058 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.062003 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" Jul 06 12:40:09.062058 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.062014 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" Jul 06 12:40:09.062058 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.062019 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" Jul 06 12:40:09.062157 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.062091 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d080094-cec9-427a-a033-5ab67c77c62e" containerName="istio-proxy" Jul 06 12:40:09.062157 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.062099 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" Jul 06 12:40:09.062157 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.062106 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1082b0-fd49-439b-9d8d-9875526553a5" containerName="istio-proxy" Jul 06 12:40:09.066731 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.066715 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.070141 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.070121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4e06f6-openshift-default-dockercfg-hhsg7\"" Jul 06 12:40:09.108844 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.108785 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc"] Jul 06 12:40:09.140855 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.140820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-credential-socket\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.140863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-certs\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.140880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-socket\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.140907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-data\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.140929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjnj\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-kube-api-access-bpjnj\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.140977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-token\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141025 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.141005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-envoy\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141218 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.141049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istiod-ca-cert\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.141218 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.141088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-podinfo\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242019 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.241976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-token\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242234 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-envoy\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242234 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istiod-ca-cert\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242234 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-podinfo\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242234 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-credential-socket\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242499 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-certs\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242499 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-socket\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242499 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-data\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.242499 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.242348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjnj\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-kube-api-access-bpjnj\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.243218 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.243186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-certs\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.243747 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.243416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-data\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.243747 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.243688 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-socket\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.244254 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.244223 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-credential-socket\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.245053 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.245023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istiod-ca-cert\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.245296 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.245272 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-envoy\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.246255 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.246233 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-podinfo\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.255533 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.255514 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjnj\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-kube-api-access-bpjnj\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.270696 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.270677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-token\") pod \"e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.379148 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.379062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:09.533391 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.533357 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc"] Jul 06 12:40:09.534236 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:40:09.534202 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90556fc1_f05c_41f9_a9f9_ead6a2bf978f.slice/crio-44fb668ab0c267d500d44c636520a4bd5917a7e6f0b656a3983099ac51afecb8 WatchSource:0}: Error finding container 44fb668ab0c267d500d44c636520a4bd5917a7e6f0b656a3983099ac51afecb8: Status 404 returned error can't find the container with id 44fb668ab0c267d500d44c636520a4bd5917a7e6f0b656a3983099ac51afecb8 Jul 06 12:40:09.536503 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.536470 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:09.536568 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.536543 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:09.536618 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:09.536575 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:10.098896 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:10.098849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" event={"ID":"90556fc1-f05c-41f9-a9f9-ead6a2bf978f","Type":"ContainerStarted","Data":"08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef"} Jul 06 12:40:10.099317 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:10.098908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" event={"ID":"90556fc1-f05c-41f9-a9f9-ead6a2bf978f","Type":"ContainerStarted","Data":"44fb668ab0c267d500d44c636520a4bd5917a7e6f0b656a3983099ac51afecb8"} Jul 06 12:40:10.140294 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:10.140245 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podStartSLOduration=1.140229335 podStartE2EDuration="1.140229335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:40:10.139168851 +0000 UTC m=+2154.860157702" watchObservedRunningTime="2026-07-06 12:40:10.140229335 +0000 UTC m=+2154.861218172" Jul 06 12:40:10.379848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:10.379745 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:10.384395 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:10.384375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:11.104380 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:11.104351 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:11.105509 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:11.105490 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:13.384045 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.383976 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:40:13.483965 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.483922 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-envoy\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.483990 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-podinfo\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484026 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-certs\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484055 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djd64\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-kube-api-access-djd64\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484082 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-credential-socket\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484167 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484123 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20624e0b-d324-43f8-879a-375cf0e7dd5d-istiod-ca-cert\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484179 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-token\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484267 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-socket\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-data\") pod \"20624e0b-d324-43f8-879a-375cf0e7dd5d\" (UID: \"20624e0b-d324-43f8-879a-375cf0e7dd5d\") " Jul 06 12:40:13.484444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484379 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:13.484444 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484387 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:13.484702 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484601 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.484702 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484607 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:13.484702 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484620 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.484702 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.484640 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20624e0b-d324-43f8-879a-375cf0e7dd5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:40:13.485153 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.485132 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:13.486347 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.486321 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:40:13.486459 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.486384 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:40:13.486601 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.486583 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-kube-api-access-djd64" (OuterVolumeSpecName: "kube-api-access-djd64") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "kube-api-access-djd64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:40:13.486731 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.486624 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20624e0b-d324-43f8-879a-375cf0e7dd5d" (UID: "20624e0b-d324-43f8-879a-375cf0e7dd5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586030 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586073 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djd64\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-kube-api-access-djd64\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586097 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20624e0b-d324-43f8-879a-375cf0e7dd5d-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586111 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586123 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586135 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:13.586848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:13.586152 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20624e0b-d324-43f8-879a-375cf0e7dd5d-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:40:14.124682 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.124651 2581 generic.go:356] "Generic (PLEG): container finished" podID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerID="5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8" exitCode=0 Jul 06 12:40:14.124895 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.124688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" event={"ID":"20624e0b-d324-43f8-879a-375cf0e7dd5d","Type":"ContainerDied","Data":"5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8"} Jul 06 12:40:14.124895 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.124715 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" Jul 06 12:40:14.124895 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.124730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s" event={"ID":"20624e0b-d324-43f8-879a-375cf0e7dd5d","Type":"ContainerDied","Data":"3cceb1ea89de7902a377aa93b0ba673ab0b1dd09ec2c55fe322c9750f8a7023c"} Jul 06 12:40:14.124895 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.124753 2581 scope.go:117] "RemoveContainer" containerID="5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8" Jul 06 12:40:14.133778 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.133757 2581 scope.go:117] "RemoveContainer" containerID="4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d" Jul 06 12:40:14.142939 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.142919 2581 scope.go:117] "RemoveContainer" containerID="5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8" Jul 06 12:40:14.143253 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:40:14.143235 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8\": container with ID starting with 5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8 not found: ID does not exist" containerID="5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8" Jul 06 12:40:14.143302 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.143263 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8"} err="failed to get container status \"5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8\": rpc error: code = NotFound desc = could not find container \"5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8\": container with ID starting with 5779b4535ec2aae2c341ad0106d96816aba26704a91c43d9e5ae6bc0f61d78d8 not found: ID does not exist" Jul 06 12:40:14.143302 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.143280 2581 scope.go:117] "RemoveContainer" containerID="4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d" Jul 06 12:40:14.143507 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:40:14.143492 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d\": container with ID starting with 4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d not found: ID does not exist" containerID="4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d" Jul 06 12:40:14.143549 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.143512 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d"} err="failed to get container status \"4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d\": rpc error: code = NotFound desc = could not find container \"4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d\": container with ID starting with 4ebc9f525470d847103f6bfe99fa5824ef0bbec3c05bb249d360b1718198140d not found: ID does not exist" Jul 06 12:40:14.153836 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.153788 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s"] Jul 06 12:40:14.163119 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:14.163091 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e76514-openshift-default-7ccbbd8dbf-gzg8s"] Jul 06 12:40:15.879502 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:15.879470 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" path="/var/lib/kubelet/pods/20624e0b-d324-43f8-879a-375cf0e7dd5d/volumes" Jul 06 12:40:17.650846 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.650814 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx"] Jul 06 12:40:17.651287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.651226 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" Jul 06 12:40:17.651287 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.651240 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" Jul 06 12:40:17.651361 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.651313 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" Jul 06 12:40:17.655986 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.655968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.659258 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.659237 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b8c37f-openshift-default-dockercfg-xwlbt\"" Jul 06 12:40:17.685924 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.685878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx"] Jul 06 12:40:17.725110 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-data\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725110 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-credential-socket\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istiod-ca-cert\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-socket\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8l4j\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-kube-api-access-g8l4j\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-token\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-certs\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-podinfo\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.725467 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.725434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-envoy\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826590 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-socket\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826590 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8l4j\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-kube-api-access-g8l4j\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826921 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-token\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826921 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-certs\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826921 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-podinfo\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826921 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-envoy\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.826921 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-data\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827169 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-credential-socket\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827169 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.826973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istiod-ca-cert\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827169 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.827024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-socket\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827169 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.827070 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-certs\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827325 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.827306 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-credential-socket\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827372 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.827356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-data\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.827816 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.827776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istiod-ca-cert\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.829453 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.829424 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-podinfo\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.829568 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.829516 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-envoy\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.836075 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.836045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-token\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.836721 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.836700 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8l4j\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-kube-api-access-g8l4j\") pod \"e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:17.967705 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:17.967601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:18.121186 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:18.121157 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx"] Jul 06 12:40:18.122400 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:40:18.122372 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722e7c00_6c4f_49e7_8700_eeaf5d15c099.slice/crio-f2e2ff949f1e1fa5d48f68dc0da74e3f5c2732665c05cdcc21d4ccaa52140d3d WatchSource:0}: Error finding container f2e2ff949f1e1fa5d48f68dc0da74e3f5c2732665c05cdcc21d4ccaa52140d3d: Status 404 returned error can't find the container with id f2e2ff949f1e1fa5d48f68dc0da74e3f5c2732665c05cdcc21d4ccaa52140d3d Jul 06 12:40:18.124821 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:18.124770 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:18.124912 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:18.124850 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:18.124912 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:18.124880 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:18.151692 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:18.151662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" event={"ID":"722e7c00-6c4f-49e7-8700-eeaf5d15c099","Type":"ContainerStarted","Data":"f2e2ff949f1e1fa5d48f68dc0da74e3f5c2732665c05cdcc21d4ccaa52140d3d"} Jul 06 12:40:19.158670 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:19.158631 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" event={"ID":"722e7c00-6c4f-49e7-8700-eeaf5d15c099","Type":"ContainerStarted","Data":"d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd"} Jul 06 12:40:19.193537 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:19.193445 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" podStartSLOduration=2.193409097 podStartE2EDuration="2.193409097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:40:19.191355349 +0000 UTC m=+2163.912344210" watchObservedRunningTime="2026-07-06 12:40:19.193409097 +0000 UTC m=+2163.914397937" Jul 06 12:40:19.968198 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:19.968161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:19.973487 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:19.973458 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:20.164614 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:20.164581 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:20.165893 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:20.165874 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:26.106552 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.106510 2581 patch_prober.go:28] interesting pod/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 06 12:40:26.107166 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.106574 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 06 12:40:26.203171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.203126 2581 generic.go:356] "Generic (PLEG): container finished" podID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerID="08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef" exitCode=0 Jul 06 12:40:26.203383 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.203279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" event={"ID":"90556fc1-f05c-41f9-a9f9-ead6a2bf978f","Type":"ContainerDied","Data":"08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef"} Jul 06 12:40:26.203856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.203831 2581 scope.go:117] "RemoveContainer" containerID="08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef" Jul 06 12:40:26.205558 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.205506 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:26.205657 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.205613 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:26.205714 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:26.205664 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:27.216692 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:27.215789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" event={"ID":"90556fc1-f05c-41f9-a9f9-ead6a2bf978f","Type":"ContainerStarted","Data":"6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486"} Jul 06 12:40:27.380214 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:27.380176 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:27.380588 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:27.380555 2581 patch_prober.go:28] interesting pod/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 06 12:40:27.380644 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:27.380620 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 06 12:40:28.380319 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:28.380287 2581 patch_prober.go:28] interesting pod/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 06 12:40:28.380741 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:28.380343 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 06 12:40:29.379464 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:29.379433 2581 patch_prober.go:28] interesting pod/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 06 12:40:29.379657 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:29.379484 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 06 12:40:30.380321 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:30.380287 2581 patch_prober.go:28] interesting pod/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 06 12:40:30.380673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:30.380342 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 06 12:40:31.399734 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:31.399693 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:31.400245 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:31.400113 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:31.400907 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:31.400885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:40:34.271301 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:34.271262 2581 generic.go:356] "Generic (PLEG): container finished" podID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerID="d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd" exitCode=0 Jul 06 12:40:34.272213 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:34.271340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" event={"ID":"722e7c00-6c4f-49e7-8700-eeaf5d15c099","Type":"ContainerDied","Data":"d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd"} Jul 06 12:40:34.272213 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:34.271927 2581 scope.go:117] "RemoveContainer" containerID="d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd" Jul 06 12:40:34.273333 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:34.273302 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:34.273434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:34.273376 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:34.273434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:34.273413 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 06 12:40:35.164711 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:35.164678 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:35.279355 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:35.279321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" event={"ID":"722e7c00-6c4f-49e7-8700-eeaf5d15c099","Type":"ContainerStarted","Data":"f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c"} Jul 06 12:40:35.967818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:35.967763 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:35.968838 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:35.968814 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 12:40:35.968960 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:35.968860 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 12:40:36.968818 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:36.968752 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 12:40:36.969236 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:36.968847 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 12:40:37.968537 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:37.968508 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 12:40:37.968724 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:37.968569 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 12:40:38.968404 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:38.968366 2581 patch_prober.go:28] interesting pod/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 12:40:38.968856 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:38.968420 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 12:40:39.972663 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:39.972634 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:39.973078 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:39.972926 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:40:39.973543 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:40:39.973525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:46:06.723673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:06.723638 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc"] Jul 06 12:46:06.726187 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:06.723850 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" containerID="cri-o://6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486" gracePeriod=30 Jul 06 12:46:11.988513 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:11.988448 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:46:12.114660 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114618 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-envoy\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114660 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114661 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-podinfo\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114691 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-socket\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114709 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-credential-socket\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114748 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-data\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114769 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpjnj\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-kube-api-access-bpjnj\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114841 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istiod-ca-cert\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114870 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-certs\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.114945 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114898 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-token\") pod \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\" (UID: \"90556fc1-f05c-41f9-a9f9-ead6a2bf978f\") " Jul 06 12:46:12.115307 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.114996 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:12.115307 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.115293 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.115765 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.115505 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:12.115765 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.115535 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:12.115765 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.115737 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-data" (OuterVolumeSpecName: "istio-data") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:12.115765 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.115738 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:46:12.116971 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.116950 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:46:12.117055 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.116984 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:12.117393 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.117372 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-token" (OuterVolumeSpecName: "istio-token") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:46:12.117496 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.117395 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-kube-api-access-bpjnj" (OuterVolumeSpecName: "kube-api-access-bpjnj") pod "90556fc1-f05c-41f9-a9f9-ead6a2bf978f" (UID: "90556fc1-f05c-41f9-a9f9-ead6a2bf978f"). InnerVolumeSpecName "kube-api-access-bpjnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:46:12.134635 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.134600 2581 generic.go:356] "Generic (PLEG): container finished" podID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerID="6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486" exitCode=0 Jul 06 12:46:12.134790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.134644 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" Jul 06 12:46:12.134790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.134676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" event={"ID":"90556fc1-f05c-41f9-a9f9-ead6a2bf978f","Type":"ContainerDied","Data":"6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486"} Jul 06 12:46:12.134790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.134731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc" event={"ID":"90556fc1-f05c-41f9-a9f9-ead6a2bf978f","Type":"ContainerDied","Data":"44fb668ab0c267d500d44c636520a4bd5917a7e6f0b656a3983099ac51afecb8"} Jul 06 12:46:12.134790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.134754 2581 scope.go:117] "RemoveContainer" containerID="6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486" Jul 06 12:46:12.148775 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.148749 2581 scope.go:117] "RemoveContainer" containerID="08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef" Jul 06 12:46:12.158050 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.157871 2581 scope.go:117] "RemoveContainer" containerID="6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486" Jul 06 12:46:12.158430 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:46:12.158401 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486\": container with ID starting with 6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486 not found: ID does not exist" containerID="6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486" Jul 06 12:46:12.158626 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.158438 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486"} err="failed to get container status \"6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486\": rpc error: code = NotFound desc = could not find container \"6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486\": container with ID starting with 6869574a2f9e2b4781531cb15764bce552790ef0e813a9eb88393e767629b486 not found: ID does not exist" Jul 06 12:46:12.158626 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.158470 2581 scope.go:117] "RemoveContainer" containerID="08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef" Jul 06 12:46:12.158769 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:46:12.158737 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef\": container with ID starting with 08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef not found: ID does not exist" containerID="08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef" Jul 06 12:46:12.158854 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.158763 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef"} err="failed to get container status \"08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef\": rpc error: code = NotFound desc = could not find container \"08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef\": container with ID starting with 08622531899cc9fae5650284edd9afba4eca5d1fe0827632f6ce8218398efcef not found: ID does not exist" Jul 06 12:46:12.161401 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.161381 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc"] Jul 06 12:46:12.167198 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.167173 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4e06f6-openshift-default-7fd567975f-bj7xc"] Jul 06 12:46:12.216143 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216118 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216143 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216143 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216143 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216151 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216159 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216168 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216177 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216185 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:12.216352 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:12.216193 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpjnj\" (UniqueName: \"kubernetes.io/projected/90556fc1-f05c-41f9-a9f9-ead6a2bf978f-kube-api-access-bpjnj\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:13.878894 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:13.878859 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" path="/var/lib/kubelet/pods/90556fc1-f05c-41f9-a9f9-ead6a2bf978f/volumes" Jul 06 12:46:14.444722 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:14.444688 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx"] Jul 06 12:46:14.445001 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:14.444976 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" containerID="cri-o://f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c" gracePeriod=30 Jul 06 12:46:15.188181 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:15.188146 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-98d94454b-gzzkr_c751487e-7ae0-4636-86bf-09f539af0f2b/authorino/0.log" Jul 06 12:46:19.701929 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.701901 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:46:19.790678 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790652 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-token\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.790865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790693 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-credential-socket\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.790865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790713 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istiod-ca-cert\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.790865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790735 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-podinfo\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.790865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790774 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8l4j\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-kube-api-access-g8l4j\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.790865 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790852 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-data\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.791171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790886 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-socket\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.791171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790938 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-envoy\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.791171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790958 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:19.791171 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.790980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-certs\") pod \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\" (UID: \"722e7c00-6c4f-49e7-8700-eeaf5d15c099\") " Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791179 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791192 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791249 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791385 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-credential-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791406 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istiod-ca-cert\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791421 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-socket\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.791673 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.791433 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-workload-certs\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.792232 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.792189 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-data" (OuterVolumeSpecName: "istio-data") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:19.793207 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.793181 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-token" (OuterVolumeSpecName: "istio-token") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:46:19.793332 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.793217 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-kube-api-access-g8l4j" (OuterVolumeSpecName: "kube-api-access-g8l4j") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "kube-api-access-g8l4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 12:46:19.793394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.793347 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 12:46:19.793394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.793364 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "722e7c00-6c4f-49e7-8700-eeaf5d15c099" (UID: "722e7c00-6c4f-49e7-8700-eeaf5d15c099"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 12:46:19.892638 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.892613 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-data\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.892638 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.892638 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-envoy\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.892779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.892646 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-token\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.892779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.892653 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/722e7c00-6c4f-49e7-8700-eeaf5d15c099-istio-podinfo\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:19.892779 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:19.892662 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8l4j\" (UniqueName: \"kubernetes.io/projected/722e7c00-6c4f-49e7-8700-eeaf5d15c099-kube-api-access-g8l4j\") on node \"ip-10-0-138-36.ec2.internal\" DevicePath \"\"" Jul 06 12:46:20.190125 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.190044 2581 generic.go:356] "Generic (PLEG): container finished" podID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerID="f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c" exitCode=0 Jul 06 12:46:20.190125 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.190096 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" Jul 06 12:46:20.190312 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.190139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" event={"ID":"722e7c00-6c4f-49e7-8700-eeaf5d15c099","Type":"ContainerDied","Data":"f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c"} Jul 06 12:46:20.190312 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.190198 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx" event={"ID":"722e7c00-6c4f-49e7-8700-eeaf5d15c099","Type":"ContainerDied","Data":"f2e2ff949f1e1fa5d48f68dc0da74e3f5c2732665c05cdcc21d4ccaa52140d3d"} Jul 06 12:46:20.190312 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.190249 2581 scope.go:117] "RemoveContainer" containerID="f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c" Jul 06 12:46:20.199528 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.199511 2581 scope.go:117] "RemoveContainer" containerID="d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd" Jul 06 12:46:20.207553 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.207535 2581 scope.go:117] "RemoveContainer" containerID="f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c" Jul 06 12:46:20.207823 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:46:20.207794 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c\": container with ID starting with f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c not found: ID does not exist" containerID="f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c" Jul 06 12:46:20.207888 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.207833 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c"} err="failed to get container status \"f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c\": rpc error: code = NotFound desc = could not find container \"f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c\": container with ID starting with f3419593ee0ead55ef7ab468c20cd519c285119d505fc813ecf47b5311405e7c not found: ID does not exist" Jul 06 12:46:20.207888 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.207853 2581 scope.go:117] "RemoveContainer" containerID="d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd" Jul 06 12:46:20.208108 ip-10-0-138-36 kubenswrapper[2581]: E0706 12:46:20.208091 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd\": container with ID starting with d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd not found: ID does not exist" containerID="d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd" Jul 06 12:46:20.208163 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.208118 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd"} err="failed to get container status \"d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd\": rpc error: code = NotFound desc = could not find container \"d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd\": container with ID starting with d0bfac3418d3aef9a3c4ddb14b0e775477962df78e0cf66c3dae8a835aa60dcd not found: ID does not exist" Jul 06 12:46:20.213290 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.213267 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx"] Jul 06 12:46:20.225573 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.225553 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b8c37f-openshift-default-65bb9764f5-8ztrx"] Jul 06 12:46:20.678895 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.678867 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722335-f9q7w_ef9318ae-6170-4673-9ef1-145a408cda5f/cleanup/0.log" Jul 06 12:46:20.808322 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:20.808293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722350-jqx4p_1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81/cleanup/0.log" Jul 06 12:46:21.434611 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:21.434580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-9xnnd_47a15c9b-2ef9-4268-bc99-f4c289f7dfdd/copy-manifests/0.log" Jul 06 12:46:21.446331 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:21.446310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-9xnnd_47a15c9b-2ef9-4268-bc99-f4c289f7dfdd/manager/0.log" Jul 06 12:46:21.878312 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:21.878271 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" path="/var/lib/kubelet/pods/722e7c00-6c4f-49e7-8700-eeaf5d15c099/volumes" Jul 06 12:46:22.695573 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.695541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v_ec853eca-a12c-40ed-957e-64e98abf66f9/extract/0.log" Jul 06 12:46:22.705319 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.705297 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v_ec853eca-a12c-40ed-957e-64e98abf66f9/util/0.log" Jul 06 12:46:22.712758 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.712742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v_ec853eca-a12c-40ed-957e-64e98abf66f9/pull/0.log" Jul 06 12:46:22.837104 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.837077 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7_80023010-bca5-4a48-a3c5-7ac39741f0ad/util/0.log" Jul 06 12:46:22.846339 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.846316 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7_80023010-bca5-4a48-a3c5-7ac39741f0ad/pull/0.log" Jul 06 12:46:22.856532 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.856498 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7_80023010-bca5-4a48-a3c5-7ac39741f0ad/extract/0.log" Jul 06 12:46:22.977691 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.977623 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw_a1c1ad52-2317-4895-bae1-8cf9d65f7f4c/util/0.log" Jul 06 12:46:22.985542 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.985524 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw_a1c1ad52-2317-4895-bae1-8cf9d65f7f4c/pull/0.log" Jul 06 12:46:22.993447 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:22.993428 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw_a1c1ad52-2317-4895-bae1-8cf9d65f7f4c/extract/0.log" Jul 06 12:46:23.114005 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:23.113973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv_f132afbe-a3cf-4607-8ba8-68115b353f01/pull/0.log" Jul 06 12:46:23.122168 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:23.122144 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv_f132afbe-a3cf-4607-8ba8-68115b353f01/extract/0.log" Jul 06 12:46:23.129746 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:23.129715 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv_f132afbe-a3cf-4607-8ba8-68115b353f01/util/0.log" Jul 06 12:46:23.253766 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:23.253684 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-98d94454b-gzzkr_c751487e-7ae0-4636-86bf-09f539af0f2b/authorino/0.log" Jul 06 12:46:24.470553 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:24.470523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jn9_e6e4be61-3d57-475c-bc5a-e75809101820/istio-proxy/0.log" Jul 06 12:46:24.747132 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:24.747051 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-6dn4x_07e41a0e-6f9e-41cf-9adc-9de75f603725/kube-auth-proxy/0.log" Jul 06 12:46:25.363887 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:25.363855 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8f795cc85-wb5g9_289d166f-52f9-4437-bf34-553f2d116868/router/0.log" Jul 06 12:46:25.718578 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:25.718490 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rq25w_5c6aadfd-2233-45fe-a5bd-58aad59e3800/main/0.log" Jul 06 12:46:26.091661 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:26.091626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsvhkq_769dd4dd-8770-444e-b325-c95d00d2dd33/main/0.log" Jul 06 12:46:30.614643 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.614607 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26xd8/must-gather-z2jmk"] Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615016 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615029 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615036 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615044 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615073 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615080 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" Jul 06 12:46:30.615160 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615157 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615170 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="20624e0b-d324-43f8-879a-375cf0e7dd5d" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615179 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615188 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615197 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615264 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615273 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90556fc1-f05c-41f9-a9f9-ead6a2bf978f" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615301 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" Jul 06 12:46:30.615411 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.615307 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="722e7c00-6c4f-49e7-8700-eeaf5d15c099" containerName="istio-proxy" Jul 06 12:46:30.618562 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.618540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.621027 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.621006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26xd8\"/\"default-dockercfg-49n4q\"" Jul 06 12:46:30.621165 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.621141 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26xd8\"/\"openshift-service-ca.crt\"" Jul 06 12:46:30.621821 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.621808 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26xd8\"/\"kube-root-ca.crt\"" Jul 06 12:46:30.631442 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.631421 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/must-gather-z2jmk"] Jul 06 12:46:30.796936 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.796897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd5970a4-a14f-45d2-92af-d2911f7ad418-must-gather-output\") pod \"must-gather-z2jmk\" (UID: \"fd5970a4-a14f-45d2-92af-d2911f7ad418\") " pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.797136 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.796951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzvg\" (UniqueName: \"kubernetes.io/projected/fd5970a4-a14f-45d2-92af-d2911f7ad418-kube-api-access-vnzvg\") pod \"must-gather-z2jmk\" (UID: \"fd5970a4-a14f-45d2-92af-d2911f7ad418\") " pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.897640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.897548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd5970a4-a14f-45d2-92af-d2911f7ad418-must-gather-output\") pod \"must-gather-z2jmk\" (UID: \"fd5970a4-a14f-45d2-92af-d2911f7ad418\") " pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.897640 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.897598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzvg\" (UniqueName: \"kubernetes.io/projected/fd5970a4-a14f-45d2-92af-d2911f7ad418-kube-api-access-vnzvg\") pod \"must-gather-z2jmk\" (UID: \"fd5970a4-a14f-45d2-92af-d2911f7ad418\") " pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.897924 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.897905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd5970a4-a14f-45d2-92af-d2911f7ad418-must-gather-output\") pod \"must-gather-z2jmk\" (UID: \"fd5970a4-a14f-45d2-92af-d2911f7ad418\") " pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.907093 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.907068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzvg\" (UniqueName: \"kubernetes.io/projected/fd5970a4-a14f-45d2-92af-d2911f7ad418-kube-api-access-vnzvg\") pod \"must-gather-z2jmk\" (UID: \"fd5970a4-a14f-45d2-92af-d2911f7ad418\") " pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:30.928042 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:30.928014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/must-gather-z2jmk" Jul 06 12:46:31.073700 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:31.073675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/must-gather-z2jmk"] Jul 06 12:46:31.074662 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:46:31.074635 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd5970a4_a14f_45d2_92af_d2911f7ad418.slice/crio-1bc075e6153c4ed0ca3e63ff3b07ee6749c7e95070508ed18e14c945c3c667d0 WatchSource:0}: Error finding container 1bc075e6153c4ed0ca3e63ff3b07ee6749c7e95070508ed18e14c945c3c667d0: Status 404 returned error can't find the container with id 1bc075e6153c4ed0ca3e63ff3b07ee6749c7e95070508ed18e14c945c3c667d0 Jul 06 12:46:31.076678 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:31.076662 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 12:46:31.250902 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:31.250816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/must-gather-z2jmk" event={"ID":"fd5970a4-a14f-45d2-92af-d2911f7ad418","Type":"ContainerStarted","Data":"1bc075e6153c4ed0ca3e63ff3b07ee6749c7e95070508ed18e14c945c3c667d0"} Jul 06 12:46:32.260524 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:32.260439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/must-gather-z2jmk" event={"ID":"fd5970a4-a14f-45d2-92af-d2911f7ad418","Type":"ContainerStarted","Data":"7ce88db7078c0cac2d83f79188ecade2734be8da8b761047234d57b95e13afca"} Jul 06 12:46:32.260524 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:32.260491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/must-gather-z2jmk" event={"ID":"fd5970a4-a14f-45d2-92af-d2911f7ad418","Type":"ContainerStarted","Data":"d475cf092b8d9f96bd7ce29963998735e0318cd151d89e06f75d33fc1ecf2a6b"} Jul 06 12:46:32.284057 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:32.283996 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26xd8/must-gather-z2jmk" podStartSLOduration=1.492822715 podStartE2EDuration="2.283976165s" totalImagesPullingTime="791.15345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:46:32.279719779 +0000 UTC m=+2537.000708619" watchObservedRunningTime="2026-07-06 12:46:32.283976165 +0000 UTC m=+2537.004965006" Jul 06 12:46:33.650879 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:33.650820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jpzwm_526122c7-949b-4d5d-ac90-1643f978892d/global-pull-secret-syncer/0.log" Jul 06 12:46:33.808877 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:33.808846 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hz7cp_c1210dbf-17b6-4f3f-8f12-be26acfcb4b9/konnectivity-agent/0.log" Jul 06 12:46:33.944622 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:33.944534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-36.ec2.internal_71da5c5a834b0330f878adb624359a1d/haproxy/0.log" Jul 06 12:46:38.800853 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:38.800825 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v_ec853eca-a12c-40ed-957e-64e98abf66f9/extract/0.log" Jul 06 12:46:38.841406 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:38.841379 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v_ec853eca-a12c-40ed-957e-64e98abf66f9/util/0.log" Jul 06 12:46:38.870790 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:38.870750 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596td8v_ec853eca-a12c-40ed-957e-64e98abf66f9/pull/0.log" Jul 06 12:46:38.909892 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:38.909859 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7_80023010-bca5-4a48-a3c5-7ac39741f0ad/extract/0.log" Jul 06 12:46:38.948755 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:38.948728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7_80023010-bca5-4a48-a3c5-7ac39741f0ad/util/0.log" Jul 06 12:46:38.981188 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:38.981162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ndlj7_80023010-bca5-4a48-a3c5-7ac39741f0ad/pull/0.log" Jul 06 12:46:39.036468 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.036439 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw_a1c1ad52-2317-4895-bae1-8cf9d65f7f4c/extract/0.log" Jul 06 12:46:39.069419 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.069310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw_a1c1ad52-2317-4895-bae1-8cf9d65f7f4c/util/0.log" Jul 06 12:46:39.130851 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.130774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gwrdw_a1c1ad52-2317-4895-bae1-8cf9d65f7f4c/pull/0.log" Jul 06 12:46:39.196783 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.196718 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv_f132afbe-a3cf-4607-8ba8-68115b353f01/extract/0.log" Jul 06 12:46:39.256715 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.256691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv_f132afbe-a3cf-4607-8ba8-68115b353f01/util/0.log" Jul 06 12:46:39.342203 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.342073 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rftmv_f132afbe-a3cf-4607-8ba8-68115b353f01/pull/0.log" Jul 06 12:46:39.741031 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:39.739690 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-98d94454b-gzzkr_c751487e-7ae0-4636-86bf-09f539af0f2b/authorino/0.log" Jul 06 12:46:43.104984 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.104946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/alertmanager/0.log" Jul 06 12:46:43.144819 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.144770 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb"] Jul 06 12:46:43.152056 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.152026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.170679 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.170643 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb"] Jul 06 12:46:43.235478 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.235441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-proc\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.235668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.235502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-lib-modules\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.235668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.235539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-podres\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.235668 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.235605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-sys\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.236341 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.236312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xln7l\" (UniqueName: \"kubernetes.io/projected/28cd72d5-95f6-49a0-b77a-51d783862598-kube-api-access-xln7l\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.242350 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.242312 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/config-reloader/0.log" Jul 06 12:46:43.308770 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.308742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/kube-rbac-proxy-web/0.log" Jul 06 12:46:43.336990 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.336953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-lib-modules\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.336990 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-podres\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337254 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-sys\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337254 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xln7l\" (UniqueName: \"kubernetes.io/projected/28cd72d5-95f6-49a0-b77a-51d783862598-kube-api-access-xln7l\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337254 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-lib-modules\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337254 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-podres\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337254 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-sys\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337465 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-proc\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.337465 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.337363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28cd72d5-95f6-49a0-b77a-51d783862598-proc\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.348288 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.348262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xln7l\" (UniqueName: \"kubernetes.io/projected/28cd72d5-95f6-49a0-b77a-51d783862598-kube-api-access-xln7l\") pod \"perf-node-gather-daemonset-gbqnb\" (UID: \"28cd72d5-95f6-49a0-b77a-51d783862598\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.365637 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.365560 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/kube-rbac-proxy/0.log" Jul 06 12:46:43.429737 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.429704 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/kube-rbac-proxy-metric/0.log" Jul 06 12:46:43.465016 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.464985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:43.474737 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.474710 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/prom-label-proxy/0.log" Jul 06 12:46:43.562515 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.562464 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_450d9e6b-f709-4a98-92ad-7cd229f9dad5/init-config-reloader/0.log" Jul 06 12:46:43.650388 ip-10-0-138-36 kubenswrapper[2581]: W0706 12:46:43.650347 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod28cd72d5_95f6_49a0_b77a_51d783862598.slice/crio-949032900a4c851944268d0f1bc660f7fab11880179a5fbe0b4d4a873a366e13 WatchSource:0}: Error finding container 949032900a4c851944268d0f1bc660f7fab11880179a5fbe0b4d4a873a366e13: Status 404 returned error can't find the container with id 949032900a4c851944268d0f1bc660f7fab11880179a5fbe0b4d4a873a366e13 Jul 06 12:46:43.653326 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.653300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb"] Jul 06 12:46:43.777791 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.777762 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-242n7_9038e8de-b6a6-428e-982b-24c6d30c9b3c/kube-state-metrics/0.log" Jul 06 12:46:43.858838 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.858812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-242n7_9038e8de-b6a6-428e-982b-24c6d30c9b3c/kube-rbac-proxy-main/0.log" Jul 06 12:46:43.911506 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:43.911430 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-242n7_9038e8de-b6a6-428e-982b-24c6d30c9b3c/kube-rbac-proxy-self/0.log" Jul 06 12:46:44.038783 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.038761 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-287mn_0eec6573-15f6-47fd-a1ae-e207e35876bb/monitoring-plugin/0.log" Jul 06 12:46:44.357100 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.357055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" event={"ID":"28cd72d5-95f6-49a0-b77a-51d783862598","Type":"ContainerStarted","Data":"6068f3fb7dde57ef7a3c37c89c6932b7122f512634885530d3a78edbc0f48115"} Jul 06 12:46:44.357594 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.357131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" event={"ID":"28cd72d5-95f6-49a0-b77a-51d783862598","Type":"ContainerStarted","Data":"949032900a4c851944268d0f1bc660f7fab11880179a5fbe0b4d4a873a366e13"} Jul 06 12:46:44.413575 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.413525 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" podStartSLOduration=1.4135076180000001 podStartE2EDuration="1.413507618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:46:44.410950714 +0000 UTC m=+2549.131939554" watchObservedRunningTime="2026-07-06 12:46:44.413507618 +0000 UTC m=+2549.134496458" Jul 06 12:46:44.548568 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.548539 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlnm7_64a5f68e-e68b-4e74-a543-383b30dac7db/node-exporter/0.log" Jul 06 12:46:44.606445 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.606421 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlnm7_64a5f68e-e68b-4e74-a543-383b30dac7db/kube-rbac-proxy/0.log" Jul 06 12:46:44.639594 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.639519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlnm7_64a5f68e-e68b-4e74-a543-383b30dac7db/init-textfile/0.log" Jul 06 12:46:44.691231 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.691200 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lfdbd_4a69a838-8795-48d9-a809-59452a9b77c5/kube-rbac-proxy-main/0.log" Jul 06 12:46:44.754848 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.754820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lfdbd_4a69a838-8795-48d9-a809-59452a9b77c5/kube-rbac-proxy-self/0.log" Jul 06 12:46:44.804128 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:44.804096 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-lfdbd_4a69a838-8795-48d9-a809-59452a9b77c5/openshift-state-metrics/0.log" Jul 06 12:46:45.234028 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.234003 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c6rb8_d5536358-90d8-4100-8362-dae17cd29991/prometheus-operator/0.log" Jul 06 12:46:45.280114 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.280083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c6rb8_d5536358-90d8-4100-8362-dae17cd29991/kube-rbac-proxy/0.log" Jul 06 12:46:45.362775 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.362695 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-8vcm9_df1de742-8a39-4c77-8198-486bcbd8e845/prometheus-operator-admission-webhook/0.log" Jul 06 12:46:45.364038 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.364006 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:45.748731 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.748694 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6ff54988-zc7n9_0542ee6c-640f-4774-80ca-dfc6b90655aa/thanos-query/0.log" Jul 06 12:46:45.838571 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.838541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6ff54988-zc7n9_0542ee6c-640f-4774-80ca-dfc6b90655aa/kube-rbac-proxy-web/0.log" Jul 06 12:46:45.911190 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.911164 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6ff54988-zc7n9_0542ee6c-640f-4774-80ca-dfc6b90655aa/kube-rbac-proxy/0.log" Jul 06 12:46:45.975953 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:45.975923 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6ff54988-zc7n9_0542ee6c-640f-4774-80ca-dfc6b90655aa/prom-label-proxy/0.log" Jul 06 12:46:46.012767 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:46.012698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6ff54988-zc7n9_0542ee6c-640f-4774-80ca-dfc6b90655aa/kube-rbac-proxy-rules/0.log" Jul 06 12:46:46.055245 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:46.055215 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6ff54988-zc7n9_0542ee6c-640f-4774-80ca-dfc6b90655aa/kube-rbac-proxy-metrics/0.log" Jul 06 12:46:48.877335 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:48.877298 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-gdt29_38b36935-98c5-4b0d-83ee-10ac524d9755/download-server/0.log" Jul 06 12:46:51.114618 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:51.114590 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26lvh_c45130cf-2eca-43f0-8cf9-534403a33df9/dns/0.log" Jul 06 12:46:51.178356 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:51.178320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26lvh_c45130cf-2eca-43f0-8cf9-534403a33df9/kube-rbac-proxy/0.log" Jul 06 12:46:51.381394 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:51.381314 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-gbqnb" Jul 06 12:46:51.481147 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:51.481115 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqb6h_1f1bc1ae-dc7d-4029-a03a-5df0bd8fcf2c/dns-node-resolver/0.log" Jul 06 12:46:52.451703 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:52.451667 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qm75_ee561c3f-af45-41d7-a7ce-3680040d9761/node-ca/0.log" Jul 06 12:46:53.826712 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:53.826684 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jn9_e6e4be61-3d57-475c-bc5a-e75809101820/istio-proxy/0.log" Jul 06 12:46:53.859461 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:53.859427 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jn9_e6e4be61-3d57-475c-bc5a-e75809101820/istio-proxy/0.log" Jul 06 12:46:54.058345 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:54.058275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-6dn4x_07e41a0e-6f9e-41cf-9adc-9de75f603725/kube-auth-proxy/0.log" Jul 06 12:46:54.080319 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:54.080292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-6dn4x_07e41a0e-6f9e-41cf-9adc-9de75f603725/kube-auth-proxy/0.log" Jul 06 12:46:54.493337 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:54.493270 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8f795cc85-wb5g9_289d166f-52f9-4437-bf34-553f2d116868/router/0.log" Jul 06 12:46:54.684333 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:54.684270 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8f795cc85-wb5g9_289d166f-52f9-4437-bf34-553f2d116868/router/0.log" Jul 06 12:46:55.713034 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:55.713011 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p5p77_9fd371b4-8ef9-4bd1-8187-faf157957179/serve-healthcheck-canary/0.log" Jul 06 12:46:55.745405 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:55.745380 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jn9_e6e4be61-3d57-475c-bc5a-e75809101820/istio-proxy/0.log" Jul 06 12:46:55.900571 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:55.900527 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-6dn4x_07e41a0e-6f9e-41cf-9adc-9de75f603725/kube-auth-proxy/0.log" Jul 06 12:46:56.157043 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:56.157014 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8f795cc85-wb5g9_289d166f-52f9-4437-bf34-553f2d116868/router/0.log" Jul 06 12:46:56.582621 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:56.582597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lc7x_ccc8a323-e81a-4a98-b281-1b42b3f17f25/kube-rbac-proxy/0.log" Jul 06 12:46:56.638860 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:56.638823 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lc7x_ccc8a323-e81a-4a98-b281-1b42b3f17f25/exporter/0.log" Jul 06 12:46:56.685940 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:56.685906 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lc7x_ccc8a323-e81a-4a98-b281-1b42b3f17f25/extractor/0.log" Jul 06 12:46:59.437951 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:59.437917 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722335-f9q7w_ef9318ae-6170-4673-9ef1-145a408cda5f/cleanup/0.log" Jul 06 12:46:59.485946 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:59.485916 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722350-jqx4p_1ce1b5c3-3c11-4c7d-bbf4-ad316705bc81/cleanup/0.log" Jul 06 12:46:59.830463 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:59.830434 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-9xnnd_47a15c9b-2ef9-4268-bc99-f4c289f7dfdd/manager/0.log" Jul 06 12:46:59.861603 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:46:59.861581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-9xnnd_47a15c9b-2ef9-4268-bc99-f4c289f7dfdd/copy-manifests/0.log" Jul 06 12:47:01.548434 ip-10-0-138-36 kubenswrapper[2581]: I0706 12:47:01.548389 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d8dd6c8b8-8ncdj_2c7a7e07-858e-41e6-a647-3aa2960c09c0/manager/0.log"