Jul 15 19:14:03.718573 ip-10-0-139-42 systemd[1]: Starting Kubernetes Kubelet... Jul 15 19:14:04.166782 ip-10-0-139-42 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 19:14:04.166782 ip-10-0-139-42 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 19:14:04.166782 ip-10-0-139-42 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 19:14:04.166782 ip-10-0-139-42 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 19:14:04.166782 ip-10-0-139-42 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 19:14:04.168849 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.168738 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 19:14:04.172844 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172829 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:14:04.172844 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172846 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172850 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172854 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172857 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172859 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172862 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172866 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172868 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172871 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172874 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172877 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172879 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172882 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172885 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172887 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172890 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172892 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172900 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172903 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:14:04.172909 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172906 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172908 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172911 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172914 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172917 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172920 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172923 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172925 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172928 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172930 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172933 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172935 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172938 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172940 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172944 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172946 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172949 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172951 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172954 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:14:04.173361 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172958 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172963 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172966 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172969 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172972 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172974 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172977 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172979 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172981 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172984 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172986 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172989 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172991 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172994 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.172996 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173000 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173003 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173006 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173008 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173011 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:14:04.173854 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173013 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173016 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173018 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173021 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173023 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173026 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173028 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173031 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173033 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173036 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173039 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173041 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173044 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173046 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173048 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173051 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173053 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173056 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173059 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173061 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:14:04.174362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173064 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173067 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173069 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173072 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173074 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173077 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173080 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173083 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173086 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173088 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173091 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173094 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173097 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173100 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173102 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173105 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173108 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173111 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173115 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:14:04.174827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.173117 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174784 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174791 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174795 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174799 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174804 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174808 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174811 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174814 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174817 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174820 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174823 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174825 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174829 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174831 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174834 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174837 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174840 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174843 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:14:04.175297 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174846 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174848 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174851 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174853 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174856 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174858 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174861 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174863 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174866 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174868 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174870 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174873 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174876 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174878 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174880 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174884 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174887 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174890 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174898 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174901 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:14:04.175780 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174904 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174906 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174909 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174912 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174914 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174920 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174923 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174926 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174929 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174932 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174935 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174938 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174940 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174943 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174946 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174948 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174951 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174953 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174956 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174959 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:14:04.176262 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174961 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174965 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174968 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174971 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174974 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174976 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174979 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174987 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174990 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174992 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.174995 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175003 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175006 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175009 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175012 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175014 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175022 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175025 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175027 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:14:04.176755 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175030 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175033 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175035 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175038 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175041 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175044 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175046 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175049 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175051 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175054 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175056 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175059 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175061 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175064 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175066 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175069 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175071 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175074 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175076 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175079 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:14:04.177208 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175082 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175085 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175466 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175471 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175475 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175478 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175480 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175483 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175485 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175488 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175490 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175495 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175499 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175502 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175505 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175508 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175511 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175513 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175516 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:14:04.177705 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175519 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175522 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175524 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175527 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175529 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175532 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175534 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175537 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175539 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175542 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175544 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175547 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175549 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175552 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175554 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175557 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175559 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175562 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175566 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175568 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175571 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:14:04.178177 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175574 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175576 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175579 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175582 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175585 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175588 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175590 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175594 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175596 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175599 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175601 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175604 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175607 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175609 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175612 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175614 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175617 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175619 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175621 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175624 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:14:04.178730 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175626 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175629 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175631 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175634 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175636 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175639 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175642 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175644 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175647 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175649 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175652 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175655 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175657 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175660 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175662 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175665 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175667 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175672 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175675 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:14:04.179220 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175678 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175680 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175683 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175686 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175688 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175690 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175693 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175695 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175697 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175700 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175702 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175705 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175710 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175712 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175715 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175717 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175720 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175722 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175725 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:14:04.179687 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175727 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175730 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.175732 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175803 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175817 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175825 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175829 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175846 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175849 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175853 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175857 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175860 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175863 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175867 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175870 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175873 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175876 2581 flags.go:64] FLAG: --cgroup-root="" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175879 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175882 2581 flags.go:64] FLAG: --client-ca-file="" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175885 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175887 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175891 2581 flags.go:64] FLAG: --cluster-domain="" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175894 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175897 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 19:14:04.180250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175900 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175906 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175909 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175912 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175916 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175919 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175923 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175926 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175929 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175932 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175935 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175939 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175942 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175945 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175948 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175952 2581 flags.go:64] FLAG: --enable-server="true" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175955 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175958 2581 flags.go:64] FLAG: --event-burst="100" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175961 2581 flags.go:64] FLAG: --event-qps="50" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175964 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175967 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175970 2581 flags.go:64] FLAG: --eviction-hard="" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175974 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175976 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175979 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 19:14:04.180840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175983 2581 flags.go:64] FLAG: --eviction-soft="" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175985 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175988 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175991 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175994 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.175997 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176000 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176002 2581 flags.go:64] FLAG: --feature-gates="" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176010 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176013 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176016 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176019 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176022 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176027 2581 flags.go:64] FLAG: --help="false" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176030 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176033 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176036 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176038 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176042 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176045 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176048 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176051 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176054 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 19:14:04.181508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176057 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176060 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176063 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176065 2581 flags.go:64] FLAG: --kube-reserved="" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176068 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176071 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176074 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176076 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176079 2581 flags.go:64] FLAG: --lock-file="" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176082 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176085 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176088 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176093 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176096 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176099 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176101 2581 flags.go:64] FLAG: --logging-format="text" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176104 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176109 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176111 2581 flags.go:64] FLAG: --manifest-url="" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176114 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176118 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176121 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176127 2581 flags.go:64] FLAG: --max-pods="110" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176130 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176133 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 19:14:04.182133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176136 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176138 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176142 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176144 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176148 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176154 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176158 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176161 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176164 2581 flags.go:64] FLAG: --pod-cidr="" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176167 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176173 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176176 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176179 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176182 2581 flags.go:64] FLAG: --port="10250" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176185 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176188 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f4de8bcac9101d22" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176191 2581 flags.go:64] FLAG: --qos-reserved="" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176194 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176197 2581 flags.go:64] FLAG: --register-node="true" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176200 2581 flags.go:64] FLAG: --register-with-taints="" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176208 2581 flags.go:64] FLAG: --registry-burst="10" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176211 2581 flags.go:64] FLAG: --registry-qps="5" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176214 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176216 2581 flags.go:64] FLAG: --reserved-memory="" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176222 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 19:14:04.182763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176225 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176228 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176230 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176233 2581 flags.go:64] FLAG: --runonce="false" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176236 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176240 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176243 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176246 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176249 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176252 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176255 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176259 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176262 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176265 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176268 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176272 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176275 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176278 2581 flags.go:64] FLAG: --system-cgroups="" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176280 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176300 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176304 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176306 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176313 2581 flags.go:64] FLAG: --tls-min-version="" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176316 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176319 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 19:14:04.183430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176322 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176325 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176328 2581 flags.go:64] FLAG: --v="2" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176332 2581 flags.go:64] FLAG: --version="false" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176336 2581 flags.go:64] FLAG: --vmodule="" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176339 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.176344 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176458 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176462 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176466 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176469 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176472 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176477 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176480 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176483 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176485 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176488 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176491 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176493 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176496 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176500 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:14:04.184041 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176503 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176506 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176510 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176514 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176517 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176519 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176522 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176525 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176527 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176530 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176533 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176535 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176538 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176540 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176543 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176545 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176548 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176551 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176554 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176556 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:14:04.184605 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176559 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176562 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176564 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176568 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176570 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176573 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176576 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176578 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176581 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176585 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176588 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176591 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176593 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176596 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176598 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176601 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176604 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176606 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176609 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:14:04.185472 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176612 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176614 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176616 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176620 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176624 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176626 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176629 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176632 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176634 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176637 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176640 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176643 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176646 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176648 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176651 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176653 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176657 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176660 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176662 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:14:04.186209 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176665 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176668 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176670 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176673 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176675 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176678 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176681 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176683 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176686 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176689 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176692 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176695 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176697 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176699 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176702 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176704 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176707 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176709 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176712 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176714 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:14:04.186701 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176717 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176719 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176722 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176726 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176728 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176731 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.176733 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.177491 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.186197 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.186214 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.187095 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.187105 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187165 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187172 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187175 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:14:04.187188 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187178 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187182 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187184 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187187 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187190 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187193 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187195 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187198 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187201 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187204 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187207 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187210 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187212 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187215 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187217 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187220 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187224 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187228 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187231 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187234 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:14:04.187576 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187237 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187240 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187243 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187251 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187254 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187257 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187260 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187262 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187265 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187267 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187270 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187272 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187275 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187279 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187283 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187299 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187303 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187306 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187310 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187313 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:14:04.188055 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187316 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187319 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187321 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187325 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187328 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187331 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187334 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187336 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187339 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187341 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187344 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187347 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187349 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187352 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187355 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187357 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187360 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187363 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187365 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187368 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:14:04.188591 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187371 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187375 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187378 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187381 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187383 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187386 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187389 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187392 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187395 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187398 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187401 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187403 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187406 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187409 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187411 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187414 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187416 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187419 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187422 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:14:04.189082 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187424 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187427 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187429 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187432 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187434 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187437 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187439 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187442 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187444 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187447 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187449 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187452 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187457 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187459 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187463 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:14:04.189573 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187465 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.187471 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187598 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187609 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187612 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187615 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187618 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187621 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187624 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187626 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187629 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187632 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187636 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187640 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187644 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 19:14:04.189979 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187647 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187650 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187653 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187656 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187658 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187661 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187663 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187666 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187668 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187671 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187673 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187676 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187678 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187681 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187684 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187686 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187689 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187692 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187695 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187697 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 19:14:04.190459 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187700 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187703 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187707 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187710 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187714 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187717 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187720 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187723 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187725 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187728 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187730 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187733 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187736 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187739 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187741 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187744 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187746 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187749 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187751 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 19:14:04.191056 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187754 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187757 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187759 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187762 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187764 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187767 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187769 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187772 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187774 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187777 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187781 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187784 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187788 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187791 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187794 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187797 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187800 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187802 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187805 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 19:14:04.191566 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187807 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187810 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187813 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187815 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187818 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187821 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187823 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187826 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187828 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187831 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187833 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187836 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187838 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187841 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187843 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187846 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187848 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187851 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187853 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187856 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 19:14:04.192009 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187858 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187861 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187864 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187866 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187869 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187872 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187874 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:04.187877 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.187882 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.188015 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.190533 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.192380 2581 server.go:1019] "Starting client certificate rotation" Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.192488 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 19:14:04.192585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.192526 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 19:14:04.196430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.196411 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 19:14:04.197637 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.197616 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 19:14:04.209801 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.209784 2581 log.go:25] "Validated CRI v1 runtime API" Jul 15 19:14:04.212264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.212249 2581 log.go:25] "Validated CRI v1 image API" Jul 15 19:14:04.213180 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.213165 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 19:14:04.218023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.217997 2581 fs.go:135] Filesystem UUIDs: map[6285e6eb-441e-4fd6-b388-eb97b32c190d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7af5c0f7-234b-41bd-8a9d-e63f898af0b0:/dev/nvme0n1p4] Jul 15 19:14:04.218094 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.218022 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 19:14:04.224651 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.224533 2581 manager.go:216] Machine: {Timestamp:2026-07-15 19:14:04.223227071 +0000 UTC m=+0.367671694 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104438 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211ef2a32e4b7c78fc744db71e7d07 SystemUUID:ec211ef2-a32e-4b7c-78fc-744db71e7d07 BootID:a6abd4a7-1b50-4c1d-ae7e-f415a764e8cc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:e2:db:d5:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:e2:db:d5:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:36:7a:5e:ea:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 19:14:04.224651 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.224640 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 19:14:04.224812 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.224755 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 19:14:04.226675 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.226660 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 19:14:04.228571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.228543 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 19:14:04.229308 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.228574 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 19:14:04.231045 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.231022 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 19:14:04.231132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.231051 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 19:14:04.231132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.231096 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 19:14:04.232272 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.232257 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 19:14:04.233947 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.233937 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 19:14:04.237449 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237438 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 15 19:14:04.237581 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237571 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 19:14:04.237627 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237602 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 15 19:14:04.237627 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237618 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 19:14:04.237711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237635 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 19:14:04.237711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237645 2581 kubelet.go:398] "Adding apiserver pod source" Jul 15 19:14:04.237711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.237654 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 19:14:04.238082 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.238067 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 19:14:04.238132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.238092 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 19:14:04.241272 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.241258 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 19:14:04.243595 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243581 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 19:14:04.243649 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243611 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 19:14:04.243792 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243782 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 19:14:04.243836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243797 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 19:14:04.243836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243804 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 19:14:04.243836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243809 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 19:14:04.243836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243818 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 19:14:04.243836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.243823 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 19:14:04.244413 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.244403 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 19:14:04.244413 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.244412 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 19:14:04.244473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.244419 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 19:14:04.244473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.244425 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 19:14:04.244473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.244433 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 19:14:04.244473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.244441 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 19:14:04.245320 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.245312 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 19:14:04.245320 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.245320 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 19:14:04.248495 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.248480 2581 server.go:1268] "Started kubelet" Jul 15 19:14:04.248787 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.248730 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 19:14:04.248882 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.248810 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 19:14:04.249497 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.249467 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 19:14:04.249666 ip-10-0-139-42 systemd[1]: Started Kubernetes Kubelet. Jul 15 19:14:04.250450 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.250369 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 19:14:04.251242 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.251220 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 19:14:04.251353 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.251260 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 19:14:04.251353 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.251306 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 19:14:04.252133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.252109 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 15 19:14:04.256472 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.256449 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 19:14:04.258530 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.258513 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 19:14:04.258602 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.258525 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 19:14:04.258867 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.258844 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.259339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259320 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 19:14:04.259425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259398 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 19:14:04.259425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259418 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 19:14:04.259543 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259524 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 15 19:14:04.259543 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259538 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 15 19:14:04.259543 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259542 2581 factory.go:55] Registering systemd factory Jul 15 19:14:04.259543 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.259555 2581 factory.go:223] Registration of the systemd container factory successfully Jul 15 19:14:04.260266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.260250 2581 factory.go:153] Registering CRI-O factory Jul 15 19:14:04.260266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.260265 2581 factory.go:223] Registration of the crio container factory successfully Jul 15 19:14:04.260443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.260319 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 19:14:04.260443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.260339 2581 factory.go:103] Registering Raw factory Jul 15 19:14:04.260443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.260352 2581 manager.go:1196] Started watching for new ooms in manager Jul 15 19:14:04.260965 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.259743 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-42.ec2.internal.18c28c76cbfbf3fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-42.ec2.internal,UID:ip-10-0-139-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-42.ec2.internal,},FirstTimestamp:2026-07-15 19:14:04.24845414 +0000 UTC m=+0.392898764,LastTimestamp:2026-07-15 19:14:04.24845414 +0000 UTC m=+0.392898764,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-42.ec2.internal,}" Jul 15 19:14:04.261073 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.260991 2581 manager.go:349] Starting recovery of all containers Jul 15 19:14:04.266482 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.266451 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 19:14:04.266609 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.266487 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 19:14:04.273472 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.273454 2581 manager.go:354] Recovery completed Jul 15 19:14:04.277489 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.277472 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.280173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280154 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.280236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280185 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.280236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280196 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.280699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280687 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 19:14:04.280699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280697 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.280778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280698 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 19:14:04.280778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.280773 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 15 19:14:04.281412 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.281396 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.281476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.281462 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.281519 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.281492 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.282142 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.282130 2581 policy_none.go:49] "None policy: Start" Jul 15 19:14:04.282176 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.282146 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 19:14:04.282176 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.282160 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 19:14:04.283028 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.282841 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-42.ec2.internal.18c28c76cddfec51 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-42.ec2.internal,UID:ip-10-0-139-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-42.ec2.internal,},FirstTimestamp:2026-07-15 19:14:04.280171601 +0000 UTC m=+0.424616228,LastTimestamp:2026-07-15 19:14:04.280171601 +0000 UTC m=+0.424616228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-42.ec2.internal,}" Jul 15 19:14:04.283198 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.283186 2581 policy_none.go:47] "Start" Jul 15 19:14:04.292944 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.292916 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnr8n" Jul 15 19:14:04.296801 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.296733 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-42.ec2.internal.18c28c76cde033f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-42.ec2.internal,UID:ip-10-0-139-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-42.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-42.ec2.internal,},FirstTimestamp:2026-07-15 19:14:04.280189945 +0000 UTC m=+0.424634568,LastTimestamp:2026-07-15 19:14:04.280189945 +0000 UTC m=+0.424634568,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-42.ec2.internal,}" Jul 15 19:14:04.304330 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.304310 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnr8n" Jul 15 19:14:04.311222 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.311155 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-42.ec2.internal.18c28c76cde05bba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-42.ec2.internal,UID:ip-10-0-139-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-42.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-42.ec2.internal,},FirstTimestamp:2026-07-15 19:14:04.280200122 +0000 UTC m=+0.424644746,LastTimestamp:2026-07-15 19:14:04.280200122 +0000 UTC m=+0.424644746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-42.ec2.internal,}" Jul 15 19:14:04.325955 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.325939 2581 manager.go:337] "Starting Device Plugin manager" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.325977 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.325987 2581 server.go:87] "Starting device plugin registration server" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.326247 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.326259 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.326351 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.326439 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.326448 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.326978 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 19:14:04.336339 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.327032 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.401958 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.401908 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 19:14:04.403167 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.403147 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 19:14:04.403230 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.403191 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 19:14:04.403230 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.403217 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 19:14:04.403318 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.403258 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 19:14:04.405637 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.405610 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:14:04.426579 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.426509 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.427464 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.427450 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.427523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.427480 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.427523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.427491 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.427523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.427518 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.438646 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.438625 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.438706 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.438651 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-42.ec2.internal\": node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.465256 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.465232 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.503948 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.503899 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal"] Jul 15 19:14:04.504077 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.503988 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.505612 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.505596 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.505666 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.505628 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.505666 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.505638 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.506885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.506873 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.506988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.506975 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.507032 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507008 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.507562 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507550 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.507622 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507577 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.507622 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507586 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.507622 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507550 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.507741 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507657 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.507741 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.507670 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.508835 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.508816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.508954 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.508844 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:04.509494 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.509476 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:04.509587 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.509508 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:04.509587 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.509522 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:04.524914 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.524887 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-42.ec2.internal\" not found" node="ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.528337 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.528318 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-42.ec2.internal\" not found" node="ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.561245 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.561213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06089b923710f2d2feae9e9599b422d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal\" (UID: \"06089b923710f2d2feae9e9599b422d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.561407 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.561248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06089b923710f2d2feae9e9599b422d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal\" (UID: \"06089b923710f2d2feae9e9599b422d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.561407 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.561279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1edd94a745f603ae25b0ce87a74b4849-config\") pod \"kube-apiserver-proxy-ip-10-0-139-42.ec2.internal\" (UID: \"1edd94a745f603ae25b0ce87a74b4849\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.566339 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.566311 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.661446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.661410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06089b923710f2d2feae9e9599b422d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal\" (UID: \"06089b923710f2d2feae9e9599b422d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.661446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.661448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06089b923710f2d2feae9e9599b422d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal\" (UID: \"06089b923710f2d2feae9e9599b422d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.661658 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.661466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1edd94a745f603ae25b0ce87a74b4849-config\") pod \"kube-apiserver-proxy-ip-10-0-139-42.ec2.internal\" (UID: \"1edd94a745f603ae25b0ce87a74b4849\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.661658 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.661512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1edd94a745f603ae25b0ce87a74b4849-config\") pod \"kube-apiserver-proxy-ip-10-0-139-42.ec2.internal\" (UID: \"1edd94a745f603ae25b0ce87a74b4849\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.661658 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.661536 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06089b923710f2d2feae9e9599b422d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal\" (UID: \"06089b923710f2d2feae9e9599b422d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.661658 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.661545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06089b923710f2d2feae9e9599b422d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal\" (UID: \"06089b923710f2d2feae9e9599b422d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.666957 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.666937 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.767209 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.767146 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.831254 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.831214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.831382 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:04.831213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:04.868129 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.868097 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:04.969147 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:04.969109 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:05.070317 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:05.070216 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:05.170690 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:05.170652 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:05.192047 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.192008 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 19:14:05.192201 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.192181 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 19:14:05.271416 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:05.271384 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:05.274151 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.274135 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:14:05.307996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.307946 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:09:04 +0000 UTC" deadline="2028-03-14 16:18:50.540538603 +0000 UTC" Jul 15 19:14:05.307996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.307992 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14589h4m45.232550046s" Jul 15 19:14:05.371848 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:05.371754 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:05.432421 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.432400 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 19:14:05.433863 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.433845 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientMemory" Jul 15 19:14:05.433968 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.433877 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 19:14:05.433968 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.433889 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeHasSufficientPID" Jul 15 19:14:05.472604 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:05.472577 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-42.ec2.internal\" not found" Jul 15 19:14:05.481791 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.481768 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:14:05.529891 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.529863 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:14:05.541912 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:05.541878 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06089b923710f2d2feae9e9599b422d3.slice/crio-17d3800e8097c06a2b080bc1c5ba57730075ca84fb4ff9fb5853e3b00bd522ef WatchSource:0}: Error finding container 17d3800e8097c06a2b080bc1c5ba57730075ca84fb4ff9fb5853e3b00bd522ef: Status 404 returned error can't find the container with id 17d3800e8097c06a2b080bc1c5ba57730075ca84fb4ff9fb5853e3b00bd522ef Jul 15 19:14:05.542140 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:05.542124 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edd94a745f603ae25b0ce87a74b4849.slice/crio-9d4750ae008e18b086f8aa585aa470974dffc12c14168b1e2c4adc456e59eebb WatchSource:0}: Error finding container 9d4750ae008e18b086f8aa585aa470974dffc12c14168b1e2c4adc456e59eebb: Status 404 returned error can't find the container with id 9d4750ae008e18b086f8aa585aa470974dffc12c14168b1e2c4adc456e59eebb Jul 15 19:14:05.546908 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.546889 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 19:14:05.559010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.558992 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" Jul 15 19:14:05.569336 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.569306 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 19:14:05.570349 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.570334 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" Jul 15 19:14:05.590656 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:05.590626 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 19:14:06.135499 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.135460 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 19:14:06.241360 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.241313 2581 apiserver.go:52] "Watching apiserver" Jul 15 19:14:06.252888 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.252853 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 19:14:06.253301 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.253276 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal","openshift-multus/multus-additional-cni-plugins-j4k8g","openshift-multus/network-metrics-daemon-zttsd","openshift-network-diagnostics/network-check-target-2jt9m","openshift-network-operator/iptables-alerter-xtz6v","kube-system/global-pull-secret-syncer-xv76q","kube-system/konnectivity-agent-8vnrz","kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal","openshift-cluster-node-tuning-operator/tuned-d7psk","openshift-multus/multus-th7vc","openshift-ovn-kubernetes/ovnkube-node-2h95x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v","openshift-dns/node-resolver-s8pgs","openshift-image-registry/node-ca-nvjrg"] Jul 15 19:14:06.254888 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.254866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.256276 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.256184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.257618 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.257481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.257618 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.257579 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:06.257905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.257890 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.257983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.257893 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.258231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.258215 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 19:14:06.258332 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.258280 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 19:14:06.258585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.258565 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hf7f7\"" Jul 15 19:14:06.258736 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.258716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.259079 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.259059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 19:14:06.259327 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.259308 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 19:14:06.259748 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.259727 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.259748 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.259746 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wftx6\"" Jul 15 19:14:06.259891 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.259787 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 19:14:06.259995 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.259979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.260740 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.260721 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 19:14:06.261279 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.261258 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 19:14:06.261771 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.261751 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.262586 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.262562 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 19:14:06.262686 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.262676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 19:14:06.262949 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.262929 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hlbvl\"" Jul 15 19:14:06.263229 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.263212 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.263735 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.263716 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 19:14:06.263840 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.263774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.264593 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.263997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mqnx7\"" Jul 15 19:14:06.264593 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.264449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.267285 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.266843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.267285 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.267131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.267874 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.267857 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 19:14:06.267973 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.267860 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 19:14:06.268159 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.268140 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jn9lv\"" Jul 15 19:14:06.268467 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.268446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.268565 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.268523 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:06.269256 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmdg\" (UniqueName: \"kubernetes.io/projected/78f93904-f3eb-4460-8064-82eeb57518fd-kube-api-access-qlmdg\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.269380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-socket-dir-parent\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-kubelet\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-node-log\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-log-socket\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovnkube-script-lib\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.269570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fda9597-4e31-4cf3-aefa-a6f2c134eef7-konnectivity-ca\") pod \"konnectivity-agent-8vnrz\" (UID: \"1fda9597-4e31-4cf3-aefa-a6f2c134eef7\") " pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.269570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-system-cni-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-netns\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovnkube-config\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-cnibin\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24a95593-32ba-4cd1-8574-383495d9428c-cni-binary-copy\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24a95593-32ba-4cd1-8574-383495d9428c-multus-daemon-config\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwhk\" (UniqueName: \"kubernetes.io/projected/24a95593-32ba-4cd1-8574-383495d9428c-kube-api-access-njwhk\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-slash\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fda9597-4e31-4cf3-aefa-a6f2c134eef7-agent-certs\") pod \"konnectivity-agent-8vnrz\" (UID: \"1fda9597-4e31-4cf3-aefa-a6f2c134eef7\") " pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:06.269816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-cni-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-k8s-cni-cncf-io\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.269839 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-cni-bin\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-cni-multus\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-conf-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-kubelet\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-env-overrides\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.269999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-etc-kubernetes\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-systemd\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-var-lib-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-etc-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmsk7\" (UniqueName: \"kubernetes.io/projected/9895e04d-f9bf-4c34-a9ee-f5931658d361-kube-api-access-dmsk7\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-hostroot\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-systemd-units\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-cni-bin\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovn-node-metrics-cert\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.270299 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270295 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v7vl\" (UniqueName: \"kubernetes.io/projected/1c3cdddf-7f56-4e85-b223-876eeb838b8d-kube-api-access-9v7vl\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270452 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9895e04d-f9bf-4c34-a9ee-f5931658d361-iptables-alerter-script\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9895e04d-f9bf-4c34-a9ee-f5931658d361-host-slash\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-run-netns\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270558 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c58dr\"" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-cni-netd\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-os-release\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-multus-certs\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-ovn\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.271155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.270798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t9ds6\"" Jul 15 19:14:06.271667 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.271320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.273033 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.273013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.276235 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 19:14:06.276357 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276267 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f6vkg\"" Jul 15 19:14:06.276782 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.276782 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276574 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.276782 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276626 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 19:14:06.276782 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 19:14:06.277026 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.276894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ds4fg\"" Jul 15 19:14:06.277085 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.277031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 19:14:06.277935 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.277911 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 19:14:06.295002 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.294979 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gs24" Jul 15 19:14:06.304618 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.304595 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gs24" Jul 15 19:14:06.360748 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.360722 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 19:14:06.371785 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.371746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-etc-kubernetes\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.371785 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.371793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-lib-modules\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.372037 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.371818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-env-overrides\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372037 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.371844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:06.372037 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.371880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-etc-kubernetes\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.372037 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.371916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrpkv\" (UniqueName: \"kubernetes.io/projected/53beb8ca-3a02-43a0-b336-0371ba1d617b-kube-api-access-vrpkv\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-var-lib-kubelet\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-systemd\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-etc-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmsk7\" (UniqueName: \"kubernetes.io/projected/9895e04d-f9bf-4c34-a9ee-f5931658d361-kube-api-access-dmsk7\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372222 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-systemd\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-system-cni-dir\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-etc-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkxlh\" (UniqueName: \"kubernetes.io/projected/460a3ee1-e245-4eaa-a386-2be5e8376183-kube-api-access-vkxlh\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863e847e-a9ad-4621-8e81-fb8a2060f55f-dbus\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-env-overrides\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-cni-bin\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovn-node-metrics-cert\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v7vl\" (UniqueName: \"kubernetes.io/projected/1c3cdddf-7f56-4e85-b223-876eeb838b8d-kube-api-access-9v7vl\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372590 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-cni-bin\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9895e04d-f9bf-4c34-a9ee-f5931658d361-iptables-alerter-script\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67c3a73f-e3a4-448e-8f9e-6dff833136dd-tmp\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-tmp-dir\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.372699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqqqv\" (UniqueName: \"kubernetes.io/projected/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-kube-api-access-pqqqv\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-multus-certs\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-socket-dir-parent\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-cnibin\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-node-log\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovnkube-script-lib\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-multus-certs\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-node-log\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fda9597-4e31-4cf3-aefa-a6f2c134eef7-konnectivity-ca\") pod \"konnectivity-agent-8vnrz\" (UID: \"1fda9597-4e31-4cf3-aefa-a6f2c134eef7\") " pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-netns\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24a95593-32ba-4cd1-8574-383495d9428c-multus-daemon-config\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/980ab03e-aafb-4f74-833b-9085a8080638-host\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-device-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-cnibin\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.373345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysctl-conf\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-run\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.373286 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4q5z\" (UniqueName: \"kubernetes.io/projected/67c3a73f-e3a4-448e-8f9e-6dff833136dd-kube-api-access-b4q5z\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-slash\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.373359 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:14:06.873336177 +0000 UTC m=+3.017780811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-slash\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-conf-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.372929 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovnkube-script-lib\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-socket-dir-parent\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-conf-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-netns\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.373950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fda9597-4e31-4cf3-aefa-a6f2c134eef7-konnectivity-ca\") pod \"konnectivity-agent-8vnrz\" (UID: \"1fda9597-4e31-4cf3-aefa-a6f2c134eef7\") " pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-registration-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.374237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-cni-binary-copy\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-modprobe-d\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374127 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9895e04d-f9bf-4c34-a9ee-f5931658d361-iptables-alerter-script\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-kubelet\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-systemd\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-cnibin\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-host\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374210 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24a95593-32ba-4cd1-8574-383495d9428c-multus-daemon-config\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-hosts-file\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-kubelet\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-var-lib-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-hostroot\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-sys-fs\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysconfig\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-var-lib-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374449 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-hostroot\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysctl-d\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.375135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-systemd-units\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9895e04d-f9bf-4c34-a9ee-f5931658d361-host-slash\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/980ab03e-aafb-4f74-833b-9085a8080638-serviceca\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-systemd-units\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9895e04d-f9bf-4c34-a9ee-f5931658d361-host-slash\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-sys\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-run-netns\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-cni-netd\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-os-release\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-cni-netd\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374835 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-run-netns\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-os-release\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-os-release\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-tuned\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-ovn\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.374994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmdg\" (UniqueName: \"kubernetes.io/projected/78f93904-f3eb-4460-8064-82eeb57518fd-kube-api-access-qlmdg\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-kubelet\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.376118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375047 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-ovn\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-kubelet\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-log-socket\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-log-socket\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-system-cni-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njwhk\" (UniqueName: \"kubernetes.io/projected/24a95593-32ba-4cd1-8574-383495d9428c-kube-api-access-njwhk\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-socket-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njj8z\" (UniqueName: \"kubernetes.io/projected/980ab03e-aafb-4f74-833b-9085a8080638-kube-api-access-njj8z\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-kubernetes\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375474 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-system-cni-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863e847e-a9ad-4621-8e81-fb8a2060f55f-kubelet-config\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovnkube-config\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24a95593-32ba-4cd1-8574-383495d9428c-cni-binary-copy\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.377010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fda9597-4e31-4cf3-aefa-a6f2c134eef7-agent-certs\") pod \"konnectivity-agent-8vnrz\" (UID: \"1fda9597-4e31-4cf3-aefa-a6f2c134eef7\") " pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-cni-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-k8s-cni-cncf-io\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-cni-bin\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.375960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-cni-multus\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-cni-multus\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c3cdddf-7f56-4e85-b223-876eeb838b8d-run-openvswitch\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376192 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovnkube-config\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24a95593-32ba-4cd1-8574-383495d9428c-cni-binary-copy\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376262 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-run-k8s-cni-cncf-io\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-host-var-lib-cni-bin\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.377997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.376440 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a95593-32ba-4cd1-8574-383495d9428c-multus-cni-dir\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.378693 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.378540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c3cdddf-7f56-4e85-b223-876eeb838b8d-ovn-node-metrics-cert\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.379226 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.379201 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fda9597-4e31-4cf3-aefa-a6f2c134eef7-agent-certs\") pod \"konnectivity-agent-8vnrz\" (UID: \"1fda9597-4e31-4cf3-aefa-a6f2c134eef7\") " pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.385899 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.385826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v7vl\" (UniqueName: \"kubernetes.io/projected/1c3cdddf-7f56-4e85-b223-876eeb838b8d-kube-api-access-9v7vl\") pod \"ovnkube-node-2h95x\" (UID: \"1c3cdddf-7f56-4e85-b223-876eeb838b8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.389695 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.387323 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmsk7\" (UniqueName: \"kubernetes.io/projected/9895e04d-f9bf-4c34-a9ee-f5931658d361-kube-api-access-dmsk7\") pod \"iptables-alerter-xtz6v\" (UID: \"9895e04d-f9bf-4c34-a9ee-f5931658d361\") " pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.389695 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.387681 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmdg\" (UniqueName: \"kubernetes.io/projected/78f93904-f3eb-4460-8064-82eeb57518fd-kube-api-access-qlmdg\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.391117 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.391073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwhk\" (UniqueName: \"kubernetes.io/projected/24a95593-32ba-4cd1-8574-383495d9428c-kube-api-access-njwhk\") pod \"multus-th7vc\" (UID: \"24a95593-32ba-4cd1-8574-383495d9428c\") " pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.407698 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.407644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" event={"ID":"1edd94a745f603ae25b0ce87a74b4849","Type":"ContainerStarted","Data":"9d4750ae008e18b086f8aa585aa470974dffc12c14168b1e2c4adc456e59eebb"} Jul 15 19:14:06.409098 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.409055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" event={"ID":"06089b923710f2d2feae9e9599b422d3","Type":"ContainerStarted","Data":"17d3800e8097c06a2b080bc1c5ba57730075ca84fb4ff9fb5853e3b00bd522ef"} Jul 15 19:14:06.476754 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-system-cni-dir\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.476754 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkxlh\" (UniqueName: \"kubernetes.io/projected/460a3ee1-e245-4eaa-a386-2be5e8376183-kube-api-access-vkxlh\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863e847e-a9ad-4621-8e81-fb8a2060f55f-dbus\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67c3a73f-e3a4-448e-8f9e-6dff833136dd-tmp\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-tmp-dir\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-system-cni-dir\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqqqv\" (UniqueName: \"kubernetes.io/projected/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-kube-api-access-pqqqv\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.476955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-cnibin\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.477023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/980ab03e-aafb-4f74-833b-9085a8080638-host\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-device-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863e847e-a9ad-4621-8e81-fb8a2060f55f-dbus\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysctl-conf\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-run\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4q5z\" (UniqueName: \"kubernetes.io/projected/67c3a73f-e3a4-448e-8f9e-6dff833136dd-kube-api-access-b4q5z\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-registration-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-cni-binary-copy\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-modprobe-d\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-systemd\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-host\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-hosts-file\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-sys-fs\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysconfig\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysctl-d\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477399 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-tmp-dir\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.477475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/980ab03e-aafb-4f74-833b-9085a8080638-serviceca\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-sys\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-os-release\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.477546 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477592 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-sys\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.477609 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:14:06.977587408 +0000 UTC m=+3.122032026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477864 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-registration-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.477967 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/980ab03e-aafb-4f74-833b-9085a8080638-serviceca\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478130 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysctl-conf\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-cni-binary-copy\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-systemd\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-device-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478228 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-cnibin\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysconfig\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-sys-fs\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-run\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.478397 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-modprobe-d\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-hosts-file\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478354 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/980ab03e-aafb-4f74-833b-9085a8080638-host\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-tuned\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-sysctl-d\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478421 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-host\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-os-release\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-socket-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njj8z\" (UniqueName: \"kubernetes.io/projected/980ab03e-aafb-4f74-833b-9085a8080638-kube-api-access-njj8z\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/460a3ee1-e245-4eaa-a386-2be5e8376183-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-kubernetes\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.478936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-kubernetes\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53beb8ca-3a02-43a0-b336-0371ba1d617b-socket-dir\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863e847e-a9ad-4621-8e81-fb8a2060f55f-kubelet-config\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.479273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863e847e-a9ad-4621-8e81-fb8a2060f55f-kubelet-config\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-lib-modules\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479439 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-lib-modules\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrpkv\" (UniqueName: \"kubernetes.io/projected/53beb8ca-3a02-43a0-b336-0371ba1d617b-kube-api-access-vrpkv\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-var-lib-kubelet\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.479787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67c3a73f-e3a4-448e-8f9e-6dff833136dd-var-lib-kubelet\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.480072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67c3a73f-e3a4-448e-8f9e-6dff833136dd-tmp\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.480174 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.480152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/460a3ee1-e245-4eaa-a386-2be5e8376183-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.480976 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.480932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67c3a73f-e3a4-448e-8f9e-6dff833136dd-etc-tuned\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.487312 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.486641 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:06.487312 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.486663 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:06.487312 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.486677 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:06.487312 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.486744 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:14:06.986725697 +0000 UTC m=+3.131170333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:06.489820 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.489793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4q5z\" (UniqueName: \"kubernetes.io/projected/67c3a73f-e3a4-448e-8f9e-6dff833136dd-kube-api-access-b4q5z\") pod \"tuned-d7psk\" (UID: \"67c3a73f-e3a4-448e-8f9e-6dff833136dd\") " pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.490345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.490205 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqqqv\" (UniqueName: \"kubernetes.io/projected/d15bbcc7-4e83-4761-adce-d5d6e90dcbd3-kube-api-access-pqqqv\") pod \"node-resolver-s8pgs\" (UID: \"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3\") " pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.490851 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.490828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkxlh\" (UniqueName: \"kubernetes.io/projected/460a3ee1-e245-4eaa-a386-2be5e8376183-kube-api-access-vkxlh\") pod \"multus-additional-cni-plugins-j4k8g\" (UID: \"460a3ee1-e245-4eaa-a386-2be5e8376183\") " pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.491197 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.491051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njj8z\" (UniqueName: \"kubernetes.io/projected/980ab03e-aafb-4f74-833b-9085a8080638-kube-api-access-njj8z\") pod \"node-ca-nvjrg\" (UID: \"980ab03e-aafb-4f74-833b-9085a8080638\") " pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.492353 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.492329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrpkv\" (UniqueName: \"kubernetes.io/projected/53beb8ca-3a02-43a0-b336-0371ba1d617b-kube-api-access-vrpkv\") pod \"aws-ebs-csi-driver-node-n2x2v\" (UID: \"53beb8ca-3a02-43a0-b336-0371ba1d617b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.571892 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.571850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-th7vc" Jul 15 19:14:06.578437 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.578413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:06.586425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.586398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:06.594258 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.594236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtz6v" Jul 15 19:14:06.602017 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.601987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" Jul 15 19:14:06.607852 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.607827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d7psk" Jul 15 19:14:06.616499 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.616436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s8pgs" Jul 15 19:14:06.624514 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.624491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" Jul 15 19:14:06.630383 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.630352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nvjrg" Jul 15 19:14:06.842846 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.842811 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980ab03e_aafb_4f74_833b_9085a8080638.slice/crio-696297ec8ac8682aa4d047cae324ddea532d9a86d9b77d5e5a81448ee2ed0068 WatchSource:0}: Error finding container 696297ec8ac8682aa4d047cae324ddea532d9a86d9b77d5e5a81448ee2ed0068: Status 404 returned error can't find the container with id 696297ec8ac8682aa4d047cae324ddea532d9a86d9b77d5e5a81448ee2ed0068 Jul 15 19:14:06.843827 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.843802 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3cdddf_7f56_4e85_b223_876eeb838b8d.slice/crio-5db51e835d35d2fd6e1022c0b50e0e3b40b725e0d847839bde9695161fed21f8 WatchSource:0}: Error finding container 5db51e835d35d2fd6e1022c0b50e0e3b40b725e0d847839bde9695161fed21f8: Status 404 returned error can't find the container with id 5db51e835d35d2fd6e1022c0b50e0e3b40b725e0d847839bde9695161fed21f8 Jul 15 19:14:06.847557 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.847534 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c3a73f_e3a4_448e_8f9e_6dff833136dd.slice/crio-c8942ad384d922d3a9672a04f880e7dee2b861d984be1d26558eb79f19639b0d WatchSource:0}: Error finding container c8942ad384d922d3a9672a04f880e7dee2b861d984be1d26558eb79f19639b0d: Status 404 returned error can't find the container with id c8942ad384d922d3a9672a04f880e7dee2b861d984be1d26558eb79f19639b0d Jul 15 19:14:06.869201 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.869161 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15bbcc7_4e83_4761_adce_d5d6e90dcbd3.slice/crio-c3475da94f3e854209cca3354e601b36932894fe996332cc795e5d6cefa013d0 WatchSource:0}: Error finding container c3475da94f3e854209cca3354e601b36932894fe996332cc795e5d6cefa013d0: Status 404 returned error can't find the container with id c3475da94f3e854209cca3354e601b36932894fe996332cc795e5d6cefa013d0 Jul 15 19:14:06.870019 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.869960 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460a3ee1_e245_4eaa_a386_2be5e8376183.slice/crio-fea63d106deda3351519fc36c3c1494a317909f9d509c9ad4a71c966d9f07917 WatchSource:0}: Error finding container fea63d106deda3351519fc36c3c1494a317909f9d509c9ad4a71c966d9f07917: Status 404 returned error can't find the container with id fea63d106deda3351519fc36c3c1494a317909f9d509c9ad4a71c966d9f07917 Jul 15 19:14:06.871124 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.871103 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a95593_32ba_4cd1_8574_383495d9428c.slice/crio-e2e7f25e4f7f7b22d51acdfe40281bc87b31854a57a02088fcf2e9aa59e3a2b1 WatchSource:0}: Error finding container e2e7f25e4f7f7b22d51acdfe40281bc87b31854a57a02088fcf2e9aa59e3a2b1: Status 404 returned error can't find the container with id e2e7f25e4f7f7b22d51acdfe40281bc87b31854a57a02088fcf2e9aa59e3a2b1 Jul 15 19:14:06.872285 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.872266 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9895e04d_f9bf_4c34_a9ee_f5931658d361.slice/crio-ebd4066c25c070852473afc5d2b366a1211fd0713491fb40636805ae8d52661a WatchSource:0}: Error finding container ebd4066c25c070852473afc5d2b366a1211fd0713491fb40636805ae8d52661a: Status 404 returned error can't find the container with id ebd4066c25c070852473afc5d2b366a1211fd0713491fb40636805ae8d52661a Jul 15 19:14:06.873725 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.873649 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53beb8ca_3a02_43a0_b336_0371ba1d617b.slice/crio-d008d49338427aaf0e2bf44afba926799a2ae535a575c2f610bd03ba7c63859a WatchSource:0}: Error finding container d008d49338427aaf0e2bf44afba926799a2ae535a575c2f610bd03ba7c63859a: Status 404 returned error can't find the container with id d008d49338427aaf0e2bf44afba926799a2ae535a575c2f610bd03ba7c63859a Jul 15 19:14:06.875138 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:06.875079 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fda9597_4e31_4cf3_aefa_a6f2c134eef7.slice/crio-4af9abb1a6d85decba3ab4e209c4916c79e83a34fab5240a487cbc24555c0be1 WatchSource:0}: Error finding container 4af9abb1a6d85decba3ab4e209c4916c79e83a34fab5240a487cbc24555c0be1: Status 404 returned error can't find the container with id 4af9abb1a6d85decba3ab4e209c4916c79e83a34fab5240a487cbc24555c0be1 Jul 15 19:14:06.883965 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.883936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:06.884123 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.884104 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:06.884199 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.884187 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:14:07.884163975 +0000 UTC m=+4.028608603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:06.985187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:06.985143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:06.985445 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.985352 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:06.985445 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:06.985416 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:14:07.985401254 +0000 UTC m=+4.129845877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:07.086096 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.086056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:07.086269 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:07.086253 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:07.086342 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:07.086277 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:07.086342 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:07.086289 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:07.086441 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:07.086366 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:14:08.086349888 +0000 UTC m=+4.230794500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:07.307811 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.307719 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:09:06 +0000 UTC" deadline="2028-03-20 04:19:30.724941794 +0000 UTC" Jul 15 19:14:07.307811 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.307752 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14721h5m23.417193367s" Jul 15 19:14:07.412672 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.412621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s8pgs" event={"ID":"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3","Type":"ContainerStarted","Data":"c3475da94f3e854209cca3354e601b36932894fe996332cc795e5d6cefa013d0"} Jul 15 19:14:07.414315 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.414229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" event={"ID":"53beb8ca-3a02-43a0-b336-0371ba1d617b","Type":"ContainerStarted","Data":"d008d49338427aaf0e2bf44afba926799a2ae535a575c2f610bd03ba7c63859a"} Jul 15 19:14:07.415851 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.415825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtz6v" event={"ID":"9895e04d-f9bf-4c34-a9ee-f5931658d361","Type":"ContainerStarted","Data":"ebd4066c25c070852473afc5d2b366a1211fd0713491fb40636805ae8d52661a"} Jul 15 19:14:07.417197 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.417171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerStarted","Data":"fea63d106deda3351519fc36c3c1494a317909f9d509c9ad4a71c966d9f07917"} Jul 15 19:14:07.418520 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.418495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d7psk" event={"ID":"67c3a73f-e3a4-448e-8f9e-6dff833136dd","Type":"ContainerStarted","Data":"c8942ad384d922d3a9672a04f880e7dee2b861d984be1d26558eb79f19639b0d"} Jul 15 19:14:07.419667 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.419641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"5db51e835d35d2fd6e1022c0b50e0e3b40b725e0d847839bde9695161fed21f8"} Jul 15 19:14:07.421039 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.421010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nvjrg" event={"ID":"980ab03e-aafb-4f74-833b-9085a8080638","Type":"ContainerStarted","Data":"696297ec8ac8682aa4d047cae324ddea532d9a86d9b77d5e5a81448ee2ed0068"} Jul 15 19:14:07.422150 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.422126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vnrz" event={"ID":"1fda9597-4e31-4cf3-aefa-a6f2c134eef7","Type":"ContainerStarted","Data":"4af9abb1a6d85decba3ab4e209c4916c79e83a34fab5240a487cbc24555c0be1"} Jul 15 19:14:07.423411 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.423385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-th7vc" event={"ID":"24a95593-32ba-4cd1-8574-383495d9428c","Type":"ContainerStarted","Data":"e2e7f25e4f7f7b22d51acdfe40281bc87b31854a57a02088fcf2e9aa59e3a2b1"} Jul 15 19:14:07.898038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:07.897041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:07.898038 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:07.897498 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:07.898038 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:07.897574 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:14:09.897552786 +0000 UTC m=+6.041997415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:08.000244 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.000194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:08.000443 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.000361 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:08.000443 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.000431 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:14:10.000410527 +0000 UTC m=+6.144855168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:08.101720 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.100977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:08.101720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.101197 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:08.101720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.101218 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:08.101720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.101232 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:08.101720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.101318 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:14:10.101297127 +0000 UTC m=+6.245741761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:08.308895 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.308795 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:09:06 +0000 UTC" deadline="2028-02-05 08:17:40.080542368 +0000 UTC" Jul 15 19:14:08.308895 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.308864 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13669h3m31.771683174s" Jul 15 19:14:08.406544 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.406466 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:08.406720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.406659 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:08.407159 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.407139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:08.407251 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.407236 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:08.407329 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.407313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:08.407452 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:08.407431 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:08.439601 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.439513 2581 generic.go:356] "Generic (PLEG): container finished" podID="06089b923710f2d2feae9e9599b422d3" containerID="a4661a8f52b5d2d7ad889cc5d88a57c239d0f79f03114f8d517e78934022e726" exitCode=0 Jul 15 19:14:08.439790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.439634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" event={"ID":"06089b923710f2d2feae9e9599b422d3","Type":"ContainerDied","Data":"a4661a8f52b5d2d7ad889cc5d88a57c239d0f79f03114f8d517e78934022e726"} Jul 15 19:14:08.447627 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:08.447586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" event={"ID":"1edd94a745f603ae25b0ce87a74b4849","Type":"ContainerStarted","Data":"ff45c5825ce857ac4ac2816ccffcad52a236adc6fbcf3a4bf65f3814ecff769e"} Jul 15 19:14:09.481513 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:09.481476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" event={"ID":"06089b923710f2d2feae9e9599b422d3","Type":"ContainerStarted","Data":"6dd789524f975a6bb0750ce0cd98bba3139404f403da4978c8a489c2e7170258"} Jul 15 19:14:09.500965 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:09.500901 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-42.ec2.internal" podStartSLOduration=4.500876041 podStartE2EDuration="4.500876041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:09.500490425 +0000 UTC m=+5.644935062" watchObservedRunningTime="2026-07-15 19:14:09.500876041 +0000 UTC m=+5.645320681" Jul 15 19:14:09.501485 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:09.501431 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-42.ec2.internal" podStartSLOduration=4.501417682 podStartE2EDuration="4.501417682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:08.487422267 +0000 UTC m=+4.631866906" watchObservedRunningTime="2026-07-15 19:14:09.501417682 +0000 UTC m=+5.645862321" Jul 15 19:14:09.915760 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:09.915134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:09.915760 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:09.915307 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:09.915760 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:09.915370 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:14:13.915351771 +0000 UTC m=+10.059796384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:10.016138 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:10.016093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:10.016352 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.016312 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:10.016430 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.016382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:14:14.016363067 +0000 UTC m=+10.160807735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:10.117648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:10.117025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:10.117648 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.117188 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:10.117648 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.117214 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:10.117648 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.117231 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:10.117648 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.117311 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:14:14.117274538 +0000 UTC m=+10.261719163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:10.409147 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:10.409064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:10.409310 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.409242 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:10.409425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:10.409396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:10.409562 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.409540 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:10.409689 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:10.409622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:10.409774 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:10.409753 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:12.403886 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:12.403825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:12.403886 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:12.403852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:12.404400 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:12.403838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:12.404400 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:12.403960 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:12.404400 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:12.404070 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:12.404400 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:12.404160 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:13.949342 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:13.949304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:13.949801 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:13.949492 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:13.949801 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:13.949554 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:14:21.949535627 +0000 UTC m=+18.093980241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:14.050076 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:14.050044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:14.050266 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.050177 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:14.050266 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.050238 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:14:22.050220931 +0000 UTC m=+18.194665556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:14.150619 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:14.150547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:14.150828 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.150766 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:14.150828 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.150785 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:14.150828 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.150796 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:14.150995 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.150853 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:14:22.150835027 +0000 UTC m=+18.295279663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:14.405048 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:14.404964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:14.405208 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.405072 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:14.405578 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:14.405345 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:14.405578 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.405440 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:14.405578 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:14.405474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:14.405578 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:14.405536 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:16.404016 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:16.403982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:16.404500 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:16.404050 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:16.404500 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:16.404326 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:16.404928 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:16.404900 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:16.405036 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:16.404980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:16.405091 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:16.405054 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:18.404349 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:18.404315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:18.404778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:18.404315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:18.404778 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:18.404447 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:18.404778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:18.404316 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:18.404778 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:18.404584 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:18.404778 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:18.404619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:20.404144 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:20.404035 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:20.404144 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:20.404046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:20.404736 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:20.404210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:20.404736 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:20.404222 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:20.404736 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:20.404357 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:20.404736 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:20.404446 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:22.012400 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:22.012362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:22.012845 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.012530 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:22.012845 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.012603 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:14:38.012581973 +0000 UTC m=+34.157026591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:22.113238 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:22.113207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:22.113420 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.113340 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:22.113420 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.113404 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:14:38.113385486 +0000 UTC m=+34.257830114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:22.213591 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:22.213545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:22.213746 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.213698 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:22.213746 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.213719 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:22.213746 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.213729 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:22.213856 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.213772 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:14:38.213758777 +0000 UTC m=+34.358203388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:22.404520 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:22.404486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:22.404669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:22.404495 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:22.404669 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.404594 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:22.404669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:22.404604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:22.404812 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.404669 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:22.404812 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:22.404776 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:24.404619 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:24.404397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:24.404619 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:24.404486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:24.404619 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:24.404501 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:24.404619 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:24.404618 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:24.405314 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:24.404651 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:24.405314 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:24.404732 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:26.404691 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.403464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:26.405625 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:26.405429 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:26.405625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.405523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:26.405625 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:26.405594 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:26.405821 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.405645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:26.405821 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:26.405730 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:26.518441 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.518411 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8vnrz" event={"ID":"1fda9597-4e31-4cf3-aefa-a6f2c134eef7","Type":"ContainerStarted","Data":"947afbbf6b5ca425c181619206012ece6072dd1c8bd8bc2f980b5e5242ca1cc3"} Jul 15 19:14:26.520044 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.520017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-th7vc" event={"ID":"24a95593-32ba-4cd1-8574-383495d9428c","Type":"ContainerStarted","Data":"e6f41604e4364652cdb388fb573338298a710cc94ce9b0fc311ccc26d559bb74"} Jul 15 19:14:26.521617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.521591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s8pgs" event={"ID":"d15bbcc7-4e83-4761-adce-d5d6e90dcbd3","Type":"ContainerStarted","Data":"1d089c43e51be876f2b9f7c5073f938c6eb5c9009ee09eedf2f89e14eef90189"} Jul 15 19:14:26.523169 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.523146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" event={"ID":"53beb8ca-3a02-43a0-b336-0371ba1d617b","Type":"ContainerStarted","Data":"ccfaab2c812cc8aaea0a7b77c35b476c7207db0796854e483783bc88a00b926c"} Jul 15 19:14:26.524701 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.524674 2581 generic.go:356] "Generic (PLEG): container finished" podID="460a3ee1-e245-4eaa-a386-2be5e8376183" containerID="984cf7e6e8da521da8bf694e7f396eb49f30651e98048a3425863d2373324984" exitCode=0 Jul 15 19:14:26.524789 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.524752 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerDied","Data":"984cf7e6e8da521da8bf694e7f396eb49f30651e98048a3425863d2373324984"} Jul 15 19:14:26.526501 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.526373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d7psk" event={"ID":"67c3a73f-e3a4-448e-8f9e-6dff833136dd","Type":"ContainerStarted","Data":"22c01097be8252bfa4b5fc7c583528f13d48dd800a9d84a49948578b7c2d4a70"} Jul 15 19:14:26.528493 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.528468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"e5b2e4752081084b1f4d071c805ae7292dc5eb03fe28ad164364878eddcbbe07"} Jul 15 19:14:26.528575 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.528540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"1c5be46a2b467d9294bbf2d3d346f3a26a33f3915164c9c3280a0ac064344ed8"} Jul 15 19:14:26.530033 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.529998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nvjrg" event={"ID":"980ab03e-aafb-4f74-833b-9085a8080638","Type":"ContainerStarted","Data":"f977762442087533bee8566d59f8759fa6057249cfee15d03f1f25213a8a03bf"} Jul 15 19:14:26.535543 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.535484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8vnrz" podStartSLOduration=7.036777545 podStartE2EDuration="22.53527394s" totalImagesPullingTime="15.498496395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:26.53458467 +0000 UTC m=+22.679029304" watchObservedRunningTime="2026-07-15 19:14:26.53527394 +0000 UTC m=+22.679718573" Jul 15 19:14:26.551158 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.551114 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s8pgs" podStartSLOduration=2.185257761 podStartE2EDuration="21.551099211s" totalImagesPullingTime="19.36584145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:26.551005787 +0000 UTC m=+22.695450503" watchObservedRunningTime="2026-07-15 19:14:26.551099211 +0000 UTC m=+22.695543844" Jul 15 19:14:26.572037 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.571987 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-th7vc" podStartSLOduration=3.150004679 podStartE2EDuration="22.571971725s" totalImagesPullingTime="19.421967046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:26.571857833 +0000 UTC m=+22.716302477" watchObservedRunningTime="2026-07-15 19:14:26.571971725 +0000 UTC m=+22.716416358" Jul 15 19:14:26.613667 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.613624 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d7psk" podStartSLOduration=2.229630892 podStartE2EDuration="21.613608199s" totalImagesPullingTime="19.383977307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:26.613314039 +0000 UTC m=+22.757758669" watchObservedRunningTime="2026-07-15 19:14:26.613608199 +0000 UTC m=+22.758052831" Jul 15 19:14:26.629109 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:26.629062 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nvjrg" podStartSLOduration=2.241298863 podStartE2EDuration="21.629047319s" totalImagesPullingTime="19.387748456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:26.628676748 +0000 UTC m=+22.773121383" watchObservedRunningTime="2026-07-15 19:14:26.629047319 +0000 UTC m=+22.773491952" Jul 15 19:14:27.536253 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.535962 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:14:27.537104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.536526 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c3cdddf-7f56-4e85-b223-876eeb838b8d" containerID="e5b2e4752081084b1f4d071c805ae7292dc5eb03fe28ad164364878eddcbbe07" exitCode=1 Jul 15 19:14:27.537104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.536620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerDied","Data":"e5b2e4752081084b1f4d071c805ae7292dc5eb03fe28ad164364878eddcbbe07"} Jul 15 19:14:27.537104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.536738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"ba8ba497450a9c7ffaa718f0b12bfc35d78dc794e5fc40a0293bf3a446ecf189"} Jul 15 19:14:27.537104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.536790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"f3b54f89f90fe11edf86a1f5dfd8932d6844d623e2c32d0d87bf6f8244bf30a1"} Jul 15 19:14:27.537104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.536836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"9265a8ae8ac650aea7a9f61e404be75c4f67111cffac12061c0ab93882e9987b"} Jul 15 19:14:27.537104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.537086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"69f0d5e4994492e0507a76e06464250f9cfec3bffd2954284c5bae1093257276"} Jul 15 19:14:27.901825 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:27.901789 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 19:14:28.338778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.338653 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:14:27.90180778Z","UUID":"ba0c973b-dfd8-418e-9f74-f5c138adfdbb","Handler":null,"Name":"","Endpoint":""} Jul 15 19:14:28.340628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.340463 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 19:14:28.340628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.340508 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 19:14:28.403963 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.403931 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:28.404179 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.403933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:28.404179 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:28.404065 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:28.404179 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.403934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:28.404179 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:28.404146 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:28.404455 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:28.404238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:28.422014 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.421990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:28.422502 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.422483 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:28.541761 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.541724 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" event={"ID":"53beb8ca-3a02-43a0-b336-0371ba1d617b","Type":"ContainerStarted","Data":"e1f31570393e7d0ba6fd6205e7c971696b123cc090fba3c832d96d120c87ffd7"} Jul 15 19:14:28.543600 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.543570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtz6v" event={"ID":"9895e04d-f9bf-4c34-a9ee-f5931658d361","Type":"ContainerStarted","Data":"1997db462aba31f2ca8641f2593aeaac2a4089663ea1632aebf55506ef2487a3"} Jul 15 19:14:28.561045 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:28.560993 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xtz6v" podStartSLOduration=5.203274449 podStartE2EDuration="24.560977454s" totalImagesPullingTime="19.357703005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:28.560679203 +0000 UTC m=+24.705123849" watchObservedRunningTime="2026-07-15 19:14:28.560977454 +0000 UTC m=+24.705422087" Jul 15 19:14:29.548743 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:29.548534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" event={"ID":"53beb8ca-3a02-43a0-b336-0371ba1d617b","Type":"ContainerStarted","Data":"029f973ade2d6c5cab0d368a7073a407fde1f7632a4b9d023336cc7f6a122c45"} Jul 15 19:14:29.551967 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:29.551946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:14:29.552416 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:29.552393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"d4c4cabbab140ad591dc5e4f407808d9d38b208befb4d53142d5646cef7f0dde"} Jul 15 19:14:29.552506 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:29.552493 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 19:14:29.570254 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:29.570195 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2x2v" podStartSLOduration=2.805393009 podStartE2EDuration="24.570179288s" totalImagesPullingTime="21.764786279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:29.568389147 +0000 UTC m=+25.712833782" watchObservedRunningTime="2026-07-15 19:14:29.570179288 +0000 UTC m=+25.714623920" Jul 15 19:14:30.404141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:30.404104 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:30.404381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:30.404113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:30.404381 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:30.404247 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:30.404381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:30.404306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:30.404546 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:30.404390 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:30.404546 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:30.404475 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:31.559656 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.559423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:14:31.560489 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.559951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"15b3ab1c06a7e9944fc6b90278562978a3de5e07dd9ed4088261a95b5ecf1541"} Jul 15 19:14:31.560489 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.560283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:31.560489 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.560418 2581 scope.go:117] "RemoveContainer" containerID="e5b2e4752081084b1f4d071c805ae7292dc5eb03fe28ad164364878eddcbbe07" Jul 15 19:14:31.562412 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.562387 2581 generic.go:356] "Generic (PLEG): container finished" podID="460a3ee1-e245-4eaa-a386-2be5e8376183" containerID="718c2a5df1d95702b8a14fcee1bc09b2569cec27ccaed808e29d7e0ae7741c1a" exitCode=0 Jul 15 19:14:31.562530 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.562422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerDied","Data":"718c2a5df1d95702b8a14fcee1bc09b2569cec27ccaed808e29d7e0ae7741c1a"} Jul 15 19:14:31.577623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:31.577604 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:32.403598 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.403562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:32.403803 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.403563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:32.403803 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:32.403669 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:32.403803 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:32.403774 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:32.403803 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.403563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:32.403944 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:32.403865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:32.568964 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.568935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:14:32.569432 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.569328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" event={"ID":"1c3cdddf-7f56-4e85-b223-876eeb838b8d","Type":"ContainerStarted","Data":"8bebb69037629502c6577d48c302fcc00788513a049d6741f6a32338ed06b947"} Jul 15 19:14:32.569585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.569561 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:32.569712 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.569636 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:32.590353 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.590322 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:14:32.609114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:32.609059 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" podStartSLOduration=9.15289218 podStartE2EDuration="28.609042388s" totalImagesPullingTime="19.456150208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:32.607314597 +0000 UTC m=+28.751759231" watchObservedRunningTime="2026-07-15 19:14:32.609042388 +0000 UTC m=+28.753487021" Jul 15 19:14:33.573448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.573413 2581 generic.go:356] "Generic (PLEG): container finished" podID="460a3ee1-e245-4eaa-a386-2be5e8376183" containerID="8db761129057ede2ba2086e380850a9cda00beb08b8a8ffd2fdf70173395cd0c" exitCode=0 Jul 15 19:14:33.573931 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.573492 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerDied","Data":"8db761129057ede2ba2086e380850a9cda00beb08b8a8ffd2fdf70173395cd0c"} Jul 15 19:14:33.659816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.659789 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xv76q"] Jul 15 19:14:33.659970 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.659893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:33.660026 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:33.659971 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:33.662871 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.662845 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2jt9m"] Jul 15 19:14:33.663005 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.662959 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:33.663093 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:33.663059 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:33.663655 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.663622 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zttsd"] Jul 15 19:14:33.663743 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:33.663717 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:33.663844 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:33.663814 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:35.189246 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.189205 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:35.189718 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.189385 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 19:14:35.190010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.189994 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8vnrz" Jul 15 19:14:35.404069 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.403894 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:35.404232 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.403944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:35.404232 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:35.404155 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:35.404232 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.403944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:35.404392 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:35.404239 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:35.404392 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:35.404318 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:35.581060 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.580968 2581 generic.go:356] "Generic (PLEG): container finished" podID="460a3ee1-e245-4eaa-a386-2be5e8376183" containerID="a8a07d722f8e83c0297f3766787a574c241ecd259b74a9ae16680fa95d55f832" exitCode=0 Jul 15 19:14:35.581060 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:35.581029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerDied","Data":"a8a07d722f8e83c0297f3766787a574c241ecd259b74a9ae16680fa95d55f832"} Jul 15 19:14:37.403960 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:37.403864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:37.404665 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:37.403864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:37.404665 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:37.403984 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jt9m" podUID="29620974-a142-4563-82dc-356fc4a4fd0c" Jul 15 19:14:37.404665 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:37.403864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:37.404665 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:37.404062 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zttsd" podUID="78f93904-f3eb-4460-8064-82eeb57518fd" Jul 15 19:14:37.404665 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:37.404122 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xv76q" podUID="863e847e-a9ad-4621-8e81-fb8a2060f55f" Jul 15 19:14:38.033117 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:38.033087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:38.033323 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.033215 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:38.033323 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.033276 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.033258862 +0000 UTC m=+66.177703474 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 19:14:38.133804 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:38.133764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:38.134139 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.133883 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:38.134139 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.133942 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret podName:863e847e-a9ad-4621-8e81-fb8a2060f55f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.133924401 +0000 UTC m=+66.278369012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret") pod "global-pull-secret-syncer-xv76q" (UID: "863e847e-a9ad-4621-8e81-fb8a2060f55f") : object "kube-system"/"original-pull-secret" not registered Jul 15 19:14:38.234891 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:38.234855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:38.235061 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.235027 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 19:14:38.235061 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.235052 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 19:14:38.235262 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.235067 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cs8gd for pod openshift-network-diagnostics/network-check-target-2jt9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:38.235262 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:38.235122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd podName:29620974-a142-4563-82dc-356fc4a4fd0c nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.235107735 +0000 UTC m=+66.379552359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cs8gd" (UniqueName: "kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd") pod "network-check-target-2jt9m" (UID: "29620974-a142-4563-82dc-356fc4a4fd0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 19:14:39.081388 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.081309 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-42.ec2.internal" event="NodeReady" Jul 15 19:14:39.081964 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.081464 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 19:14:39.126376 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.126346 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79f8459cd4-x6bx7"] Jul 15 19:14:39.156509 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.156473 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-brlgd"] Jul 15 19:14:39.156665 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.156485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.160068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.160044 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 19:14:39.160439 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.160413 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 19:14:39.160762 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.160738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xd8s9\"" Jul 15 19:14:39.160926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.160892 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 19:14:39.170000 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.169979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79f8459cd4-x6bx7"] Jul 15 19:14:39.170111 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.170007 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6t2j6"] Jul 15 19:14:39.170111 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.170093 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.175460 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.175409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 19:14:39.175741 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.175720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l2njj\"" Jul 15 19:14:39.177400 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.177383 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 19:14:39.178377 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.178359 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 19:14:39.184019 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.183994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-brlgd"] Jul 15 19:14:39.184143 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.184122 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.187217 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.187173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvjwq\"" Jul 15 19:14:39.187367 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.187217 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 19:14:39.187701 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.187670 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 19:14:39.187795 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.187755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 19:14:39.213052 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.212996 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t2j6"] Jul 15 19:14:39.243923 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.243894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-image-registry-private-configuration\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.243948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-trusted-ca\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.243972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-bound-sa-token\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.244054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-installation-pull-secrets\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244233 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.244088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2m7\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-kube-api-access-2w2m7\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244233 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.244128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9d0031-b8eb-47cf-b309-b08391de1fbb-ca-trust-extracted\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244233 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.244200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.244233 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.244222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-certificates\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.341414 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.341332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:39.345114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9d0031-b8eb-47cf-b309-b08391de1fbb-ca-trust-extracted\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345249 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-config-volume\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.345249 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.345249 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d394df5d-135f-45d9-8647-26db0fcc9eb2-cert\") pod \"ingress-canary-6t2j6\" (UID: \"d394df5d-135f-45d9-8647-26db0fcc9eb2\") " pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.345249 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-certificates\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-image-registry-private-configuration\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.345361 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-trusted-ca\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.345381 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-bound-sa-token\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.345436 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:14:39.845415195 +0000 UTC m=+35.989859832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:14:39.345469 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-tmp-dir\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.345859 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzlk\" (UniqueName: \"kubernetes.io/projected/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-kube-api-access-mgzlk\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.345859 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345520 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9d0031-b8eb-47cf-b309-b08391de1fbb-ca-trust-extracted\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345859 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-installation-pull-secrets\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345859 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2m7\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-kube-api-access-2w2m7\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.345859 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcg5s\" (UniqueName: \"kubernetes.io/projected/d394df5d-135f-45d9-8647-26db0fcc9eb2-kube-api-access-fcg5s\") pod \"ingress-canary-6t2j6\" (UID: \"d394df5d-135f-45d9-8647-26db0fcc9eb2\") " pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.345859 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.345818 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-certificates\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.346575 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.346539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-trusted-ca\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.350008 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.349988 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-installation-pull-secrets\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.350104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.349988 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-image-registry-private-configuration\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.357971 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.357935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-bound-sa-token\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.358436 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.358411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2m7\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-kube-api-access-2w2m7\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.404480 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.404442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:14:39.404662 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.404442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:14:39.404662 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.404442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:14:39.407905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.407882 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 19:14:39.407905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.407894 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 19:14:39.408195 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.408177 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 19:14:39.408323 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.408205 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pjk9x\"" Jul 15 19:14:39.408323 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.408255 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 19:14:39.408453 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.408323 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sk5rd\"" Jul 15 19:14:39.434737 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.434707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:39.446666 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.446640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-config-volume\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.446808 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.446698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.446808 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.446777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d394df5d-135f-45d9-8647-26db0fcc9eb2-cert\") pod \"ingress-canary-6t2j6\" (UID: \"d394df5d-135f-45d9-8647-26db0fcc9eb2\") " pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.446808 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.446804 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:14:39.446972 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.446874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:39.946855041 +0000 UTC m=+36.091299666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:14:39.446972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.446894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-tmp-dir\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.446972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.446923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzlk\" (UniqueName: \"kubernetes.io/projected/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-kube-api-access-mgzlk\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.447114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.447038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcg5s\" (UniqueName: \"kubernetes.io/projected/d394df5d-135f-45d9-8647-26db0fcc9eb2-kube-api-access-fcg5s\") pod \"ingress-canary-6t2j6\" (UID: \"d394df5d-135f-45d9-8647-26db0fcc9eb2\") " pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.447237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.447191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-tmp-dir\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.447382 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.447369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-config-volume\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.449387 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.449365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d394df5d-135f-45d9-8647-26db0fcc9eb2-cert\") pod \"ingress-canary-6t2j6\" (UID: \"d394df5d-135f-45d9-8647-26db0fcc9eb2\") " pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.457387 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.457362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzlk\" (UniqueName: \"kubernetes.io/projected/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-kube-api-access-mgzlk\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.457501 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.457477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcg5s\" (UniqueName: \"kubernetes.io/projected/d394df5d-135f-45d9-8647-26db0fcc9eb2-kube-api-access-fcg5s\") pod \"ingress-canary-6t2j6\" (UID: \"d394df5d-135f-45d9-8647-26db0fcc9eb2\") " pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.495583 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.495541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t2j6" Jul 15 19:14:39.682907 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.682805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:39.850031 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.849985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:39.850210 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.850147 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:14:39.850210 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.850176 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:14:39.850360 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.850246 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:14:40.850225543 +0000 UTC m=+36.994670177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:14:39.950898 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:39.950801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:39.951053 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.950977 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:14:39.951108 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:39.951067 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:40.951043902 +0000 UTC m=+37.095488514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:14:40.030643 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.030603 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:40.123064 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.123028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:40.188783 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.188572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:40.263599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.263495 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t2j6"] Jul 15 19:14:40.340959 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:14:40.340915 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd394df5d_135f_45d9_8647_26db0fcc9eb2.slice/crio-53d64dd142f22f2da732db144680f7af0a788341b563a5f215d12672a46b7e7d WatchSource:0}: Error finding container 53d64dd142f22f2da732db144680f7af0a788341b563a5f215d12672a46b7e7d: Status 404 returned error can't find the container with id 53d64dd142f22f2da732db144680f7af0a788341b563a5f215d12672a46b7e7d Jul 15 19:14:40.599720 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.599691 2581 generic.go:356] "Generic (PLEG): container finished" podID="460a3ee1-e245-4eaa-a386-2be5e8376183" containerID="15848fe266fd0224ebb7c5be244629f05cc3f12d4e84daa05fbbe93b70ef3c59" exitCode=0 Jul 15 19:14:40.599852 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.599762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerDied","Data":"15848fe266fd0224ebb7c5be244629f05cc3f12d4e84daa05fbbe93b70ef3c59"} Jul 15 19:14:40.600811 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.600793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t2j6" event={"ID":"d394df5d-135f-45d9-8647-26db0fcc9eb2","Type":"ContainerStarted","Data":"53d64dd142f22f2da732db144680f7af0a788341b563a5f215d12672a46b7e7d"} Jul 15 19:14:40.857972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.857870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:40.858148 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:40.858034 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:14:40.858148 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:40.858056 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:14:40.858148 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:40.858122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:14:42.858103982 +0000 UTC m=+39.002548609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:14:40.958673 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:40.958632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:40.958841 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:40.958792 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:14:40.958879 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:40.958851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:42.958835183 +0000 UTC m=+39.103279806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:14:41.606014 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:41.605978 2581 generic.go:356] "Generic (PLEG): container finished" podID="460a3ee1-e245-4eaa-a386-2be5e8376183" containerID="1e17039ab343695b4a88bda0044d54f6beeafa6f896cc661c748242e14d11df6" exitCode=0 Jul 15 19:14:41.606495 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:41.606040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerDied","Data":"1e17039ab343695b4a88bda0044d54f6beeafa6f896cc661c748242e14d11df6"} Jul 15 19:14:42.612500 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:42.612464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" event={"ID":"460a3ee1-e245-4eaa-a386-2be5e8376183","Type":"ContainerStarted","Data":"3f21eb1812a203390d2d45b06b4d6ef59440830cf58528666a33f3cb858a8bde"} Jul 15 19:14:42.640540 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:42.640484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j4k8g" podStartSLOduration=7.9280912059999995 podStartE2EDuration="38.640461062s" totalImagesPullingTime="30.712369856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:42.638334737 +0000 UTC m=+38.782779370" watchObservedRunningTime="2026-07-15 19:14:42.640461062 +0000 UTC m=+38.784905694" Jul 15 19:14:42.767884 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:42.767851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:42.827877 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:42.827844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:42.873844 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:42.873758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:42.873998 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:42.873922 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:14:42.873998 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:42.873941 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:14:42.874117 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:42.874008 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:14:46.873988303 +0000 UTC m=+43.018432927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:14:42.974849 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:42.974817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:42.975005 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:42.974978 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:14:42.975052 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:42.975041 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:46.975026492 +0000 UTC m=+43.119471104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:14:43.948846 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:43.948641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:44.050005 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:44.049915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:44.618942 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:44.618912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t2j6" event={"ID":"d394df5d-135f-45d9-8647-26db0fcc9eb2","Type":"ContainerStarted","Data":"f6cb428f62ecdedde10f6fd737ea2cbb028cb38e1c1eadf7ca3fd6c7878b7f04"} Jul 15 19:14:44.639796 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:44.639747 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6t2j6" podStartSLOduration=2.243852322 podStartE2EDuration="5.639728304s" totalImagesPullingTime="3.395875982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:44.639312955 +0000 UTC m=+40.783757584" watchObservedRunningTime="2026-07-15 19:14:44.639728304 +0000 UTC m=+40.784172937" Jul 15 19:14:46.902648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:46.902606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:46.903008 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:46.902769 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:14:46.903008 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:46.902791 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:14:46.903008 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:46.902842 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:14:54.90282806 +0000 UTC m=+51.047272696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:14:47.003932 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:47.003892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:47.004090 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:47.004037 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:14:47.004130 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:47.004101 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:55.004085934 +0000 UTC m=+51.148530544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:14:48.180217 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:48.180184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" limit=1024 Jul 15 19:14:54.963212 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:54.963168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:14:54.963720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:54.963306 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:14:54.963720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:54.963320 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:14:54.963720 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:54.963381 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.963365051 +0000 UTC m=+67.107809677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:14:55.064355 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:14:55.064315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:14:55.064512 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:55.064444 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:14:55.064512 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:14:55.064508 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:11.064492662 +0000 UTC m=+67.208937273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:15:00.211696 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.211663 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd"] Jul 15 19:15:00.230022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.229351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" Jul 15 19:15:00.230022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.229229 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66"] Jul 15 19:15:00.232342 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.232314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fx7n5\"" Jul 15 19:15:00.242078 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.242057 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b"] Jul 15 19:15:00.242187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.242158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" Jul 15 19:15:00.245240 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.245216 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.245240 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.245241 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.245408 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.245269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rtfsf\"" Jul 15 19:15:00.256280 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.256261 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44"] Jul 15 19:15:00.256399 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.256385 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.259015 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.258997 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.259163 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.259142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.259163 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.259156 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 19:15:00.259279 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.259189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5bnkl\"" Jul 15 19:15:00.274860 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.274834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd"] Jul 15 19:15:00.274860 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.274864 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66"] Jul 15 19:15:00.275006 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.274878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b"] Jul 15 19:15:00.275006 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.274897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44"] Jul 15 19:15:00.275006 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.274969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.277802 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.277784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 19:15:00.277918 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.277790 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.278124 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.278110 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.279395 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.279368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gb5c7\"" Jul 15 19:15:00.292942 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.292922 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 19:15:00.305913 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.305886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.306047 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.305921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmvk\" (UniqueName: \"kubernetes.io/projected/330ed2ee-5fb3-4428-b551-b933c47ec693-kube-api-access-2dmvk\") pod \"volume-data-source-validator-78495597f6-vkt66\" (UID: \"330ed2ee-5fb3-4428-b551-b933c47ec693\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" Jul 15 19:15:00.306047 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.305948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdx6\" (UniqueName: \"kubernetes.io/projected/0b258edf-9d2d-43b1-aba1-8a3a07e67485-kube-api-access-hzdx6\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.306047 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.305965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jls6g\" (UniqueName: \"kubernetes.io/projected/38720aac-3140-47d3-8772-1aef804e5f3f-kube-api-access-jls6g\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.306047 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.306001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.306252 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.306052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74btp\" (UniqueName: \"kubernetes.io/projected/6bcfe752-3945-4f15-8958-09453fe4ed3a-kube-api-access-74btp\") pod \"network-check-source-869dcfcdcd-r7mnd\" (UID: \"6bcfe752-3945-4f15-8958-09453fe4ed3a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" Jul 15 19:15:00.306252 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.306085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b258edf-9d2d-43b1-aba1-8a3a07e67485-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.312962 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.312935 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8"] Jul 15 19:15:00.329444 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.329418 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd"] Jul 15 19:15:00.329571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.329546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.332763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.332739 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 19:15:00.333442 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.333420 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 19:15:00.334070 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.333676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.334070 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.333748 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m8ggj\"" Jul 15 19:15:00.334260 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.334083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.347126 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.347096 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-jdnzk"] Jul 15 19:15:00.347277 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.347222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.351507 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.351484 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.351710 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.351694 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 19:15:00.351782 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.351743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 19:15:00.352205 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.352184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v89cr\"" Jul 15 19:15:00.352513 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.352495 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.358707 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.358689 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xlrwl"] Jul 15 19:15:00.358822 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.358806 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.361982 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.361966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.362357 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.362336 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 19:15:00.362357 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.362339 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 19:15:00.362509 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.362369 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.362509 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.362387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zklx9\"" Jul 15 19:15:00.368784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.368770 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 19:15:00.374250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.374233 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59d6798796-8ds8g"] Jul 15 19:15:00.374372 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.374358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.377549 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.377531 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5qdsh\"" Jul 15 19:15:00.378989 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.378974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.379183 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.379170 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.379254 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.379202 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 19:15:00.379572 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.379552 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 19:15:00.385958 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.385928 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 19:15:00.390533 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.390518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8"] Jul 15 19:15:00.390617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.390544 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd"] Jul 15 19:15:00.390617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.390558 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59d6798796-8ds8g"] Jul 15 19:15:00.390617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.390572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xlrwl"] Jul 15 19:15:00.390617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.390588 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-jdnzk"] Jul 15 19:15:00.390811 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.390641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.393459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.393441 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 19:15:00.394425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.394398 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 19:15:00.394750 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.394731 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 19:15:00.394880 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.394861 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 19:15:00.394998 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.394984 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtf5f\"" Jul 15 19:15:00.395084 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.395068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 19:15:00.406050 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406031 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 19:15:00.406355 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0354250-88e0-4707-bd70-8496f6b754ad-config\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.406429 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ede1146f-2531-47c9-89a5-f840d528eab6-config\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.406429 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74hp8\" (UniqueName: \"kubernetes.io/projected/ede1146f-2531-47c9-89a5-f840d528eab6-kube-api-access-74hp8\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.406429 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmvk\" (UniqueName: \"kubernetes.io/projected/330ed2ee-5fb3-4428-b551-b933c47ec693-kube-api-access-2dmvk\") pod \"volume-data-source-validator-78495597f6-vkt66\" (UID: \"330ed2ee-5fb3-4428-b551-b933c47ec693\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" Jul 15 19:15:00.406429 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dfb87b6-a087-4433-a400-c6b5567f7d0f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.406623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-tmp\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.406623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.406623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8d46\" (UniqueName: \"kubernetes.io/projected/2a99eb45-c843-407d-93e8-a804e8f24025-kube-api-access-q8d46\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.406623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls6g\" (UniqueName: \"kubernetes.io/projected/38720aac-3140-47d3-8772-1aef804e5f3f-kube-api-access-jls6g\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.406623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxvw\" (UniqueName: \"kubernetes.io/projected/2dfb87b6-a087-4433-a400-c6b5567f7d0f-kube-api-access-hwxvw\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.406862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74btp\" (UniqueName: \"kubernetes.io/projected/6bcfe752-3945-4f15-8958-09453fe4ed3a-kube-api-access-74btp\") pod \"network-check-source-869dcfcdcd-r7mnd\" (UID: \"6bcfe752-3945-4f15-8958-09453fe4ed3a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" Jul 15 19:15:00.406862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-snapshots\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.406862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b258edf-9d2d-43b1-aba1-8a3a07e67485-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.406862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.406862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdx6\" (UniqueName: \"kubernetes.io/projected/0b258edf-9d2d-43b1-aba1-8a3a07e67485-kube-api-access-hzdx6\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede1146f-2531-47c9-89a5-f840d528eab6-trusted-ca\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.406907 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-default-certificate\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.406935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.406963 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls podName:0b258edf-9d2d-43b1-aba1-8a3a07e67485 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:00.906944454 +0000 UTC m=+57.051389079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qjm44" (UID: "0b258edf-9d2d-43b1-aba1-8a3a07e67485") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dfb87b6-a087-4433-a400-c6b5567f7d0f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-stats-auth\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.407123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407117 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0354250-88e0-4707-bd70-8496f6b754ad-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.407152 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ede1146f-2531-47c9-89a5-f840d528eab6-serving-cert\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-serving-cert\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.407234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls podName:38720aac-3140-47d3-8772-1aef804e5f3f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:00.907222653 +0000 UTC m=+57.051667264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls") pod "cluster-samples-operator-65db858894-t274b" (UID: "38720aac-3140-47d3-8772-1aef804e5f3f") : secret "samples-operator-tls" not found Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prhfh\" (UniqueName: \"kubernetes.io/projected/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-kube-api-access-prhfh\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.407452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhmw\" (UniqueName: \"kubernetes.io/projected/d0354250-88e0-4707-bd70-8496f6b754ad-kube-api-access-frhmw\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.407679 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.407525 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b258edf-9d2d-43b1-aba1-8a3a07e67485-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.419629 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.419567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmvk\" (UniqueName: \"kubernetes.io/projected/330ed2ee-5fb3-4428-b551-b933c47ec693-kube-api-access-2dmvk\") pod \"volume-data-source-validator-78495597f6-vkt66\" (UID: \"330ed2ee-5fb3-4428-b551-b933c47ec693\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" Jul 15 19:15:00.420692 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.420664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jls6g\" (UniqueName: \"kubernetes.io/projected/38720aac-3140-47d3-8772-1aef804e5f3f-kube-api-access-jls6g\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.421757 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.421731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74btp\" (UniqueName: \"kubernetes.io/projected/6bcfe752-3945-4f15-8958-09453fe4ed3a-kube-api-access-74btp\") pod \"network-check-source-869dcfcdcd-r7mnd\" (UID: \"6bcfe752-3945-4f15-8958-09453fe4ed3a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" Jul 15 19:15:00.421922 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.421907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdx6\" (UniqueName: \"kubernetes.io/projected/0b258edf-9d2d-43b1-aba1-8a3a07e67485-kube-api-access-hzdx6\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.508689 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-serving-cert\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.508689 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prhfh\" (UniqueName: \"kubernetes.io/projected/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-kube-api-access-prhfh\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.508689 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frhmw\" (UniqueName: \"kubernetes.io/projected/d0354250-88e0-4707-bd70-8496f6b754ad-kube-api-access-frhmw\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0354250-88e0-4707-bd70-8496f6b754ad-config\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.508804 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:01.00878465 +0000 UTC m=+57.153229287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : configmap references non-existent config key: service-ca.crt Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ede1146f-2531-47c9-89a5-f840d528eab6-config\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74hp8\" (UniqueName: \"kubernetes.io/projected/ede1146f-2531-47c9-89a5-f840d528eab6-kube-api-access-74hp8\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dfb87b6-a087-4433-a400-c6b5567f7d0f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-tmp\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.508940 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.508972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8d46\" (UniqueName: \"kubernetes.io/projected/2a99eb45-c843-407d-93e8-a804e8f24025-kube-api-access-q8d46\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxvw\" (UniqueName: \"kubernetes.io/projected/2dfb87b6-a087-4433-a400-c6b5567f7d0f-kube-api-access-hwxvw\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-snapshots\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede1146f-2531-47c9-89a5-f840d528eab6-trusted-ca\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-default-certificate\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dfb87b6-a087-4433-a400-c6b5567f7d0f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-stats-auth\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0354250-88e0-4707-bd70-8496f6b754ad-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ede1146f-2531-47c9-89a5-f840d528eab6-serving-cert\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.509459 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.509457 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 19:15:00.510065 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.509522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:01.009505967 +0000 UTC m=+57.153950596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : secret "router-metrics-certs-default" not found Jul 15 19:15:00.510065 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.510065 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-tmp\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.510065 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.509620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ede1146f-2531-47c9-89a5-f840d528eab6-config\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.510266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.510195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dfb87b6-a087-4433-a400-c6b5567f7d0f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.510971 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.510944 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ede1146f-2531-47c9-89a5-f840d528eab6-trusted-ca\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.511455 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.511413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-snapshots\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.511722 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.511694 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-serving-cert\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.511894 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.511874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.512434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.512413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ede1146f-2531-47c9-89a5-f840d528eab6-serving-cert\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.512550 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.512495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0354250-88e0-4707-bd70-8496f6b754ad-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.512550 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.512512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-default-certificate\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.513049 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.513032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-stats-auth\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.518354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.518331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8d46\" (UniqueName: \"kubernetes.io/projected/2a99eb45-c843-407d-93e8-a804e8f24025-kube-api-access-q8d46\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:00.518453 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.518384 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prhfh\" (UniqueName: \"kubernetes.io/projected/8e4cbc00-51f7-48af-b137-bc6bb3a6cdec-kube-api-access-prhfh\") pod \"insights-operator-68d9dd94cf-xlrwl\" (UID: \"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec\") " pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.518603 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.518586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74hp8\" (UniqueName: \"kubernetes.io/projected/ede1146f-2531-47c9-89a5-f840d528eab6-kube-api-access-74hp8\") pod \"console-operator-7866497494-jdnzk\" (UID: \"ede1146f-2531-47c9-89a5-f840d528eab6\") " pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.519052 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.519032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhmw\" (UniqueName: \"kubernetes.io/projected/d0354250-88e0-4707-bd70-8496f6b754ad-kube-api-access-frhmw\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.521714 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.521693 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0354250-88e0-4707-bd70-8496f6b754ad-config\") pod \"service-ca-operator-7695fc6c8c-6r5xd\" (UID: \"d0354250-88e0-4707-bd70-8496f6b754ad\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.521795 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.521784 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dfb87b6-a087-4433-a400-c6b5567f7d0f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.523478 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.523460 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxvw\" (UniqueName: \"kubernetes.io/projected/2dfb87b6-a087-4433-a400-c6b5567f7d0f-kube-api-access-hwxvw\") pod \"kube-storage-version-migrator-operator-799cb7f958-4zpp8\" (UID: \"2dfb87b6-a087-4433-a400-c6b5567f7d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.539393 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.539365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" Jul 15 19:15:00.553500 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.553477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" Jul 15 19:15:00.646038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.645761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" Jul 15 19:15:00.656756 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.656387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" Jul 15 19:15:00.666985 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.666958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:00.686091 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.686061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" Jul 15 19:15:00.732208 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.732072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd"] Jul 15 19:15:00.737432 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:00.737375 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcfe752_3945_4f15_8958_09453fe4ed3a.slice/crio-81e992f82b63b2096cacafedf2cf86078a7ce405102911e7c34d199fe1f0abf4 WatchSource:0}: Error finding container 81e992f82b63b2096cacafedf2cf86078a7ce405102911e7c34d199fe1f0abf4: Status 404 returned error can't find the container with id 81e992f82b63b2096cacafedf2cf86078a7ce405102911e7c34d199fe1f0abf4 Jul 15 19:15:00.754377 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.754274 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66"] Jul 15 19:15:00.832256 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.832193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8"] Jul 15 19:15:00.835544 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:00.835506 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfb87b6_a087_4433_a400_c6b5567f7d0f.slice/crio-08e888eba7daeee65bb2d5eba5c17344f68788fca0903655396cd686d9256878 WatchSource:0}: Error finding container 08e888eba7daeee65bb2d5eba5c17344f68788fca0903655396cd686d9256878: Status 404 returned error can't find the container with id 08e888eba7daeee65bb2d5eba5c17344f68788fca0903655396cd686d9256878 Jul 15 19:15:00.851110 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.851069 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-jdnzk"] Jul 15 19:15:00.866120 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.866051 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd"] Jul 15 19:15:00.868433 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:00.868411 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0354250_88e0_4707_bd70_8496f6b754ad.slice/crio-6b9f026664621fa500080091e50347f844d2ad60b613d000d26cd09cfb5e74da WatchSource:0}: Error finding container 6b9f026664621fa500080091e50347f844d2ad60b613d000d26cd09cfb5e74da: Status 404 returned error can't find the container with id 6b9f026664621fa500080091e50347f844d2ad60b613d000d26cd09cfb5e74da Jul 15 19:15:00.883140 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.883112 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xlrwl"] Jul 15 19:15:00.886306 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:00.886267 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4cbc00_51f7_48af_b137_bc6bb3a6cdec.slice/crio-50b64b8517533c9c9da3b1ec00eaf52364b11a7f8af8dd7842c446bbad7c7f53 WatchSource:0}: Error finding container 50b64b8517533c9c9da3b1ec00eaf52364b11a7f8af8dd7842c446bbad7c7f53: Status 404 returned error can't find the container with id 50b64b8517533c9c9da3b1ec00eaf52364b11a7f8af8dd7842c446bbad7c7f53 Jul 15 19:15:00.912831 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.912801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:00.912953 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:00.912851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:00.912953 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.912942 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:00.913022 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.913002 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls podName:0b258edf-9d2d-43b1-aba1-8a3a07e67485 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:01.912988088 +0000 UTC m=+58.057432699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qjm44" (UID: "0b258edf-9d2d-43b1-aba1-8a3a07e67485") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:00.913074 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.912944 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 19:15:00.913074 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:00.913071 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls podName:38720aac-3140-47d3-8772-1aef804e5f3f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:01.913058309 +0000 UTC m=+58.057502922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls") pod "cluster-samples-operator-65db858894-t274b" (UID: "38720aac-3140-47d3-8772-1aef804e5f3f") : secret "samples-operator-tls" not found Jul 15 19:15:01.013718 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.013635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:01.013718 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.013698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:01.013900 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.013798 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 19:15:01.013900 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.013810 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:02.013796881 +0000 UTC m=+58.158241492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : configmap references non-existent config key: service-ca.crt Jul 15 19:15:01.013900 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.013863 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:02.013847004 +0000 UTC m=+58.158291615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : secret "router-metrics-certs-default" not found Jul 15 19:15:01.659571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.659526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" event={"ID":"2dfb87b6-a087-4433-a400-c6b5567f7d0f","Type":"ContainerStarted","Data":"08e888eba7daeee65bb2d5eba5c17344f68788fca0903655396cd686d9256878"} Jul 15 19:15:01.660546 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.660523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" event={"ID":"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec","Type":"ContainerStarted","Data":"50b64b8517533c9c9da3b1ec00eaf52364b11a7f8af8dd7842c446bbad7c7f53"} Jul 15 19:15:01.661689 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.661665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" event={"ID":"d0354250-88e0-4707-bd70-8496f6b754ad","Type":"ContainerStarted","Data":"6b9f026664621fa500080091e50347f844d2ad60b613d000d26cd09cfb5e74da"} Jul 15 19:15:01.663230 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.663203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" event={"ID":"6bcfe752-3945-4f15-8958-09453fe4ed3a","Type":"ContainerStarted","Data":"81e992f82b63b2096cacafedf2cf86078a7ce405102911e7c34d199fe1f0abf4"} Jul 15 19:15:01.664574 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.664507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" event={"ID":"330ed2ee-5fb3-4428-b551-b933c47ec693","Type":"ContainerStarted","Data":"e049ace71955d4b6599ebe857fe425a4332192611f205d740a36ff0fdedac766"} Jul 15 19:15:01.665785 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.665762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jdnzk" event={"ID":"ede1146f-2531-47c9-89a5-f840d528eab6","Type":"ContainerStarted","Data":"a56b8a41da86a5415fb45073843658b040e3e11f1cf7e3c47b421a80c23c2c81"} Jul 15 19:15:01.922049 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.921959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:01.922049 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:01.922042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:01.922267 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.922181 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 19:15:01.922267 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.922246 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls podName:38720aac-3140-47d3-8772-1aef804e5f3f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:03.922225854 +0000 UTC m=+60.066670472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls") pod "cluster-samples-operator-65db858894-t274b" (UID: "38720aac-3140-47d3-8772-1aef804e5f3f") : secret "samples-operator-tls" not found Jul 15 19:15:01.922669 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.922650 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:01.922745 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:01.922706 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls podName:0b258edf-9d2d-43b1-aba1-8a3a07e67485 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:03.922691207 +0000 UTC m=+60.067135820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qjm44" (UID: "0b258edf-9d2d-43b1-aba1-8a3a07e67485") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:02.022793 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:02.022710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:02.023883 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:02.022894 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 19:15:02.023883 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:02.022974 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:04.022952669 +0000 UTC m=+60.167397282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : secret "router-metrics-certs-default" not found Jul 15 19:15:02.023883 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:02.023299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:02.023883 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:02.023419 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:04.023402456 +0000 UTC m=+60.167847079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : configmap references non-existent config key: service-ca.crt Jul 15 19:15:03.941957 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:03.941913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:03.942434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:03.941995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:03.942434 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:03.942069 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:03.942434 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:03.942119 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 19:15:03.942434 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:03.942156 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls podName:0b258edf-9d2d-43b1-aba1-8a3a07e67485 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:07.942133344 +0000 UTC m=+64.086577955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qjm44" (UID: "0b258edf-9d2d-43b1-aba1-8a3a07e67485") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:03.942434 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:03.942184 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls podName:38720aac-3140-47d3-8772-1aef804e5f3f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:07.942168724 +0000 UTC m=+64.086613342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls") pod "cluster-samples-operator-65db858894-t274b" (UID: "38720aac-3140-47d3-8772-1aef804e5f3f") : secret "samples-operator-tls" not found Jul 15 19:15:04.042734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:04.042694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:04.042926 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:04.042870 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 19:15:04.042983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:04.042927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:04.042983 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:04.042950 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:08.042931132 +0000 UTC m=+64.187375748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : secret "router-metrics-certs-default" not found Jul 15 19:15:04.043085 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:04.043053 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:08.043036669 +0000 UTC m=+64.187481285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : configmap references non-existent config key: service-ca.crt Jul 15 19:15:04.589038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:04.589012 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2h95x" Jul 15 19:15:06.684284 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.683924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" event={"ID":"330ed2ee-5fb3-4428-b551-b933c47ec693","Type":"ContainerStarted","Data":"7f6912ef0403eb347444f080d1f5974b5fb34ded9fadca2ed9d89f8c8e96bb3a"} Jul 15 19:15:06.685945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.685918 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/0.log" Jul 15 19:15:06.686067 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.685960 2581 generic.go:356] "Generic (PLEG): container finished" podID="ede1146f-2531-47c9-89a5-f840d528eab6" containerID="6dc1a30329389bc0377c5e53fdc072b650db5e6660820231975d5506fc0e88df" exitCode=255 Jul 15 19:15:06.686067 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.686051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jdnzk" event={"ID":"ede1146f-2531-47c9-89a5-f840d528eab6","Type":"ContainerDied","Data":"6dc1a30329389bc0377c5e53fdc072b650db5e6660820231975d5506fc0e88df"} Jul 15 19:15:06.686302 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.686265 2581 scope.go:117] "RemoveContainer" containerID="6dc1a30329389bc0377c5e53fdc072b650db5e6660820231975d5506fc0e88df" Jul 15 19:15:06.687936 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.687908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" event={"ID":"2dfb87b6-a087-4433-a400-c6b5567f7d0f","Type":"ContainerStarted","Data":"e9b54a7fab3474a5af11038446b71ad7279cf55987559b4ea1c8b579f08fb6f6"} Jul 15 19:15:06.690187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.690103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" event={"ID":"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec","Type":"ContainerStarted","Data":"31f1eefc666b061818cc7c0308fb486b92c4a2a73f1c09b28e3105d8d58c80a8"} Jul 15 19:15:06.691783 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.691762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" event={"ID":"d0354250-88e0-4707-bd70-8496f6b754ad","Type":"ContainerStarted","Data":"9e4cf6eb7c4f39ed6e7b6e5d8fd10b19554587f3cd68728364d60f7ce8eac26d"} Jul 15 19:15:06.693956 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.693932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" event={"ID":"6bcfe752-3945-4f15-8958-09453fe4ed3a","Type":"ContainerStarted","Data":"08b0f746e418a1008e3d471a7f8c787cae91b6e7cc9c001dda430f87e1826f65"} Jul 15 19:15:06.702945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.702895 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vkt66" podStartSLOduration=1.443287638 podStartE2EDuration="6.702875067s" totalImagesPullingTime="5.259587429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:06.700520049 +0000 UTC m=+62.844964684" watchObservedRunningTime="2026-07-15 19:15:06.702875067 +0000 UTC m=+62.847319699" Jul 15 19:15:06.720791 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.720592 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r7mnd" podStartSLOduration=1.396104875 podStartE2EDuration="6.720573062s" totalImagesPullingTime="5.324468187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:06.719655128 +0000 UTC m=+62.864099764" watchObservedRunningTime="2026-07-15 19:15:06.720573062 +0000 UTC m=+62.865017696" Jul 15 19:15:06.737972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.737932 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" podStartSLOduration=1.554827161 podStartE2EDuration="6.737913882s" totalImagesPullingTime="5.183086721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:06.73651376 +0000 UTC m=+62.880958395" watchObservedRunningTime="2026-07-15 19:15:06.737913882 +0000 UTC m=+62.882358519" Jul 15 19:15:06.782719 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.782318 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" podStartSLOduration=1.5675807929999999 podStartE2EDuration="6.782267255s" totalImagesPullingTime="5.214686462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:06.763214727 +0000 UTC m=+62.907659361" watchObservedRunningTime="2026-07-15 19:15:06.782267255 +0000 UTC m=+62.926711889" Jul 15 19:15:06.783235 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:06.783194 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" podStartSLOduration=1.617594334 podStartE2EDuration="6.783180937s" totalImagesPullingTime="5.165586603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:06.78154197 +0000 UTC m=+62.925986601" watchObservedRunningTime="2026-07-15 19:15:06.783180937 +0000 UTC m=+62.927625548" Jul 15 19:15:07.660406 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.660364 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6gd4m"] Jul 15 19:15:07.663177 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.663145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.665960 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.665928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 19:15:07.666093 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.665993 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gg6xc\"" Jul 15 19:15:07.666961 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.666941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 19:15:07.673870 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.673848 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gd4m"] Jul 15 19:15:07.699769 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.699741 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/1.log" Jul 15 19:15:07.700184 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.700170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/0.log" Jul 15 19:15:07.700231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.700204 2581 generic.go:356] "Generic (PLEG): container finished" podID="ede1146f-2531-47c9-89a5-f840d528eab6" containerID="fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3" exitCode=255 Jul 15 19:15:07.700340 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.700322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jdnzk" event={"ID":"ede1146f-2531-47c9-89a5-f840d528eab6","Type":"ContainerDied","Data":"fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3"} Jul 15 19:15:07.700389 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.700370 2581 scope.go:117] "RemoveContainer" containerID="6dc1a30329389bc0377c5e53fdc072b650db5e6660820231975d5506fc0e88df" Jul 15 19:15:07.700566 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.700543 2581 scope.go:117] "RemoveContainer" containerID="fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3" Jul 15 19:15:07.700754 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.700730 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-jdnzk_openshift-console-operator(ede1146f-2531-47c9-89a5-f840d528eab6)\"" pod="openshift-console-operator/console-operator-7866497494-jdnzk" podUID="ede1146f-2531-47c9-89a5-f840d528eab6" Jul 15 19:15:07.781145 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.781106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a158cb5-f00b-44b6-a5ea-a98f557df640-data-volume\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.781334 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.781204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.781334 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.781226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.781442 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.781394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a158cb5-f00b-44b6-a5ea-a98f557df640-crio-socket\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.781827 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.781703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2294\" (UniqueName: \"kubernetes.io/projected/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-api-access-b2294\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882652 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.882608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a158cb5-f00b-44b6-a5ea-a98f557df640-crio-socket\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.882697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2294\" (UniqueName: \"kubernetes.io/projected/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-api-access-b2294\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.882718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a158cb5-f00b-44b6-a5ea-a98f557df640-data-volume\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.882749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a158cb5-f00b-44b6-a5ea-a98f557df640-crio-socket\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.882754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.882792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.882989 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.882868 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:15:07.882989 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.882924 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:08.382909772 +0000 UTC m=+64.527354382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : configmap "kube-rbac-proxy" not found Jul 15 19:15:07.882989 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.882921 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:15:07.882989 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.882948 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:08.382942322 +0000 UTC m=+64.527386932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : secret "insights-runtime-extractor-tls" not found Jul 15 19:15:07.883125 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.883056 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a158cb5-f00b-44b6-a5ea-a98f557df640-data-volume\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.892357 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.892335 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2294\" (UniqueName: \"kubernetes.io/projected/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-api-access-b2294\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:07.983498 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.983411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:07.983627 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.983573 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 19:15:07.983627 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:07.983599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:07.983699 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.983655 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls podName:38720aac-3140-47d3-8772-1aef804e5f3f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:15.983635035 +0000 UTC m=+72.128079700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls") pod "cluster-samples-operator-65db858894-t274b" (UID: "38720aac-3140-47d3-8772-1aef804e5f3f") : secret "samples-operator-tls" not found Jul 15 19:15:07.983744 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.983710 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:07.983779 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:07.983758 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls podName:0b258edf-9d2d-43b1-aba1-8a3a07e67485 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:15.983746544 +0000 UTC m=+72.128191173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qjm44" (UID: "0b258edf-9d2d-43b1-aba1-8a3a07e67485") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:08.084528 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:08.084492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:08.084694 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:08.084560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:08.084694 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.084653 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 19:15:08.084779 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.084697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:16.084684342 +0000 UTC m=+72.229128954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : configmap references non-existent config key: service-ca.crt Jul 15 19:15:08.084779 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.084711 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:16.084705362 +0000 UTC m=+72.229149973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : secret "router-metrics-certs-default" not found Jul 15 19:15:08.387134 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:08.387049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:08.387273 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.387178 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:15:08.387273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:08.387238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:08.387273 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.387253 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:09.387234865 +0000 UTC m=+65.531679493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : configmap "kube-rbac-proxy" not found Jul 15 19:15:08.387436 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.387374 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:15:08.387436 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.387424 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:09.387410897 +0000 UTC m=+65.531855511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : secret "insights-runtime-extractor-tls" not found Jul 15 19:15:08.704703 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:08.704673 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/1.log" Jul 15 19:15:08.705172 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:08.705086 2581 scope.go:117] "RemoveContainer" containerID="fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3" Jul 15 19:15:08.705364 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:08.705340 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-jdnzk_openshift-console-operator(ede1146f-2531-47c9-89a5-f840d528eab6)\"" pod="openshift-console-operator/console-operator-7866497494-jdnzk" podUID="ede1146f-2531-47c9-89a5-f840d528eab6" Jul 15 19:15:09.238277 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:09.238251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s8pgs_d15bbcc7-4e83-4761-adce-d5d6e90dcbd3/dns-node-resolver/0.log" Jul 15 19:15:09.397780 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:09.397725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:09.397780 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:09.397783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:09.398019 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:09.397894 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:15:09.398019 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:09.397956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:11.397941875 +0000 UTC m=+67.542386491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : secret "insights-runtime-extractor-tls" not found Jul 15 19:15:09.398019 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:09.397898 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:15:09.398164 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:09.398092 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:11.398067744 +0000 UTC m=+67.542512369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : configmap "kube-rbac-proxy" not found Jul 15 19:15:10.105309 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.105250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:15:10.107976 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.107955 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 19:15:10.116111 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:10.116090 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 19:15:10.116179 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:10.116159 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs podName:78f93904-f3eb-4460-8064-82eeb57518fd nodeName:}" failed. No retries permitted until 2026-07-15 19:16:14.116141848 +0000 UTC m=+130.260586459 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs") pod "network-metrics-daemon-zttsd" (UID: "78f93904-f3eb-4460-8064-82eeb57518fd") : secret "metrics-daemon-secret" not found Jul 15 19:15:10.206224 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.206186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:15:10.209123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.209105 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 19:15:10.218705 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.218676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863e847e-a9ad-4621-8e81-fb8a2060f55f-original-pull-secret\") pod \"global-pull-secret-syncer-xv76q\" (UID: \"863e847e-a9ad-4621-8e81-fb8a2060f55f\") " pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:15:10.307490 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.307452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:15:10.310109 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.310084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8gd\" (UniqueName: \"kubernetes.io/projected/29620974-a142-4563-82dc-356fc4a4fd0c-kube-api-access-cs8gd\") pod \"network-check-target-2jt9m\" (UID: \"29620974-a142-4563-82dc-356fc4a4fd0c\") " pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:15:10.316734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.316701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xv76q" Jul 15 19:15:10.331571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.331534 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pjk9x\"" Jul 15 19:15:10.339076 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.339042 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:15:10.438603 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.438550 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nvjrg_980ab03e-aafb-4f74-833b-9085a8080638/node-ca/0.log" Jul 15 19:15:10.455090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.455059 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xv76q"] Jul 15 19:15:10.458157 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:10.458124 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863e847e_a9ad_4621_8e81_fb8a2060f55f.slice/crio-d6ccc7062c30bcf8cc18b6814574ce7eae2afd54ed9c343b51908120953e23ec WatchSource:0}: Error finding container d6ccc7062c30bcf8cc18b6814574ce7eae2afd54ed9c343b51908120953e23ec: Status 404 returned error can't find the container with id d6ccc7062c30bcf8cc18b6814574ce7eae2afd54ed9c343b51908120953e23ec Jul 15 19:15:10.475198 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.475171 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2jt9m"] Jul 15 19:15:10.478040 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:10.478008 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29620974_a142_4563_82dc_356fc4a4fd0c.slice/crio-f09802a4c7046a35114111b9c36232a98078d47ed20d4e8c8a1a3be63f1e2343 WatchSource:0}: Error finding container f09802a4c7046a35114111b9c36232a98078d47ed20d4e8c8a1a3be63f1e2343: Status 404 returned error can't find the container with id f09802a4c7046a35114111b9c36232a98078d47ed20d4e8c8a1a3be63f1e2343 Jul 15 19:15:10.667847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.667811 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:10.668011 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.667870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:10.668210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.668198 2581 scope.go:117] "RemoveContainer" containerID="fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3" Jul 15 19:15:10.668391 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:10.668372 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-jdnzk_openshift-console-operator(ede1146f-2531-47c9-89a5-f840d528eab6)\"" pod="openshift-console-operator/console-operator-7866497494-jdnzk" podUID="ede1146f-2531-47c9-89a5-f840d528eab6" Jul 15 19:15:10.711456 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.711416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xv76q" event={"ID":"863e847e-a9ad-4621-8e81-fb8a2060f55f","Type":"ContainerStarted","Data":"d6ccc7062c30bcf8cc18b6814574ce7eae2afd54ed9c343b51908120953e23ec"} Jul 15 19:15:10.712800 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.712773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2jt9m" event={"ID":"29620974-a142-4563-82dc-356fc4a4fd0c","Type":"ContainerStarted","Data":"20f8af9d17de0d521b9d6a7bf46f6574238c5b377c2874111abe497eedb64a58"} Jul 15 19:15:10.712909 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.712816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2jt9m" event={"ID":"29620974-a142-4563-82dc-356fc4a4fd0c","Type":"ContainerStarted","Data":"f09802a4c7046a35114111b9c36232a98078d47ed20d4e8c8a1a3be63f1e2343"} Jul 15 19:15:10.712909 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.712901 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:15:10.733088 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.733030 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2jt9m" podStartSLOduration=65.733011774 podStartE2EDuration="1m5.733011774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:10.732077527 +0000 UTC m=+66.876522163" watchObservedRunningTime="2026-07-15 19:15:10.733011774 +0000 UTC m=+66.877456385" Jul 15 19:15:10.839023 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:10.838989 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t2j6_d394df5d-135f-45d9-8647-26db0fcc9eb2/serve-healthcheck-canary/0.log" Jul 15 19:15:11.014053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:11.013959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:15:11.014223 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.014137 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 19:15:11.014223 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.014160 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79f8459cd4-x6bx7: secret "image-registry-tls" not found Jul 15 19:15:11.014360 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.014227 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls podName:ae9d0031-b8eb-47cf-b309-b08391de1fbb nodeName:}" failed. No retries permitted until 2026-07-15 19:15:43.014207105 +0000 UTC m=+99.158651745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls") pod "image-registry-79f8459cd4-x6bx7" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb") : secret "image-registry-tls" not found Jul 15 19:15:11.114952 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:11.114914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:15:11.115403 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.115093 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 19:15:11.115403 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.115171 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls podName:9f473ffd-ddd4-45df-96b8-5556d3d8cb51 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:43.11514933 +0000 UTC m=+99.259593946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls") pod "dns-default-brlgd" (UID: "9f473ffd-ddd4-45df-96b8-5556d3d8cb51") : secret "dns-default-metrics-tls" not found Jul 15 19:15:11.417308 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:11.417246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:11.417471 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:11.417315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:11.417471 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.417389 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:15:11.417471 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.417414 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:15:11.417471 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.417466 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:15.417450469 +0000 UTC m=+71.561895086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : configmap "kube-rbac-proxy" not found Jul 15 19:15:11.417650 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:11.417482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:15.417475768 +0000 UTC m=+71.561920426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : secret "insights-runtime-extractor-tls" not found Jul 15 19:15:15.454370 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:15.454333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:15.454745 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:15.454463 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 19:15:15.454745 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:15.454471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:15.454745 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:15.454527 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:23.454511239 +0000 UTC m=+79.598955853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : configmap "kube-rbac-proxy" not found Jul 15 19:15:15.454745 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:15.454562 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:15:15.454745 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:15.454603 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:23.454589656 +0000 UTC m=+79.599034267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : secret "insights-runtime-extractor-tls" not found Jul 15 19:15:15.731524 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:15.731439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xv76q" event={"ID":"863e847e-a9ad-4621-8e81-fb8a2060f55f","Type":"ContainerStarted","Data":"c0bf8494824c7a5e57beac191290585b5a734254e0e8e3c24c9d0fbf648e305d"} Jul 15 19:15:15.758757 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:15.758690 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xv76q" podStartSLOduration=66.076404199 podStartE2EDuration="1m10.758675498s" totalImagesPullingTime="4.682271299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:15.757687818 +0000 UTC m=+71.902132456" watchObservedRunningTime="2026-07-15 19:15:15.758675498 +0000 UTC m=+71.903120131" Jul 15 19:15:16.059639 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:16.059558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:16.059639 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:16.059612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:16.059829 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.059705 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:16.059829 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.059740 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 19:15:16.059829 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.059771 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls podName:0b258edf-9d2d-43b1-aba1-8a3a07e67485 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:32.059756788 +0000 UTC m=+88.204201401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qjm44" (UID: "0b258edf-9d2d-43b1-aba1-8a3a07e67485") : secret "cluster-monitoring-operator-tls" not found Jul 15 19:15:16.059829 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.059798 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls podName:38720aac-3140-47d3-8772-1aef804e5f3f nodeName:}" failed. No retries permitted until 2026-07-15 19:15:32.059786678 +0000 UTC m=+88.204231292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls") pod "cluster-samples-operator-65db858894-t274b" (UID: "38720aac-3140-47d3-8772-1aef804e5f3f") : secret "samples-operator-tls" not found Jul 15 19:15:16.160245 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:16.160216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:16.160381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:16.160342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:16.160419 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.160404 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:32.160384664 +0000 UTC m=+88.304829276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : configmap references non-existent config key: service-ca.crt Jul 15 19:15:16.160459 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.160440 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 19:15:16.160491 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:16.160478 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs podName:2a99eb45-c843-407d-93e8-a804e8f24025 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:32.16046743 +0000 UTC m=+88.304912041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs") pod "router-default-59d6798796-8ds8g" (UID: "2a99eb45-c843-407d-93e8-a804e8f24025") : secret "router-metrics-certs-default" not found Jul 15 19:15:23.529089 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:23.529038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:23.529089 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:23.529102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:23.529611 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:23.529164 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 19:15:23.529611 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:23.529233 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls podName:5a158cb5-f00b-44b6-a5ea-a98f557df640 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:39.529216367 +0000 UTC m=+95.673660977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gd4m" (UID: "5a158cb5-f00b-44b6-a5ea-a98f557df640") : secret "insights-runtime-extractor-tls" not found Jul 15 19:15:23.529611 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:23.529569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a158cb5-f00b-44b6-a5ea-a98f557df640-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:24.407703 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.407672 2581 scope.go:117] "RemoveContainer" containerID="fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3" Jul 15 19:15:24.760567 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.760490 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:15:24.760988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.760907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/1.log" Jul 15 19:15:24.760988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.760945 2581 generic.go:356] "Generic (PLEG): container finished" podID="ede1146f-2531-47c9-89a5-f840d528eab6" containerID="f6d3d1d2a3716937d2f94e1eccbf62b8d877bf9d024a4e67908f1a9fb2b44709" exitCode=255 Jul 15 19:15:24.761104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.761005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jdnzk" event={"ID":"ede1146f-2531-47c9-89a5-f840d528eab6","Type":"ContainerDied","Data":"f6d3d1d2a3716937d2f94e1eccbf62b8d877bf9d024a4e67908f1a9fb2b44709"} Jul 15 19:15:24.761104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.761066 2581 scope.go:117] "RemoveContainer" containerID="fc7484d9a0c1c6e2ab45a16370140a885bb94ddec45e0c221ed17cae040c6ed3" Jul 15 19:15:24.761386 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:24.761368 2581 scope.go:117] "RemoveContainer" containerID="f6d3d1d2a3716937d2f94e1eccbf62b8d877bf9d024a4e67908f1a9fb2b44709" Jul 15 19:15:24.761583 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:24.761560 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-jdnzk_openshift-console-operator(ede1146f-2531-47c9-89a5-f840d528eab6)\"" pod="openshift-console-operator/console-operator-7866497494-jdnzk" podUID="ede1146f-2531-47c9-89a5-f840d528eab6" Jul 15 19:15:25.766051 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:25.766024 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:15:28.370944 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.370825 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj"] Jul 15 19:15:28.374874 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.374856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.377845 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.377808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 19:15:28.377845 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.377814 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 19:15:28.378204 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.378168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 19:15:28.379165 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.379148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 19:15:28.379264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.379205 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 19:15:28.379264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.379250 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 19:15:28.379264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.379256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 19:15:28.394107 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.394083 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj"] Jul 15 19:15:28.472710 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.472674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.472710 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.472710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-ca\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.472916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.472811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtwzm\" (UniqueName: \"kubernetes.io/projected/36b6d40f-51b0-41da-9e15-81904af3d374-kube-api-access-jtwzm\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.472916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.472847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36b6d40f-51b0-41da-9e15-81904af3d374-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.472916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.472894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-hub\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.473018 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.472929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.573767 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.573737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtwzm\" (UniqueName: \"kubernetes.io/projected/36b6d40f-51b0-41da-9e15-81904af3d374-kube-api-access-jtwzm\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.573767 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.573772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36b6d40f-51b0-41da-9e15-81904af3d374-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.573984 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.573859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-hub\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.573984 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.573898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.573984 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.573947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.573984 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.573974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-ca\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.574580 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.574550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/36b6d40f-51b0-41da-9e15-81904af3d374-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.576513 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.576490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-hub\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.576625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.576551 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-ca\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.576625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.576578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.576761 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.576743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36b6d40f-51b0-41da-9e15-81904af3d374-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.583365 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.583314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtwzm\" (UniqueName: \"kubernetes.io/projected/36b6d40f-51b0-41da-9e15-81904af3d374-kube-api-access-jtwzm\") pod \"cluster-proxy-proxy-agent-7cffc7b885-qp2rj\" (UID: \"36b6d40f-51b0-41da-9e15-81904af3d374\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.700048 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.700011 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" Jul 15 19:15:28.831779 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:28.831751 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj"] Jul 15 19:15:28.833504 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:28.833474 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36b6d40f_51b0_41da_9e15_81904af3d374.slice/crio-2f027a7ff8437d797e77be5e78ae1551d545eb1aab4b33b7ced4bb846cb558eb WatchSource:0}: Error finding container 2f027a7ff8437d797e77be5e78ae1551d545eb1aab4b33b7ced4bb846cb558eb: Status 404 returned error can't find the container with id 2f027a7ff8437d797e77be5e78ae1551d545eb1aab4b33b7ced4bb846cb558eb Jul 15 19:15:29.783041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:29.783006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" event={"ID":"36b6d40f-51b0-41da-9e15-81904af3d374","Type":"ContainerStarted","Data":"2f027a7ff8437d797e77be5e78ae1551d545eb1aab4b33b7ced4bb846cb558eb"} Jul 15 19:15:30.668096 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:30.668057 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:30.668276 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:30.668121 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:30.668533 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:30.668514 2581 scope.go:117] "RemoveContainer" containerID="f6d3d1d2a3716937d2f94e1eccbf62b8d877bf9d024a4e67908f1a9fb2b44709" Jul 15 19:15:30.668762 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:30.668731 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-jdnzk_openshift-console-operator(ede1146f-2531-47c9-89a5-f840d528eab6)\"" pod="openshift-console-operator/console-operator-7866497494-jdnzk" podUID="ede1146f-2531-47c9-89a5-f840d528eab6" Jul 15 19:15:32.106406 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.106369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:32.106882 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.106431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:32.109175 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.109144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38720aac-3140-47d3-8772-1aef804e5f3f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t274b\" (UID: \"38720aac-3140-47d3-8772-1aef804e5f3f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:32.109315 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.109197 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b258edf-9d2d-43b1-aba1-8a3a07e67485-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qjm44\" (UID: \"0b258edf-9d2d-43b1-aba1-8a3a07e67485\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:32.207906 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.207869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:32.208098 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.207955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:32.208621 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.208594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a99eb45-c843-407d-93e8-a804e8f24025-service-ca-bundle\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:32.210869 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.210837 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a99eb45-c843-407d-93e8-a804e8f24025-metrics-certs\") pod \"router-default-59d6798796-8ds8g\" (UID: \"2a99eb45-c843-407d-93e8-a804e8f24025\") " pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:32.378091 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.378066 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5bnkl\"" Jul 15 19:15:32.385261 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.385243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" Jul 15 19:15:32.385570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.385546 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gb5c7\"" Jul 15 19:15:32.394227 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.394202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" Jul 15 19:15:32.502743 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.502706 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtf5f\"" Jul 15 19:15:32.510516 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.510464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:32.532274 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.532173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b"] Jul 15 19:15:32.549695 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.549663 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44"] Jul 15 19:15:32.552430 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:32.552400 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b258edf_9d2d_43b1_aba1_8a3a07e67485.slice/crio-68f8a506e5d1bfcf6f0417ddca4634542c5ae1b5af0159fd40f61ef786ef3257 WatchSource:0}: Error finding container 68f8a506e5d1bfcf6f0417ddca4634542c5ae1b5af0159fd40f61ef786ef3257: Status 404 returned error can't find the container with id 68f8a506e5d1bfcf6f0417ddca4634542c5ae1b5af0159fd40f61ef786ef3257 Jul 15 19:15:32.658251 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.658223 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59d6798796-8ds8g"] Jul 15 19:15:32.660460 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:32.660428 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a99eb45_c843_407d_93e8_a804e8f24025.slice/crio-c7b2cd9d74e3ca36deb59ef1303f03ca2d979371a4939fe226be40ef685f20c5 WatchSource:0}: Error finding container c7b2cd9d74e3ca36deb59ef1303f03ca2d979371a4939fe226be40ef685f20c5: Status 404 returned error can't find the container with id c7b2cd9d74e3ca36deb59ef1303f03ca2d979371a4939fe226be40ef685f20c5 Jul 15 19:15:32.796981 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.796949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59d6798796-8ds8g" event={"ID":"2a99eb45-c843-407d-93e8-a804e8f24025","Type":"ContainerStarted","Data":"af2f625bd951f8b31ebed89124999ea94bcda1036c58dba7830ad0fb25439eff"} Jul 15 19:15:32.797165 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.796996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59d6798796-8ds8g" event={"ID":"2a99eb45-c843-407d-93e8-a804e8f24025","Type":"ContainerStarted","Data":"c7b2cd9d74e3ca36deb59ef1303f03ca2d979371a4939fe226be40ef685f20c5"} Jul 15 19:15:32.798147 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.798119 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" event={"ID":"38720aac-3140-47d3-8772-1aef804e5f3f","Type":"ContainerStarted","Data":"fbc6f525f1c0a92d72f302782fbfa2e524e2fee3553ce3c6a2dbb0b308155af4"} Jul 15 19:15:32.799971 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.799937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" event={"ID":"36b6d40f-51b0-41da-9e15-81904af3d374","Type":"ContainerStarted","Data":"d5bea0b304c62ae59cff7ef7848a4c5068a1c0ea325f66e1018999b1f3321465"} Jul 15 19:15:32.800053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.799973 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" event={"ID":"36b6d40f-51b0-41da-9e15-81904af3d374","Type":"ContainerStarted","Data":"ca81c2535c6311f150c28867b1212a0f2ac69ed13a44895fc5751ebf6b0c26a4"} Jul 15 19:15:32.800053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.799993 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" event={"ID":"36b6d40f-51b0-41da-9e15-81904af3d374","Type":"ContainerStarted","Data":"76559590c3955fbb7f37f1558ecf7b03b4e20b7bfbfe7191a6ee06004c14e6a8"} Jul 15 19:15:32.801052 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.801031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" event={"ID":"0b258edf-9d2d-43b1-aba1-8a3a07e67485","Type":"ContainerStarted","Data":"68f8a506e5d1bfcf6f0417ddca4634542c5ae1b5af0159fd40f61ef786ef3257"} Jul 15 19:15:32.819393 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.819347 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59d6798796-8ds8g" podStartSLOduration=32.819333033 podStartE2EDuration="32.819333033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:32.818490916 +0000 UTC m=+88.962935560" watchObservedRunningTime="2026-07-15 19:15:32.819333033 +0000 UTC m=+88.963777665" Jul 15 19:15:32.842434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:32.842381 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cffc7b885-qp2rj" podStartSLOduration=1.38154949 podStartE2EDuration="4.842364832s" totalImagesPullingTime="3.460815342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:32.84098294 +0000 UTC m=+88.985427574" watchObservedRunningTime="2026-07-15 19:15:32.842364832 +0000 UTC m=+88.986809465" Jul 15 19:15:33.511285 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:33.511244 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:33.514168 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:33.514146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:33.806437 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:33.806326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:33.807872 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:33.807845 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59d6798796-8ds8g" Jul 15 19:15:35.815034 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:35.814998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" event={"ID":"38720aac-3140-47d3-8772-1aef804e5f3f","Type":"ContainerStarted","Data":"9bae447ecfde8b2f6fbeb3be996b36dbb8caf6cc7ac970fc1256c16915d64634"} Jul 15 19:15:35.815518 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:35.815090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" event={"ID":"38720aac-3140-47d3-8772-1aef804e5f3f","Type":"ContainerStarted","Data":"be6a380d4c7dab21225a549d9de2d8d7168ae37332d1d9ba7dcfe31531166455"} Jul 15 19:15:35.816479 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:35.816455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" event={"ID":"0b258edf-9d2d-43b1-aba1-8a3a07e67485","Type":"ContainerStarted","Data":"3dcbfd55553e1648c1af761147a329b2b50d5f13e146e4fe852bf2c6349e9acb"} Jul 15 19:15:35.834302 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:35.834238 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t274b" podStartSLOduration=33.118302149 podStartE2EDuration="35.834223309s" totalImagesPullingTime="2.71592116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:35.833378066 +0000 UTC m=+91.977822699" watchObservedRunningTime="2026-07-15 19:15:35.834223309 +0000 UTC m=+91.978667941" Jul 15 19:15:35.856440 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:35.856382 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qjm44" podStartSLOduration=33.652356722 podStartE2EDuration="35.856362529s" totalImagesPullingTime="2.204005807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:35.856186928 +0000 UTC m=+92.000631562" watchObservedRunningTime="2026-07-15 19:15:35.856362529 +0000 UTC m=+92.000807157" Jul 15 19:15:39.573555 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:39.573517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:39.575827 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:39.575800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a158cb5-f00b-44b6-a5ea-a98f557df640-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gd4m\" (UID: \"5a158cb5-f00b-44b6-a5ea-a98f557df640\") " pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:39.772050 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:39.772011 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gd4m" Jul 15 19:15:39.935723 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:39.935696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gd4m"] Jul 15 19:15:39.937983 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:39.937957 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a158cb5_f00b_44b6_a5ea_a98f557df640.slice/crio-54c48a7bb8829ee93e6895817d62333f3db6a6a3854986f299c89c3e425ce09b WatchSource:0}: Error finding container 54c48a7bb8829ee93e6895817d62333f3db6a6a3854986f299c89c3e425ce09b: Status 404 returned error can't find the container with id 54c48a7bb8829ee93e6895817d62333f3db6a6a3854986f299c89c3e425ce09b Jul 15 19:15:40.835763 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:40.835728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gd4m" event={"ID":"5a158cb5-f00b-44b6-a5ea-a98f557df640","Type":"ContainerStarted","Data":"54c48a7bb8829ee93e6895817d62333f3db6a6a3854986f299c89c3e425ce09b"} Jul 15 19:15:41.719844 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:41.719812 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2jt9m" Jul 15 19:15:43.103225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.103185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:15:43.105864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.105835 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"image-registry-79f8459cd4-x6bx7\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:15:43.204275 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.204232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:15:43.206780 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.206758 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f473ffd-ddd4-45df-96b8-5556d3d8cb51-metrics-tls\") pod \"dns-default-brlgd\" (UID: \"9f473ffd-ddd4-45df-96b8-5556d3d8cb51\") " pod="openshift-dns/dns-default-brlgd" Jul 15 19:15:43.371138 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.371062 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xd8s9\"" Jul 15 19:15:43.378705 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.378677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:15:43.382582 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.382560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l2njj\"" Jul 15 19:15:43.391003 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:43.390978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-brlgd" Jul 15 19:15:45.404609 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:45.404579 2581 scope.go:117] "RemoveContainer" containerID="f6d3d1d2a3716937d2f94e1eccbf62b8d877bf9d024a4e67908f1a9fb2b44709" Jul 15 19:15:45.860613 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:45.860399 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:15:45.957674 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:45.957641 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-brlgd"] Jul 15 19:15:45.960812 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:45.960785 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f473ffd_ddd4_45df_96b8_5556d3d8cb51.slice/crio-10ae6fe32bc4c469ba69066201a4086d1187a69a73692c43c0c1a66c9d49593c WatchSource:0}: Error finding container 10ae6fe32bc4c469ba69066201a4086d1187a69a73692c43c0c1a66c9d49593c: Status 404 returned error can't find the container with id 10ae6fe32bc4c469ba69066201a4086d1187a69a73692c43c0c1a66c9d49593c Jul 15 19:15:45.983403 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:45.983365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79f8459cd4-x6bx7"] Jul 15 19:15:45.987424 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:45.987392 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9d0031_b8eb_47cf_b309_b08391de1fbb.slice/crio-e4e2d143bd9e7a84f46d55cd620dcfcbe546734a57796a397e0c40548e553933 WatchSource:0}: Error finding container e4e2d143bd9e7a84f46d55cd620dcfcbe546734a57796a397e0c40548e553933: Status 404 returned error can't find the container with id e4e2d143bd9e7a84f46d55cd620dcfcbe546734a57796a397e0c40548e553933 Jul 15 19:15:46.865801 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.865765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gd4m" event={"ID":"5a158cb5-f00b-44b6-a5ea-a98f557df640","Type":"ContainerStarted","Data":"78e0e23c62156b0704aae210cba77572682942032acc867ea09aef850fbfcac8"} Jul 15 19:15:46.867418 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.867382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" event={"ID":"ae9d0031-b8eb-47cf-b309-b08391de1fbb","Type":"ContainerStarted","Data":"2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b"} Jul 15 19:15:46.867570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.867437 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" event={"ID":"ae9d0031-b8eb-47cf-b309-b08391de1fbb","Type":"ContainerStarted","Data":"e4e2d143bd9e7a84f46d55cd620dcfcbe546734a57796a397e0c40548e553933"} Jul 15 19:15:46.867635 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.867586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:15:46.868743 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.868718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-brlgd" event={"ID":"9f473ffd-ddd4-45df-96b8-5556d3d8cb51","Type":"ContainerStarted","Data":"10ae6fe32bc4c469ba69066201a4086d1187a69a73692c43c0c1a66c9d49593c"} Jul 15 19:15:46.870364 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.870345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:15:46.870463 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.870406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jdnzk" event={"ID":"ede1146f-2531-47c9-89a5-f840d528eab6","Type":"ContainerStarted","Data":"e10f811fcfae40d2cfe96e44b20cc01614862cfb5e12936c9c94ba9cec40c561"} Jul 15 19:15:46.870689 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.870670 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:46.876106 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.876087 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-jdnzk" Jul 15 19:15:46.892943 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.892883 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" podStartSLOduration=101.892862032 podStartE2EDuration="1m41.892862032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:46.890777072 +0000 UTC m=+103.035221719" watchObservedRunningTime="2026-07-15 19:15:46.892862032 +0000 UTC m=+103.037306666" Jul 15 19:15:46.913307 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:46.913228 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-jdnzk" podStartSLOduration=41.729787403 podStartE2EDuration="46.913211161s" totalImagesPullingTime="5.183423758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:46.912263295 +0000 UTC m=+103.056707932" watchObservedRunningTime="2026-07-15 19:15:46.913211161 +0000 UTC m=+103.057655793" Jul 15 19:15:47.807124 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.807093 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8gbhl"] Jul 15 19:15:47.815698 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.815670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.818385 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.818363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 19:15:47.818532 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.818513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 19:15:47.818614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.818597 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-znk59\"" Jul 15 19:15:47.819594 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.819577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 19:15:47.819679 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.819611 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 19:15:47.845241 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-textfile\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-tls\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-root\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-wtmp\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a597c66-f08b-4193-9763-13141df7a773-metrics-client-ca\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845520 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-sys\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845666 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.845666 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.845625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7t4n\" (UniqueName: \"kubernetes.io/projected/0a597c66-f08b-4193-9763-13141df7a773-kube-api-access-v7t4n\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.875898 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.875857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-brlgd" event={"ID":"9f473ffd-ddd4-45df-96b8-5556d3d8cb51","Type":"ContainerStarted","Data":"f806f8b13f5c15a3dc3c41f773e8bcd9610fd9b36a4d4f619597c382f520c23d"} Jul 15 19:15:47.946309 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.946199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a597c66-f08b-4193-9763-13141df7a773-metrics-client-ca\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.947680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.947207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.947680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.947275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-sys\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.947680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.947405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.947680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.947441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7t4n\" (UniqueName: \"kubernetes.io/projected/0a597c66-f08b-4193-9763-13141df7a773-kube-api-access-v7t4n\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.947680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.947496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-textfile\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.947680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.947526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-tls\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.956330 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.955847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-root\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.956330 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.955914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-wtmp\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.956330 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.956179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-wtmp\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.956330 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.956244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-root\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.957735 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.957676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-textfile\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.957876 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:47.957770 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 19:15:47.957876 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:15:47.957851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-tls podName:0a597c66-f08b-4193-9763-13141df7a773 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:48.457824887 +0000 UTC m=+104.602269503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-tls") pod "node-exporter-8gbhl" (UID: "0a597c66-f08b-4193-9763-13141df7a773") : secret "node-exporter-tls" not found Jul 15 19:15:47.957995 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.957919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a597c66-f08b-4193-9763-13141df7a773-sys\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.958403 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.958337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a597c66-f08b-4193-9763-13141df7a773-metrics-client-ca\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.959756 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.959703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.962786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.962766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:47.973130 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:47.972661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7t4n\" (UniqueName: \"kubernetes.io/projected/0a597c66-f08b-4193-9763-13141df7a773-kube-api-access-v7t4n\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:48.460667 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:48.460624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-tls\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:48.463374 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:48.463336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a597c66-f08b-4193-9763-13141df7a773-node-exporter-tls\") pod \"node-exporter-8gbhl\" (UID: \"0a597c66-f08b-4193-9763-13141df7a773\") " pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:48.727486 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:48.727357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8gbhl" Jul 15 19:15:48.753357 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:15:48.753266 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a597c66_f08b_4193_9763_13141df7a773.slice/crio-fd784d84c4c3a77634c746e42a88a662fc12aeb676bf07842a78e8c0682b7ed3 WatchSource:0}: Error finding container fd784d84c4c3a77634c746e42a88a662fc12aeb676bf07842a78e8c0682b7ed3: Status 404 returned error can't find the container with id fd784d84c4c3a77634c746e42a88a662fc12aeb676bf07842a78e8c0682b7ed3 Jul 15 19:15:48.882076 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:48.882042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gbhl" event={"ID":"0a597c66-f08b-4193-9763-13141df7a773","Type":"ContainerStarted","Data":"fd784d84c4c3a77634c746e42a88a662fc12aeb676bf07842a78e8c0682b7ed3"} Jul 15 19:15:48.884548 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:48.884449 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-brlgd" event={"ID":"9f473ffd-ddd4-45df-96b8-5556d3d8cb51","Type":"ContainerStarted","Data":"b25c164e6063537d66371cb6fb4514640a9f5f62e947eaa189be4af6a4ceb95c"} Jul 15 19:15:48.884699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:48.884621 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-brlgd" Jul 15 19:15:51.713022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:51.712970 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-brlgd" podStartSLOduration=70.941777663 podStartE2EDuration="1m12.712949755s" totalImagesPullingTime="1.771172092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:48.905214011 +0000 UTC m=+105.049658647" watchObservedRunningTime="2026-07-15 19:15:51.712949755 +0000 UTC m=+107.857394389" Jul 15 19:15:51.713931 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:51.713911 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79f8459cd4-x6bx7"] Jul 15 19:15:51.897468 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:51.897437 2581 generic.go:356] "Generic (PLEG): container finished" podID="0a597c66-f08b-4193-9763-13141df7a773" containerID="1c81a96e20cde5671482cf138da22a2012980b97bcaad112a7ce22c4c0e371d9" exitCode=0 Jul 15 19:15:51.897641 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:51.897522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gbhl" event={"ID":"0a597c66-f08b-4193-9763-13141df7a773","Type":"ContainerDied","Data":"1c81a96e20cde5671482cf138da22a2012980b97bcaad112a7ce22c4c0e371d9"} Jul 15 19:15:51.899629 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:51.899604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gd4m" event={"ID":"5a158cb5-f00b-44b6-a5ea-a98f557df640","Type":"ContainerStarted","Data":"b5e0af450545b4bc83b8a4991c01054d15cd5a6a5107372dbe209a693e28a064"} Jul 15 19:15:52.905855 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:52.905813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gbhl" event={"ID":"0a597c66-f08b-4193-9763-13141df7a773","Type":"ContainerStarted","Data":"6f8dd328faf4602c9a105c9c672cdfecb0755995eed01be8fa5771330e3ac6ee"} Jul 15 19:15:52.906347 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:52.905872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gbhl" event={"ID":"0a597c66-f08b-4193-9763-13141df7a773","Type":"ContainerStarted","Data":"c1751de33b1209c41b02466c955d40c8da8bd68a57d5f64a44291d7ae65c1507"} Jul 15 19:15:52.932255 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:52.932206 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8gbhl" podStartSLOduration=3.282735521 podStartE2EDuration="5.932189599s" totalImagesPullingTime="2.585781231s" totalInitContainerRuntime="63.672847ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:52.929922919 +0000 UTC m=+109.074367573" watchObservedRunningTime="2026-07-15 19:15:52.932189599 +0000 UTC m=+109.076634231" Jul 15 19:15:56.924039 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:56.924002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gd4m" event={"ID":"5a158cb5-f00b-44b6-a5ea-a98f557df640","Type":"ContainerStarted","Data":"72188a1d9596da341601ac2c0b46279cccd19fab993103fa9a24dd0b4cae11f7"} Jul 15 19:15:56.948860 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:56.948805 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6gd4m" podStartSLOduration=34.098380204 podStartE2EDuration="49.948789124s" totalImagesPullingTime="15.85040892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:56.946648855 +0000 UTC m=+113.091093503" watchObservedRunningTime="2026-07-15 19:15:56.948789124 +0000 UTC m=+113.093233757" Jul 15 19:15:58.891586 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:15:58.891557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-brlgd" Jul 15 19:16:01.720478 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:01.720451 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:16:12.987238 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:12.987198 2581 generic.go:356] "Generic (PLEG): container finished" podID="8e4cbc00-51f7-48af-b137-bc6bb3a6cdec" containerID="31f1eefc666b061818cc7c0308fb486b92c4a2a73f1c09b28e3105d8d58c80a8" exitCode=0 Jul 15 19:16:12.987668 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:12.987271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" event={"ID":"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec","Type":"ContainerDied","Data":"31f1eefc666b061818cc7c0308fb486b92c4a2a73f1c09b28e3105d8d58c80a8"} Jul 15 19:16:12.987668 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:12.987649 2581 scope.go:117] "RemoveContainer" containerID="31f1eefc666b061818cc7c0308fb486b92c4a2a73f1c09b28e3105d8d58c80a8" Jul 15 19:16:13.996002 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:13.995969 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xlrwl" event={"ID":"8e4cbc00-51f7-48af-b137-bc6bb3a6cdec","Type":"ContainerStarted","Data":"b30e1cd76fd24028bac4bdb02b50c2fb558494ea6fe56059e879770c9e718c96"} Jul 15 19:16:14.185714 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:14.185672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:16:14.188065 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:14.188040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78f93904-f3eb-4460-8064-82eeb57518fd-metrics-certs\") pod \"network-metrics-daemon-zttsd\" (UID: \"78f93904-f3eb-4460-8064-82eeb57518fd\") " pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:16:14.226550 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:14.226522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sk5rd\"" Jul 15 19:16:14.233636 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:14.233612 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zttsd" Jul 15 19:16:14.429170 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:14.429042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zttsd"] Jul 15 19:16:14.431663 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:16:14.431633 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f93904_f3eb_4460_8064_82eeb57518fd.slice/crio-79c2bf9b17168966c5b7ddcabfc1a51101721762129191c3838b0357d7c4172c WatchSource:0}: Error finding container 79c2bf9b17168966c5b7ddcabfc1a51101721762129191c3838b0357d7c4172c: Status 404 returned error can't find the container with id 79c2bf9b17168966c5b7ddcabfc1a51101721762129191c3838b0357d7c4172c Jul 15 19:16:15.001571 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:15.001530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zttsd" event={"ID":"78f93904-f3eb-4460-8064-82eeb57518fd","Type":"ContainerStarted","Data":"79c2bf9b17168966c5b7ddcabfc1a51101721762129191c3838b0357d7c4172c"} Jul 15 19:16:16.734204 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:16.734129 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" podUID="ae9d0031-b8eb-47cf-b309-b08391de1fbb" containerName="registry" containerID="cri-o://2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b" gracePeriod=30 Jul 15 19:16:16.972818 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:16.972793 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:16:17.013671 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.013571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zttsd" event={"ID":"78f93904-f3eb-4460-8064-82eeb57518fd","Type":"ContainerStarted","Data":"f76055d695496e5344f4476e18bfcf20f5f1f45a1eb207abc2ad5d5917784ec0"} Jul 15 19:16:17.013671 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.013636 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zttsd" event={"ID":"78f93904-f3eb-4460-8064-82eeb57518fd","Type":"ContainerStarted","Data":"a4e1f211ff3b24ac6da6d6b17d4dec96c0bd4e76c86c1d6b9d7af55faa57383e"} Jul 15 19:16:17.014858 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.014833 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae9d0031-b8eb-47cf-b309-b08391de1fbb" containerID="2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b" exitCode=0 Jul 15 19:16:17.014988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.014875 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" Jul 15 19:16:17.014988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.014884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" event={"ID":"ae9d0031-b8eb-47cf-b309-b08391de1fbb","Type":"ContainerDied","Data":"2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b"} Jul 15 19:16:17.014988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.014914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79f8459cd4-x6bx7" event={"ID":"ae9d0031-b8eb-47cf-b309-b08391de1fbb","Type":"ContainerDied","Data":"e4e2d143bd9e7a84f46d55cd620dcfcbe546734a57796a397e0c40548e553933"} Jul 15 19:16:17.014988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.014933 2581 scope.go:117] "RemoveContainer" containerID="2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b" Jul 15 19:16:17.022909 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.022890 2581 scope.go:117] "RemoveContainer" containerID="2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b" Jul 15 19:16:17.023167 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:16:17.023147 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b\": container with ID starting with 2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b not found: ID does not exist" containerID="2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b" Jul 15 19:16:17.023273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.023175 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b"} err="failed to get container status \"2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b\": rpc error: code = NotFound desc = could not find container \"2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b\": container with ID starting with 2abe98b190a3e8cc5eaca80c4280f9794ef6d3964d1e8f9f89d97c6d8824512b not found: ID does not exist" Jul 15 19:16:17.042125 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.042080 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zttsd" podStartSLOduration=131.588692314 podStartE2EDuration="2m13.042064718s" totalImagesPullingTime="1.453372404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:17.04063815 +0000 UTC m=+133.185082810" watchObservedRunningTime="2026-07-15 19:16:17.042064718 +0000 UTC m=+133.186509352" Jul 15 19:16:17.109337 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109276 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9d0031-b8eb-47cf-b309-b08391de1fbb-ca-trust-extracted\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109337 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109348 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-installation-pull-secrets\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109559 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109403 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109559 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109435 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-image-registry-private-configuration\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109664 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109560 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w2m7\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-kube-api-access-2w2m7\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109664 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109614 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-trusted-ca\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109664 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109644 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-bound-sa-token\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.109799 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.109686 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-certificates\") pod \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\" (UID: \"ae9d0031-b8eb-47cf-b309-b08391de1fbb\") " Jul 15 19:16:17.110524 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.110458 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:16:17.111163 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.111131 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:16:17.112451 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.112383 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-kube-api-access-2w2m7" (OuterVolumeSpecName: "kube-api-access-2w2m7") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "kube-api-access-2w2m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:16:17.112451 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.112400 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:16:17.112451 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.112397 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:16:17.112451 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.112488 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:16:17.112748 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.112518 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:16:17.118660 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.118636 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9d0031-b8eb-47cf-b309-b08391de1fbb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae9d0031-b8eb-47cf-b309-b08391de1fbb" (UID: "ae9d0031-b8eb-47cf-b309-b08391de1fbb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:16:17.210825 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210783 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9d0031-b8eb-47cf-b309-b08391de1fbb-ca-trust-extracted\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.210825 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210817 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-installation-pull-secrets\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.210825 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210828 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-tls\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.211061 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210839 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9d0031-b8eb-47cf-b309-b08391de1fbb-image-registry-private-configuration\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.211061 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210849 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w2m7\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-kube-api-access-2w2m7\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.211061 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210859 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-trusted-ca\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.211061 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210867 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9d0031-b8eb-47cf-b309-b08391de1fbb-bound-sa-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.211061 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.210875 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9d0031-b8eb-47cf-b309-b08391de1fbb-registry-certificates\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:16:17.338225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.338194 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79f8459cd4-x6bx7"] Jul 15 19:16:17.343116 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:17.343085 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79f8459cd4-x6bx7"] Jul 15 19:16:18.408577 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:18.408543 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae9d0031-b8eb-47cf-b309-b08391de1fbb" path="/var/lib/kubelet/pods/ae9d0031-b8eb-47cf-b309-b08391de1fbb/volumes" Jul 15 19:16:32.082690 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:32.082659 2581 generic.go:356] "Generic (PLEG): container finished" podID="2dfb87b6-a087-4433-a400-c6b5567f7d0f" containerID="e9b54a7fab3474a5af11038446b71ad7279cf55987559b4ea1c8b579f08fb6f6" exitCode=0 Jul 15 19:16:32.083068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:32.082732 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" event={"ID":"2dfb87b6-a087-4433-a400-c6b5567f7d0f","Type":"ContainerDied","Data":"e9b54a7fab3474a5af11038446b71ad7279cf55987559b4ea1c8b579f08fb6f6"} Jul 15 19:16:32.083114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:32.083066 2581 scope.go:117] "RemoveContainer" containerID="e9b54a7fab3474a5af11038446b71ad7279cf55987559b4ea1c8b579f08fb6f6" Jul 15 19:16:33.088219 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:33.088189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4zpp8" event={"ID":"2dfb87b6-a087-4433-a400-c6b5567f7d0f","Type":"ContainerStarted","Data":"a8f5fbef9f517fb58c6a2616216b473254057b6b9976682514012bd8ba3a8b91"} Jul 15 19:16:37.103473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:37.103386 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0354250-88e0-4707-bd70-8496f6b754ad" containerID="9e4cf6eb7c4f39ed6e7b6e5d8fd10b19554587f3cd68728364d60f7ce8eac26d" exitCode=0 Jul 15 19:16:37.103473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:37.103458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" event={"ID":"d0354250-88e0-4707-bd70-8496f6b754ad","Type":"ContainerDied","Data":"9e4cf6eb7c4f39ed6e7b6e5d8fd10b19554587f3cd68728364d60f7ce8eac26d"} Jul 15 19:16:37.103905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:37.103759 2581 scope.go:117] "RemoveContainer" containerID="9e4cf6eb7c4f39ed6e7b6e5d8fd10b19554587f3cd68728364d60f7ce8eac26d" Jul 15 19:16:38.109402 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:16:38.109364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6r5xd" event={"ID":"d0354250-88e0-4707-bd70-8496f6b754ad","Type":"ContainerStarted","Data":"a97991f3c1472801eb115f90e3903d99d19b78059e75fceb6e878637ac9d475c"} Jul 15 19:19:04.268146 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:04.268118 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:19:04.270887 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:04.270861 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:19:04.276131 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:04.276108 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:19:04.279460 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:04.279442 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:19:04.279727 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:04.279711 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 19:19:16.690888 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.690842 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d"] Jul 15 19:19:16.692477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.691249 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9d0031-b8eb-47cf-b309-b08391de1fbb" containerName="registry" Jul 15 19:19:16.692477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.691265 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9d0031-b8eb-47cf-b309-b08391de1fbb" containerName="registry" Jul 15 19:19:16.692477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.691379 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9d0031-b8eb-47cf-b309-b08391de1fbb" containerName="registry" Jul 15 19:19:16.693169 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.693152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.704196 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.704173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 19:19:16.704196 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.704194 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 19:19:16.704543 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.704524 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 19:19:16.704691 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.704655 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c6zmb\"" Jul 15 19:19:16.704971 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.704956 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 19:19:16.719731 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.719698 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d"] Jul 15 19:19:16.783119 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.783078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c94c412d-762b-4b28-bb59-21c52128bcf4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.783317 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.783136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztsl6\" (UniqueName: \"kubernetes.io/projected/c94c412d-762b-4b28-bb59-21c52128bcf4-kube-api-access-ztsl6\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.783317 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.783221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94c412d-762b-4b28-bb59-21c52128bcf4-tmp\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.783317 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.783250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c94c412d-762b-4b28-bb59-21c52128bcf4-manifests\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.783317 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.783276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c94c412d-762b-4b28-bb59-21c52128bcf4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.883862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.883828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c94c412d-762b-4b28-bb59-21c52128bcf4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.884063 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.883874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztsl6\" (UniqueName: \"kubernetes.io/projected/c94c412d-762b-4b28-bb59-21c52128bcf4-kube-api-access-ztsl6\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.884063 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.883911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94c412d-762b-4b28-bb59-21c52128bcf4-tmp\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.884063 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.883928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c94c412d-762b-4b28-bb59-21c52128bcf4-manifests\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.884063 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.883944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c94c412d-762b-4b28-bb59-21c52128bcf4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.884339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.884317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c94c412d-762b-4b28-bb59-21c52128bcf4-manifests\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.886389 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.886360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94c412d-762b-4b28-bb59-21c52128bcf4-tmp\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.886472 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.886386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c94c412d-762b-4b28-bb59-21c52128bcf4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.886534 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.886518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c94c412d-762b-4b28-bb59-21c52128bcf4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:16.895917 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:16.895887 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztsl6\" (UniqueName: \"kubernetes.io/projected/c94c412d-762b-4b28-bb59-21c52128bcf4-kube-api-access-ztsl6\") pod \"opendatahub-operator-controller-manager-5d9998b69-jmx2d\" (UID: \"c94c412d-762b-4b28-bb59-21c52128bcf4\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:17.002680 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:17.002587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:17.182739 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:17.182709 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94c412d_762b_4b28_bb59_21c52128bcf4.slice/crio-b9841f3caa2006dbb7bb0197826294dfdc2896458a6f2dd48078ef6ebaaa1a96 WatchSource:0}: Error finding container b9841f3caa2006dbb7bb0197826294dfdc2896458a6f2dd48078ef6ebaaa1a96: Status 404 returned error can't find the container with id b9841f3caa2006dbb7bb0197826294dfdc2896458a6f2dd48078ef6ebaaa1a96 Jul 15 19:19:17.183090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:17.183071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d"] Jul 15 19:19:17.184438 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:17.184421 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 19:19:17.676905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:17.676868 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" event={"ID":"c94c412d-762b-4b28-bb59-21c52128bcf4","Type":"ContainerStarted","Data":"b9841f3caa2006dbb7bb0197826294dfdc2896458a6f2dd48078ef6ebaaa1a96"} Jul 15 19:19:20.691408 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:20.691278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" event={"ID":"c94c412d-762b-4b28-bb59-21c52128bcf4","Type":"ContainerStarted","Data":"5b7d51b84297694a82a6381aca9c4951a64049ff4e32e360f48d5f9de2a08642"} Jul 15 19:19:21.696564 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:21.696528 2581 generic.go:356] "Generic (PLEG): container finished" podID="c94c412d-762b-4b28-bb59-21c52128bcf4" containerID="5b7d51b84297694a82a6381aca9c4951a64049ff4e32e360f48d5f9de2a08642" exitCode=0 Jul 15 19:19:21.696955 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:21.696608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" event={"ID":"c94c412d-762b-4b28-bb59-21c52128bcf4","Type":"ContainerDied","Data":"5b7d51b84297694a82a6381aca9c4951a64049ff4e32e360f48d5f9de2a08642"} Jul 15 19:19:22.702243 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:22.702201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" event={"ID":"c94c412d-762b-4b28-bb59-21c52128bcf4","Type":"ContainerStarted","Data":"06e8e54f2e88de8f5d60eb75bd20f6c379ca717bfbf36ffbacf390b4f4056589"} Jul 15 19:19:22.702630 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:22.702416 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:22.772885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:22.772823 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" podStartSLOduration=2.045737469 podStartE2EDuration="6.772802323s" totalImagesPullingTime="3.665367218s" totalInitContainerRuntime="1.061697636s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:22.769570374 +0000 UTC m=+318.914015030" watchObservedRunningTime="2026-07-15 19:19:22.772802323 +0000 UTC m=+318.917246957" Jul 15 19:19:33.708690 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:33.708651 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-jmx2d" Jul 15 19:19:38.588506 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.588477 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6zbr6"] Jul 15 19:19:38.595589 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.595568 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:38.598636 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.598615 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m67tm\"" Jul 15 19:19:38.598987 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.598968 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 19:19:38.603414 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.603392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6zbr6"] Jul 15 19:19:38.650611 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.650579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27636919-019d-42f5-881f-328506a2bc7a-cert\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:38.650795 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.650622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhwfq\" (UniqueName: \"kubernetes.io/projected/27636919-019d-42f5-881f-328506a2bc7a-kube-api-access-bhwfq\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:38.751507 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.751472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27636919-019d-42f5-881f-328506a2bc7a-cert\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:38.751684 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.751515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhwfq\" (UniqueName: \"kubernetes.io/projected/27636919-019d-42f5-881f-328506a2bc7a-kube-api-access-bhwfq\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:38.751684 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:19:38.751632 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 19:19:38.751800 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:19:38.751710 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27636919-019d-42f5-881f-328506a2bc7a-cert podName:27636919-019d-42f5-881f-328506a2bc7a nodeName:}" failed. No retries permitted until 2026-07-15 19:19:39.251690982 +0000 UTC m=+335.396135592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27636919-019d-42f5-881f-328506a2bc7a-cert") pod "odh-model-controller-7998c67dc4-6zbr6" (UID: "27636919-019d-42f5-881f-328506a2bc7a") : secret "odh-model-controller-webhook-cert" not found Jul 15 19:19:38.764920 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:38.764888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhwfq\" (UniqueName: \"kubernetes.io/projected/27636919-019d-42f5-881f-328506a2bc7a-kube-api-access-bhwfq\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:39.242158 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.242121 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jlbz"] Jul 15 19:19:39.244480 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.244454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.247956 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.247931 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 19:19:39.255534 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.255513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27636919-019d-42f5-881f-328506a2bc7a-cert\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:39.257803 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.257777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27636919-019d-42f5-881f-328506a2bc7a-cert\") pod \"odh-model-controller-7998c67dc4-6zbr6\" (UID: \"27636919-019d-42f5-881f-328506a2bc7a\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:39.269523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.269495 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jlbz"] Jul 15 19:19:39.356564 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.356531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b12b41-64d9-4cf5-b6a2-148e1c8b670e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jlbz\" (UID: \"45b12b41-64d9-4cf5-b6a2-148e1c8b670e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.356753 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.356580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qqwx\" (UniqueName: \"kubernetes.io/projected/45b12b41-64d9-4cf5-b6a2-148e1c8b670e-kube-api-access-4qqwx\") pod \"model-serving-api-54d89bd5fc-5jlbz\" (UID: \"45b12b41-64d9-4cf5-b6a2-148e1c8b670e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.457747 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.457704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qqwx\" (UniqueName: \"kubernetes.io/projected/45b12b41-64d9-4cf5-b6a2-148e1c8b670e-kube-api-access-4qqwx\") pod \"model-serving-api-54d89bd5fc-5jlbz\" (UID: \"45b12b41-64d9-4cf5-b6a2-148e1c8b670e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.458007 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.457956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b12b41-64d9-4cf5-b6a2-148e1c8b670e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jlbz\" (UID: \"45b12b41-64d9-4cf5-b6a2-148e1c8b670e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.460487 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.460458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b12b41-64d9-4cf5-b6a2-148e1c8b670e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jlbz\" (UID: \"45b12b41-64d9-4cf5-b6a2-148e1c8b670e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.468634 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.468604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qqwx\" (UniqueName: \"kubernetes.io/projected/45b12b41-64d9-4cf5-b6a2-148e1c8b670e-kube-api-access-4qqwx\") pod \"model-serving-api-54d89bd5fc-5jlbz\" (UID: \"45b12b41-64d9-4cf5-b6a2-148e1c8b670e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.506525 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.506428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:39.555045 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.555007 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:39.660261 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.660120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6zbr6"] Jul 15 19:19:39.663861 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:39.663818 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27636919_019d_42f5_881f_328506a2bc7a.slice/crio-5317de5569e4a50eeeb38cae477020633a022af323e0c9160753060a71e12172 WatchSource:0}: Error finding container 5317de5569e4a50eeeb38cae477020633a022af323e0c9160753060a71e12172: Status 404 returned error can't find the container with id 5317de5569e4a50eeeb38cae477020633a022af323e0c9160753060a71e12172 Jul 15 19:19:39.706136 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.706092 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jlbz"] Jul 15 19:19:39.708656 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:39.708628 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b12b41_64d9_4cf5_b6a2_148e1c8b670e.slice/crio-2043b9f124625777b9177494dff8599ecd72ee04767c9e5605c8d977953da5ac WatchSource:0}: Error finding container 2043b9f124625777b9177494dff8599ecd72ee04767c9e5605c8d977953da5ac: Status 404 returned error can't find the container with id 2043b9f124625777b9177494dff8599ecd72ee04767c9e5605c8d977953da5ac Jul 15 19:19:39.769577 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.769436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" event={"ID":"45b12b41-64d9-4cf5-b6a2-148e1c8b670e","Type":"ContainerStarted","Data":"2043b9f124625777b9177494dff8599ecd72ee04767c9e5605c8d977953da5ac"} Jul 15 19:19:39.770718 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:39.770688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" event={"ID":"27636919-019d-42f5-881f-328506a2bc7a","Type":"ContainerStarted","Data":"5317de5569e4a50eeeb38cae477020633a022af323e0c9160753060a71e12172"} Jul 15 19:19:41.327277 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.327189 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc"] Jul 15 19:19:41.329710 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.329683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.333629 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.332776 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4rmzk\"" Jul 15 19:19:41.333629 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.332994 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 19:19:41.333629 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.333269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 19:19:41.343139 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.343102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc"] Jul 15 19:19:41.376679 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.376474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-tmp\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.376679 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.376532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qfkd\" (UniqueName: \"kubernetes.io/projected/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-kube-api-access-5qfkd\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.376679 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.376562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-tls-certs\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.477559 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.477517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-tmp\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.477742 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.477601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qfkd\" (UniqueName: \"kubernetes.io/projected/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-kube-api-access-5qfkd\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.477742 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.477632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-tls-certs\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.480615 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.480581 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-tmp\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.480786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.480764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-tls-certs\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.488720 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.488665 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qfkd\" (UniqueName: \"kubernetes.io/projected/8bf20423-ddc3-46eb-afc3-5eecdb52e3b7-kube-api-access-5qfkd\") pod \"kube-auth-proxy-c95658bf4-dxnlc\" (UID: \"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7\") " pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:41.647199 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:41.647114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" Jul 15 19:19:42.350780 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.350566 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg"] Jul 15 19:19:42.354307 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.354272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.357729 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.357665 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 19:19:42.358231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.358034 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 19:19:42.358231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.358038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 19:19:42.358231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.358073 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 19:19:42.358498 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.358368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lpz4v\"" Jul 15 19:19:42.376223 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.376190 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg"] Jul 15 19:19:42.487894 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.487848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-token\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.487894 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.487893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.488132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.487981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.488132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.488017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7tv\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-kube-api-access-dz7tv\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.488132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.488058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c438f704-f361-4771-ad0e-eaee6a0b071d-local-certs\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.488132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.488079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-cacerts\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.488379 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.488138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.588944 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.588913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589110 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.588955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7tv\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-kube-api-access-dz7tv\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589110 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.588997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c438f704-f361-4771-ad0e-eaee6a0b071d-local-certs\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589110 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.589018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-cacerts\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589278 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.589111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589278 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.589169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-token\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589278 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.589198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.589830 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.589805 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.591881 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.591855 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.592111 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.592073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c438f704-f361-4771-ad0e-eaee6a0b071d-local-certs\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.592313 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.592270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-cacerts\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.592410 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.592328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.606187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.606121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7tv\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-kube-api-access-dz7tv\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.606187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.606131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-token\") pod \"istiod-openshift-gateway-7574459656-dc5sg\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:42.667098 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:42.667046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:43.280009 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.279776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg"] Jul 15 19:19:43.282910 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:43.282882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc438f704_f361_4771_ad0e_eaee6a0b071d.slice/crio-5b1007b6f2733109af1e9b60f5663192790e0df4a6ebae1364281c2dc51cd8ef WatchSource:0}: Error finding container 5b1007b6f2733109af1e9b60f5663192790e0df4a6ebae1364281c2dc51cd8ef: Status 404 returned error can't find the container with id 5b1007b6f2733109af1e9b60f5663192790e0df4a6ebae1364281c2dc51cd8ef Jul 15 19:19:43.304660 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.304639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc"] Jul 15 19:19:43.306616 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:43.306592 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf20423_ddc3_46eb_afc3_5eecdb52e3b7.slice/crio-38520cabff5435f28bd9395f5c3e95d884f94113177d110eb2d2e74685040996 WatchSource:0}: Error finding container 38520cabff5435f28bd9395f5c3e95d884f94113177d110eb2d2e74685040996: Status 404 returned error can't find the container with id 38520cabff5435f28bd9395f5c3e95d884f94113177d110eb2d2e74685040996 Jul 15 19:19:43.792285 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.792240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" event={"ID":"c438f704-f361-4771-ad0e-eaee6a0b071d","Type":"ContainerStarted","Data":"5b1007b6f2733109af1e9b60f5663192790e0df4a6ebae1364281c2dc51cd8ef"} Jul 15 19:19:43.793920 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.793892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" event={"ID":"27636919-019d-42f5-881f-328506a2bc7a","Type":"ContainerStarted","Data":"d72a9cddcc049ed6824380d8c5b1523384e4caafb59a3a2c2d313e746bd03d46"} Jul 15 19:19:43.794138 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.794119 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:43.795693 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.795671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" event={"ID":"45b12b41-64d9-4cf5-b6a2-148e1c8b670e","Type":"ContainerStarted","Data":"3a64f0d7acad9e7acdfcdfedb466779c741ce5607df16dc1899101e2cbff0d77"} Jul 15 19:19:43.795799 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.795731 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:43.797099 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.797074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" event={"ID":"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7","Type":"ContainerStarted","Data":"38520cabff5435f28bd9395f5c3e95d884f94113177d110eb2d2e74685040996"} Jul 15 19:19:43.819446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.819395 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" podStartSLOduration=2.375743441 podStartE2EDuration="5.819377407s" totalImagesPullingTime="3.443633966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:43.817699154 +0000 UTC m=+339.962143787" watchObservedRunningTime="2026-07-15 19:19:43.819377407 +0000 UTC m=+339.963822079" Jul 15 19:19:43.854240 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:43.854114 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" podStartSLOduration=1.45307487 podStartE2EDuration="4.854088109s" totalImagesPullingTime="3.401013239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:43.85334423 +0000 UTC m=+339.997788864" watchObservedRunningTime="2026-07-15 19:19:43.854088109 +0000 UTC m=+339.998532781" Jul 15 19:19:46.561143 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.561109 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:19:46.561442 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.561173 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:19:46.812954 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.812854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" event={"ID":"8bf20423-ddc3-46eb-afc3-5eecdb52e3b7","Type":"ContainerStarted","Data":"5055eb3f71bccea09ad153ddd7cbf4c11653c2ddf26e99de541a565658d802f1"} Jul 15 19:19:46.814556 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.814519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" event={"ID":"c438f704-f361-4771-ad0e-eaee6a0b071d","Type":"ContainerStarted","Data":"89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161"} Jul 15 19:19:46.814698 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.814654 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:46.884779 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.884686 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c95658bf4-dxnlc" podStartSLOduration=2.633552414 podStartE2EDuration="5.884667043s" totalImagesPullingTime="3.251114629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:46.856248956 +0000 UTC m=+343.000693818" watchObservedRunningTime="2026-07-15 19:19:46.884667043 +0000 UTC m=+343.029111689" Jul 15 19:19:46.885499 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:46.885461 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" podStartSLOduration=1.609511172 podStartE2EDuration="4.885453701s" totalImagesPullingTime="3.275942529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:46.883576909 +0000 UTC m=+343.028021541" watchObservedRunningTime="2026-07-15 19:19:46.885453701 +0000 UTC m=+343.029898331" Jul 15 19:19:47.820097 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:47.820053 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-dc5sg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 19:19:47.820545 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:47.820111 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" podUID="c438f704-f361-4771-ad0e-eaee6a0b071d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 19:19:49.243488 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.243456 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p"] Jul 15 19:19:49.246259 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.246242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.249822 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.249798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7vlbr\"" Jul 15 19:19:49.269018 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.268992 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p"] Jul 15 19:19:49.352997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.352960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbltp\" (UniqueName: \"kubernetes.io/projected/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-kube-api-access-vbltp\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353467 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353467 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.353467 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.353356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454566 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454566 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbltp\" (UniqueName: \"kubernetes.io/projected/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-kube-api-access-vbltp\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.454833 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.454782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.455177 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.455133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.455229 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.455173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.455372 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.455345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.455570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.455543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.455650 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.455589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.457018 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.456994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.457147 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.457129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.471890 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.471856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.472164 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.472139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbltp\" (UniqueName: \"kubernetes.io/projected/a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8-kube-api-access-vbltp\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678dbw9p\" (UID: \"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.556465 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.556200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:49.711310 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.711269 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p"] Jul 15 19:19:49.712903 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:49.712877 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41dbeb4_54ae_4fcb_b63b_72d5dfe9fba8.slice/crio-1ab0b750ee8434b16a1eec48c4d8635d1161ea4ee4d56043e7631635a3889483 WatchSource:0}: Error finding container 1ab0b750ee8434b16a1eec48c4d8635d1161ea4ee4d56043e7631635a3889483: Status 404 returned error can't find the container with id 1ab0b750ee8434b16a1eec48c4d8635d1161ea4ee4d56043e7631635a3889483 Jul 15 19:19:49.830441 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:49.830339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" event={"ID":"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8","Type":"ContainerStarted","Data":"1ab0b750ee8434b16a1eec48c4d8635d1161ea4ee4d56043e7631635a3889483"} Jul 15 19:19:50.819941 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:50.819911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:51.400319 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.400273 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl"] Jul 15 19:19:51.407525 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.407488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.410804 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.410776 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bcvks\"" Jul 15 19:19:51.411093 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.411070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 15 19:19:51.418472 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.418403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl"] Jul 15 19:19:51.425427 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.424057 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw"] Jul 15 19:19:51.450202 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.448703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.450557 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.450531 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw"] Jul 15 19:19:51.452747 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.452712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jjqcs\"" Jul 15 19:19:51.453012 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.452997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 19:19:51.473970 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.473934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93eefa20-9870-47e8-96b5-54b7d82a0ab8-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzqwl\" (UID: \"93eefa20-9870-47e8-96b5-54b7d82a0ab8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.474136 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.473981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mdn\" (UniqueName: \"kubernetes.io/projected/93eefa20-9870-47e8-96b5-54b7d82a0ab8-kube-api-access-j9mdn\") pod \"kserve-controller-manager-d6f4b65b8-kzqwl\" (UID: \"93eefa20-9870-47e8-96b5-54b7d82a0ab8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.574585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.574541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrlm\" (UniqueName: \"kubernetes.io/projected/d71c6892-bb80-4042-ae8c-a1e3064c869c-kube-api-access-ccrlm\") pod \"llmisvc-controller-manager-777c6bd7d5-k42fw\" (UID: \"d71c6892-bb80-4042-ae8c-a1e3064c869c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.574751 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.574599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d71c6892-bb80-4042-ae8c-a1e3064c869c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k42fw\" (UID: \"d71c6892-bb80-4042-ae8c-a1e3064c869c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.574751 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.574665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93eefa20-9870-47e8-96b5-54b7d82a0ab8-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzqwl\" (UID: \"93eefa20-9870-47e8-96b5-54b7d82a0ab8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.574751 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.574693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mdn\" (UniqueName: \"kubernetes.io/projected/93eefa20-9870-47e8-96b5-54b7d82a0ab8-kube-api-access-j9mdn\") pod \"kserve-controller-manager-d6f4b65b8-kzqwl\" (UID: \"93eefa20-9870-47e8-96b5-54b7d82a0ab8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.577354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.577324 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93eefa20-9870-47e8-96b5-54b7d82a0ab8-cert\") pod \"kserve-controller-manager-d6f4b65b8-kzqwl\" (UID: \"93eefa20-9870-47e8-96b5-54b7d82a0ab8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.595711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.595674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mdn\" (UniqueName: \"kubernetes.io/projected/93eefa20-9870-47e8-96b5-54b7d82a0ab8-kube-api-access-j9mdn\") pod \"kserve-controller-manager-d6f4b65b8-kzqwl\" (UID: \"93eefa20-9870-47e8-96b5-54b7d82a0ab8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.675565 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.675525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrlm\" (UniqueName: \"kubernetes.io/projected/d71c6892-bb80-4042-ae8c-a1e3064c869c-kube-api-access-ccrlm\") pod \"llmisvc-controller-manager-777c6bd7d5-k42fw\" (UID: \"d71c6892-bb80-4042-ae8c-a1e3064c869c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.675753 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.675588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d71c6892-bb80-4042-ae8c-a1e3064c869c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k42fw\" (UID: \"d71c6892-bb80-4042-ae8c-a1e3064c869c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.678406 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.678381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d71c6892-bb80-4042-ae8c-a1e3064c869c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k42fw\" (UID: \"d71c6892-bb80-4042-ae8c-a1e3064c869c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.692862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.692836 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrlm\" (UniqueName: \"kubernetes.io/projected/d71c6892-bb80-4042-ae8c-a1e3064c869c-kube-api-access-ccrlm\") pod \"llmisvc-controller-manager-777c6bd7d5-k42fw\" (UID: \"d71c6892-bb80-4042-ae8c-a1e3064c869c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:51.722666 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.722630 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:51.764090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:51.764058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:52.309536 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.309469 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:19:52.309918 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.309556 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:19:52.309918 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.309595 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:19:52.391226 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.391186 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl"] Jul 15 19:19:52.393437 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:52.393410 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93eefa20_9870_47e8_96b5_54b7d82a0ab8.slice/crio-e08134df8e9883753bbe8565323b636d250cb24d398a40998537c8c741b5ada2 WatchSource:0}: Error finding container e08134df8e9883753bbe8565323b636d250cb24d398a40998537c8c741b5ada2: Status 404 returned error can't find the container with id e08134df8e9883753bbe8565323b636d250cb24d398a40998537c8c741b5ada2 Jul 15 19:19:52.410804 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:19:52.410775 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd71c6892_bb80_4042_ae8c_a1e3064c869c.slice/crio-752d6f9a6ecb5fe3802bd2d02b0cff51709a1a02cc77d8389e3ed51d9f0c409b WatchSource:0}: Error finding container 752d6f9a6ecb5fe3802bd2d02b0cff51709a1a02cc77d8389e3ed51d9f0c409b: Status 404 returned error can't find the container with id 752d6f9a6ecb5fe3802bd2d02b0cff51709a1a02cc77d8389e3ed51d9f0c409b Jul 15 19:19:52.411441 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.411406 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw"] Jul 15 19:19:52.415520 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.415497 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg"] Jul 15 19:19:52.415662 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.415642 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" podUID="c438f704-f361-4771-ad0e-eaee6a0b071d" containerName="discovery" containerID="cri-o://89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161" gracePeriod=30 Jul 15 19:19:52.659720 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.659693 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:52.788406 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788284 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-token\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788406 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c438f704-f361-4771-ad0e-eaee6a0b071d-local-certs\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788417 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-cacerts\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788449 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-ca-configmap\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788476 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz7tv\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-kube-api-access-dz7tv\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788531 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-dns-cert\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-kubeconfig\") pod \"c438f704-f361-4771-ad0e-eaee6a0b071d\" (UID: \"c438f704-f361-4771-ad0e-eaee6a0b071d\") " Jul 15 19:19:52.788871 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.788815 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:19:52.791456 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.791428 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-kube-api-access-dz7tv" (OuterVolumeSpecName: "kube-api-access-dz7tv") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "kube-api-access-dz7tv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:19:52.791456 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.791443 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:19:52.791456 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.791447 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:19:52.791651 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.791430 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-cacerts" (OuterVolumeSpecName: "cacerts") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:19:52.791651 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.791426 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c438f704-f361-4771-ad0e-eaee6a0b071d-local-certs" (OuterVolumeSpecName: "local-certs") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:19:52.791738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.791679 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c438f704-f361-4771-ad0e-eaee6a0b071d" (UID: "c438f704-f361-4771-ad0e-eaee6a0b071d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:19:52.847090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.847053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" event={"ID":"a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8","Type":"ContainerStarted","Data":"23ac9042b285c7454f856336336c47cbf84e7c08393b05d662ac41ff501566b6"} Jul 15 19:19:52.848338 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.848307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" event={"ID":"93eefa20-9870-47e8-96b5-54b7d82a0ab8","Type":"ContainerStarted","Data":"e08134df8e9883753bbe8565323b636d250cb24d398a40998537c8c741b5ada2"} Jul 15 19:19:52.849526 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.849503 2581 generic.go:356] "Generic (PLEG): container finished" podID="c438f704-f361-4771-ad0e-eaee6a0b071d" containerID="89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161" exitCode=0 Jul 15 19:19:52.849640 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.849545 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" Jul 15 19:19:52.849640 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.849567 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" event={"ID":"c438f704-f361-4771-ad0e-eaee6a0b071d","Type":"ContainerDied","Data":"89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161"} Jul 15 19:19:52.849640 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.849604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg" event={"ID":"c438f704-f361-4771-ad0e-eaee6a0b071d","Type":"ContainerDied","Data":"5b1007b6f2733109af1e9b60f5663192790e0df4a6ebae1364281c2dc51cd8ef"} Jul 15 19:19:52.849640 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.849633 2581 scope.go:117] "RemoveContainer" containerID="89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161" Jul 15 19:19:52.851094 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.850885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" event={"ID":"d71c6892-bb80-4042-ae8c-a1e3064c869c","Type":"ContainerStarted","Data":"752d6f9a6ecb5fe3802bd2d02b0cff51709a1a02cc77d8389e3ed51d9f0c409b"} Jul 15 19:19:52.859206 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.859186 2581 scope.go:117] "RemoveContainer" containerID="89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161" Jul 15 19:19:52.859525 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:19:52.859503 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161\": container with ID starting with 89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161 not found: ID does not exist" containerID="89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161" Jul 15 19:19:52.859586 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.859534 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161"} err="failed to get container status \"89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161\": rpc error: code = NotFound desc = could not find container \"89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161\": container with ID starting with 89651ce83b50595f9b93f5a65468a49b96997b36d20074991b9a68621fc5a161 not found: ID does not exist" Jul 15 19:19:52.889977 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.889947 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-kubeconfig\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.889977 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.889978 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.890215 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.889991 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c438f704-f361-4771-ad0e-eaee6a0b071d-local-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.890215 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.889999 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-cacerts\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.890215 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.890010 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-ca-configmap\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.890215 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.890032 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz7tv\" (UniqueName: \"kubernetes.io/projected/c438f704-f361-4771-ad0e-eaee6a0b071d-kube-api-access-dz7tv\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.890215 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.890043 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c438f704-f361-4771-ad0e-eaee6a0b071d-istio-csr-dns-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:19:52.909141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.909085 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" podStartSLOduration=1.314851897 podStartE2EDuration="3.909066916s" totalImagesPullingTime="2.594215019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:52.907358244 +0000 UTC m=+349.051802874" watchObservedRunningTime="2026-07-15 19:19:52.909066916 +0000 UTC m=+349.053511549" Jul 15 19:19:52.932575 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.932515 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg"] Jul 15 19:19:52.939863 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:52.939834 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dc5sg"] Jul 15 19:19:53.557398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:53.557327 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:53.563950 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:53.563830 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:53.857712 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:53.857638 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:53.858784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:53.858755 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678dbw9p" Jul 15 19:19:54.419054 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:54.419018 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c438f704-f361-4771-ad0e-eaee6a0b071d" path="/var/lib/kubelet/pods/c438f704-f361-4771-ad0e-eaee6a0b071d/volumes" Jul 15 19:19:54.805212 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:54.805128 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6zbr6" Jul 15 19:19:54.807235 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:54.807210 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5jlbz" Jul 15 19:19:55.870501 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:55.870465 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" event={"ID":"93eefa20-9870-47e8-96b5-54b7d82a0ab8","Type":"ContainerStarted","Data":"5a9dba83f5baebdc05ccefb4286acab0faab5ecac6115236e3e0faf72ccfede2"} Jul 15 19:19:55.870930 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:55.870527 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:19:55.872029 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:55.871998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" event={"ID":"d71c6892-bb80-4042-ae8c-a1e3064c869c","Type":"ContainerStarted","Data":"7827ebde8475998b831f0326ae17589e1b141c0ec3e746601205ed97da9971ff"} Jul 15 19:19:55.872186 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:55.872170 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:19:55.893098 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:55.893050 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" podStartSLOduration=2.40863859 podStartE2EDuration="4.89303222s" totalImagesPullingTime="2.48439363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:55.89156122 +0000 UTC m=+352.036005852" watchObservedRunningTime="2026-07-15 19:19:55.89303222 +0000 UTC m=+352.037476853" Jul 15 19:19:55.914328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:19:55.914257 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" podStartSLOduration=1.636441955 podStartE2EDuration="4.914240359s" totalImagesPullingTime="3.277798404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:55.912793643 +0000 UTC m=+352.057238277" watchObservedRunningTime="2026-07-15 19:19:55.914240359 +0000 UTC m=+352.058684991" Jul 15 19:20:26.878514 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:26.878483 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k42fw" Jul 15 19:20:26.881659 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:26.881636 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kzqwl" Jul 15 19:20:39.573555 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.573520 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6lz2"] Jul 15 19:20:39.573927 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.573845 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c438f704-f361-4771-ad0e-eaee6a0b071d" containerName="discovery" Jul 15 19:20:39.573927 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.573855 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c438f704-f361-4771-ad0e-eaee6a0b071d" containerName="discovery" Jul 15 19:20:39.573927 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.573911 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c438f704-f361-4771-ad0e-eaee6a0b071d" containerName="discovery" Jul 15 19:20:39.575893 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.575869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:39.579302 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.579258 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 19:20:39.579434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.579406 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 19:20:39.581892 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.581869 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jc9tt\"" Jul 15 19:20:39.594302 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.594255 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6lz2"] Jul 15 19:20:39.693555 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.693512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sdhg\" (UniqueName: \"kubernetes.io/projected/7f83cb19-8b14-4689-9029-b1cfc95df8b3-kube-api-access-9sdhg\") pod \"kuadrant-operator-catalog-z6lz2\" (UID: \"7f83cb19-8b14-4689-9029-b1cfc95df8b3\") " pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:39.794387 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.794356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sdhg\" (UniqueName: \"kubernetes.io/projected/7f83cb19-8b14-4689-9029-b1cfc95df8b3-kube-api-access-9sdhg\") pod \"kuadrant-operator-catalog-z6lz2\" (UID: \"7f83cb19-8b14-4689-9029-b1cfc95df8b3\") " pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:39.804311 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.804267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sdhg\" (UniqueName: \"kubernetes.io/projected/7f83cb19-8b14-4689-9029-b1cfc95df8b3-kube-api-access-9sdhg\") pod \"kuadrant-operator-catalog-z6lz2\" (UID: \"7f83cb19-8b14-4689-9029-b1cfc95df8b3\") " pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:39.886564 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.886475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:39.889572 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:39.889549 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6lz2"] Jul 15 19:20:40.044010 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.043980 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6lz2"] Jul 15 19:20:40.047159 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:20:40.047129 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f83cb19_8b14_4689_9029_b1cfc95df8b3.slice/crio-43c01065e44ff6764cda49bb8f8a8f4e00f69da7584b392337a4ac22e22cbd13 WatchSource:0}: Error finding container 43c01065e44ff6764cda49bb8f8a8f4e00f69da7584b392337a4ac22e22cbd13: Status 404 returned error can't find the container with id 43c01065e44ff6764cda49bb8f8a8f4e00f69da7584b392337a4ac22e22cbd13 Jul 15 19:20:40.058903 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.058870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" event={"ID":"7f83cb19-8b14-4689-9029-b1cfc95df8b3","Type":"ContainerStarted","Data":"43c01065e44ff6764cda49bb8f8a8f4e00f69da7584b392337a4ac22e22cbd13"} Jul 15 19:20:40.103127 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.103093 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gz9st"] Jul 15 19:20:40.106018 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.106000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:40.126864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.126824 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gz9st"] Jul 15 19:20:40.197226 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.197191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tndhk\" (UniqueName: \"kubernetes.io/projected/9794268a-6078-43e1-a5ce-258cacab5cb7-kube-api-access-tndhk\") pod \"kuadrant-operator-catalog-gz9st\" (UID: \"9794268a-6078-43e1-a5ce-258cacab5cb7\") " pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:40.298639 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.298601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tndhk\" (UniqueName: \"kubernetes.io/projected/9794268a-6078-43e1-a5ce-258cacab5cb7-kube-api-access-tndhk\") pod \"kuadrant-operator-catalog-gz9st\" (UID: \"9794268a-6078-43e1-a5ce-258cacab5cb7\") " pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:40.311945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.311912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tndhk\" (UniqueName: \"kubernetes.io/projected/9794268a-6078-43e1-a5ce-258cacab5cb7-kube-api-access-tndhk\") pod \"kuadrant-operator-catalog-gz9st\" (UID: \"9794268a-6078-43e1-a5ce-258cacab5cb7\") " pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:40.415241 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.415196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:40.547579 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:40.547554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gz9st"] Jul 15 19:20:40.549899 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:20:40.549873 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9794268a_6078_43e1_a5ce_258cacab5cb7.slice/crio-c18c8b6e580b4717824738e2a58ee7c25b6e0f40be22b4816668482f99afbebf WatchSource:0}: Error finding container c18c8b6e580b4717824738e2a58ee7c25b6e0f40be22b4816668482f99afbebf: Status 404 returned error can't find the container with id c18c8b6e580b4717824738e2a58ee7c25b6e0f40be22b4816668482f99afbebf Jul 15 19:20:41.066533 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:41.066459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" event={"ID":"9794268a-6078-43e1-a5ce-258cacab5cb7","Type":"ContainerStarted","Data":"c18c8b6e580b4717824738e2a58ee7c25b6e0f40be22b4816668482f99afbebf"} Jul 15 19:20:43.077810 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.077777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" event={"ID":"7f83cb19-8b14-4689-9029-b1cfc95df8b3","Type":"ContainerStarted","Data":"4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11"} Jul 15 19:20:43.078225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.077831 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" podUID="7f83cb19-8b14-4689-9029-b1cfc95df8b3" containerName="registry-server" containerID="cri-o://4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11" gracePeriod=2 Jul 15 19:20:43.079530 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.079505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" event={"ID":"9794268a-6078-43e1-a5ce-258cacab5cb7","Type":"ContainerStarted","Data":"cc0ba968a48053826617f242d37a31e84fa03f865974ccc2ff5be248a24c703b"} Jul 15 19:20:43.095974 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.095930 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" podStartSLOduration=1.7883045100000001 podStartE2EDuration="4.095914362s" totalImagesPullingTime="2.307609852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:20:43.095052793 +0000 UTC m=+399.239497428" watchObservedRunningTime="2026-07-15 19:20:43.095914362 +0000 UTC m=+399.240358997" Jul 15 19:20:43.323136 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.323070 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:43.342284 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.342233 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" podStartSLOduration=1.534062338 podStartE2EDuration="3.342215538s" totalImagesPullingTime="1.8081532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:20:43.112951626 +0000 UTC m=+399.257396270" watchObservedRunningTime="2026-07-15 19:20:43.342215538 +0000 UTC m=+399.486660171" Jul 15 19:20:43.428334 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.428285 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sdhg\" (UniqueName: \"kubernetes.io/projected/7f83cb19-8b14-4689-9029-b1cfc95df8b3-kube-api-access-9sdhg\") pod \"7f83cb19-8b14-4689-9029-b1cfc95df8b3\" (UID: \"7f83cb19-8b14-4689-9029-b1cfc95df8b3\") " Jul 15 19:20:43.430469 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.430441 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f83cb19-8b14-4689-9029-b1cfc95df8b3-kube-api-access-9sdhg" (OuterVolumeSpecName: "kube-api-access-9sdhg") pod "7f83cb19-8b14-4689-9029-b1cfc95df8b3" (UID: "7f83cb19-8b14-4689-9029-b1cfc95df8b3"). InnerVolumeSpecName "kube-api-access-9sdhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:20:43.529823 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:43.529787 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sdhg\" (UniqueName: \"kubernetes.io/projected/7f83cb19-8b14-4689-9029-b1cfc95df8b3-kube-api-access-9sdhg\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:20:44.084864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.084825 2581 generic.go:356] "Generic (PLEG): container finished" podID="7f83cb19-8b14-4689-9029-b1cfc95df8b3" containerID="4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11" exitCode=0 Jul 15 19:20:44.085341 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.084869 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" Jul 15 19:20:44.085341 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.084911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" event={"ID":"7f83cb19-8b14-4689-9029-b1cfc95df8b3","Type":"ContainerDied","Data":"4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11"} Jul 15 19:20:44.085341 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.084961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z6lz2" event={"ID":"7f83cb19-8b14-4689-9029-b1cfc95df8b3","Type":"ContainerDied","Data":"43c01065e44ff6764cda49bb8f8a8f4e00f69da7584b392337a4ac22e22cbd13"} Jul 15 19:20:44.085341 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.084982 2581 scope.go:117] "RemoveContainer" containerID="4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11" Jul 15 19:20:44.093767 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.093752 2581 scope.go:117] "RemoveContainer" containerID="4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11" Jul 15 19:20:44.094008 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:20:44.093991 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11\": container with ID starting with 4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11 not found: ID does not exist" containerID="4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11" Jul 15 19:20:44.094045 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.094017 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11"} err="failed to get container status \"4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11\": rpc error: code = NotFound desc = could not find container \"4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11\": container with ID starting with 4ffa232af1e96042d7afeb76ce8a2775ff0022d8021e09e1f4a52d3269e70a11 not found: ID does not exist" Jul 15 19:20:44.118647 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.118617 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6lz2"] Jul 15 19:20:44.123530 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.123498 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6lz2"] Jul 15 19:20:44.409245 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:44.409205 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f83cb19-8b14-4689-9029-b1cfc95df8b3" path="/var/lib/kubelet/pods/7f83cb19-8b14-4689-9029-b1cfc95df8b3/volumes" Jul 15 19:20:50.415999 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:50.415963 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:50.416411 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:50.416027 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:50.439212 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:50.439184 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:20:51.137132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:20:51.137106 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gz9st" Jul 15 19:21:11.370412 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.370374 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn"] Jul 15 19:21:11.370805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.370686 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f83cb19-8b14-4689-9029-b1cfc95df8b3" containerName="registry-server" Jul 15 19:21:11.370805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.370696 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f83cb19-8b14-4689-9029-b1cfc95df8b3" containerName="registry-server" Jul 15 19:21:11.370805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.370752 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f83cb19-8b14-4689-9029-b1cfc95df8b3" containerName="registry-server" Jul 15 19:21:11.374941 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.374922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:11.378303 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.378274 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8qf22\"" Jul 15 19:21:11.385144 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.385124 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn"] Jul 15 19:21:11.460593 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.460557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr277\" (UniqueName: \"kubernetes.io/projected/afb94860-d98b-4f4f-bc3b-b57f66ac86cd-kube-api-access-nr277\") pod \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" (UID: \"afb94860-d98b-4f4f-bc3b-b57f66ac86cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:11.561208 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.561168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr277\" (UniqueName: \"kubernetes.io/projected/afb94860-d98b-4f4f-bc3b-b57f66ac86cd-kube-api-access-nr277\") pod \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" (UID: \"afb94860-d98b-4f4f-bc3b-b57f66ac86cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:11.578530 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.578497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr277\" (UniqueName: \"kubernetes.io/projected/afb94860-d98b-4f4f-bc3b-b57f66ac86cd-kube-api-access-nr277\") pod \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" (UID: \"afb94860-d98b-4f4f-bc3b-b57f66ac86cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:11.684774 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.684736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:11.830612 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:11.830586 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn"] Jul 15 19:21:11.833201 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:21:11.833173 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb94860_d98b_4f4f_bc3b_b57f66ac86cd.slice/crio-436fcebfdb0cea20ab3013767b06d3ed8f19c0ea5413064c97ce5e29d24e8a3b WatchSource:0}: Error finding container 436fcebfdb0cea20ab3013767b06d3ed8f19c0ea5413064c97ce5e29d24e8a3b: Status 404 returned error can't find the container with id 436fcebfdb0cea20ab3013767b06d3ed8f19c0ea5413064c97ce5e29d24e8a3b Jul 15 19:21:12.210320 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:12.210272 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" event={"ID":"afb94860-d98b-4f4f-bc3b-b57f66ac86cd","Type":"ContainerStarted","Data":"436fcebfdb0cea20ab3013767b06d3ed8f19c0ea5413064c97ce5e29d24e8a3b"} Jul 15 19:21:14.222577 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.222535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" event={"ID":"afb94860-d98b-4f4f-bc3b-b57f66ac86cd","Type":"ContainerStarted","Data":"57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7"} Jul 15 19:21:14.222945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.222613 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:14.245935 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.245882 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" podStartSLOduration=1.23864723 podStartE2EDuration="3.245862884s" totalImagesPullingTime="2.007215654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:14.244537958 +0000 UTC m=+430.388982589" watchObservedRunningTime="2026-07-15 19:21:14.245862884 +0000 UTC m=+430.390307516" Jul 15 19:21:14.858588 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.858549 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg"] Jul 15 19:21:14.861864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.861840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:14.867133 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.867108 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 19:21:14.867728 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.867708 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4bm2x\"" Jul 15 19:21:14.878663 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.878635 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg"] Jul 15 19:21:14.989281 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:14.989247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnzt\" (UniqueName: \"kubernetes.io/projected/2134bb94-7a1d-4e64-a38e-5e6971428c3b-kube-api-access-xbnzt\") pod \"dns-operator-controller-manager-864dd78c4c-w2xtg\" (UID: \"2134bb94-7a1d-4e64-a38e-5e6971428c3b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:15.090380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:15.090342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnzt\" (UniqueName: \"kubernetes.io/projected/2134bb94-7a1d-4e64-a38e-5e6971428c3b-kube-api-access-xbnzt\") pod \"dns-operator-controller-manager-864dd78c4c-w2xtg\" (UID: \"2134bb94-7a1d-4e64-a38e-5e6971428c3b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:15.107949 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:15.107913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnzt\" (UniqueName: \"kubernetes.io/projected/2134bb94-7a1d-4e64-a38e-5e6971428c3b-kube-api-access-xbnzt\") pod \"dns-operator-controller-manager-864dd78c4c-w2xtg\" (UID: \"2134bb94-7a1d-4e64-a38e-5e6971428c3b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:15.172648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:15.172600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:15.324671 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:15.324646 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg"] Jul 15 19:21:15.326971 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:21:15.326941 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2134bb94_7a1d_4e64_a38e_5e6971428c3b.slice/crio-e8578fe1351a0096b54afa14504ab490b41bea59642922552c2398421c68f6e0 WatchSource:0}: Error finding container e8578fe1351a0096b54afa14504ab490b41bea59642922552c2398421c68f6e0: Status 404 returned error can't find the container with id e8578fe1351a0096b54afa14504ab490b41bea59642922552c2398421c68f6e0 Jul 15 19:21:16.238897 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:16.238859 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" event={"ID":"2134bb94-7a1d-4e64-a38e-5e6971428c3b","Type":"ContainerStarted","Data":"e8578fe1351a0096b54afa14504ab490b41bea59642922552c2398421c68f6e0"} Jul 15 19:21:17.246215 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:17.246177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" event={"ID":"2134bb94-7a1d-4e64-a38e-5e6971428c3b","Type":"ContainerStarted","Data":"b85d212c80027619f4fbfadf5b230eda11bf00c0e387accb08d1898221d76c4b"} Jul 15 19:21:17.246628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:17.246255 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:17.273135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:17.273078 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" podStartSLOduration=1.469157186 podStartE2EDuration="3.273058782s" totalImagesPullingTime="1.803901596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:17.272196599 +0000 UTC m=+433.416641232" watchObservedRunningTime="2026-07-15 19:21:17.273058782 +0000 UTC m=+433.417503415" Jul 15 19:21:19.847952 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:19.847914 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh"] Jul 15 19:21:19.851462 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:19.851444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:19.857504 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:19.857479 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r4m2d\"" Jul 15 19:21:19.876357 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:19.876319 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh"] Jul 15 19:21:19.933407 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:19.933371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd195e34-e6df-459a-a64d-9d2d4868478b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:19.933582 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:19.933443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5qg\" (UniqueName: \"kubernetes.io/projected/bd195e34-e6df-459a-a64d-9d2d4868478b-kube-api-access-hk5qg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:20.034564 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:20.034519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd195e34-e6df-459a-a64d-9d2d4868478b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:20.034739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:20.034615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5qg\" (UniqueName: \"kubernetes.io/projected/bd195e34-e6df-459a-a64d-9d2d4868478b-kube-api-access-hk5qg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:20.034993 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:20.034969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd195e34-e6df-459a-a64d-9d2d4868478b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:20.056813 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:20.056780 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5qg\" (UniqueName: \"kubernetes.io/projected/bd195e34-e6df-459a-a64d-9d2d4868478b-kube-api-access-hk5qg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:20.161352 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:20.161315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:20.318497 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:20.318462 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh"] Jul 15 19:21:20.322668 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:21:20.322637 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd195e34_e6df_459a_a64d_9d2d4868478b.slice/crio-1aa08fe4799ec79399158104406509b95736b4c6692533454e15f89a15656cb0 WatchSource:0}: Error finding container 1aa08fe4799ec79399158104406509b95736b4c6692533454e15f89a15656cb0: Status 404 returned error can't find the container with id 1aa08fe4799ec79399158104406509b95736b4c6692533454e15f89a15656cb0 Jul 15 19:21:21.269954 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:21.269914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" event={"ID":"bd195e34-e6df-459a-a64d-9d2d4868478b","Type":"ContainerStarted","Data":"1aa08fe4799ec79399158104406509b95736b4c6692533454e15f89a15656cb0"} Jul 15 19:21:23.680058 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.680019 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8"] Jul 15 19:21:23.683889 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.683863 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:23.689941 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.689911 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xh6vh\"" Jul 15 19:21:23.713726 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.713694 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8"] Jul 15 19:21:23.771913 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.771875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8zj\" (UniqueName: \"kubernetes.io/projected/c00b501a-5f87-40e0-bf1d-405bb9696e00-kube-api-access-th8zj\") pod \"authorino-operator-75cc8d5cb7-kkxb8\" (UID: \"c00b501a-5f87-40e0-bf1d-405bb9696e00\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:23.872649 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.872608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8zj\" (UniqueName: \"kubernetes.io/projected/c00b501a-5f87-40e0-bf1d-405bb9696e00-kube-api-access-th8zj\") pod \"authorino-operator-75cc8d5cb7-kkxb8\" (UID: \"c00b501a-5f87-40e0-bf1d-405bb9696e00\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:23.887925 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.887888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8zj\" (UniqueName: \"kubernetes.io/projected/c00b501a-5f87-40e0-bf1d-405bb9696e00-kube-api-access-th8zj\") pod \"authorino-operator-75cc8d5cb7-kkxb8\" (UID: \"c00b501a-5f87-40e0-bf1d-405bb9696e00\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:23.996956 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:23.996865 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:24.147747 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:24.147723 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8"] Jul 15 19:21:24.150176 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:21:24.150140 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00b501a_5f87_40e0_bf1d_405bb9696e00.slice/crio-8fc7e362360e6e3f55070d5185b71b7df13e78fb9b9b06f916440aedfbda5475 WatchSource:0}: Error finding container 8fc7e362360e6e3f55070d5185b71b7df13e78fb9b9b06f916440aedfbda5475: Status 404 returned error can't find the container with id 8fc7e362360e6e3f55070d5185b71b7df13e78fb9b9b06f916440aedfbda5475 Jul 15 19:21:24.286321 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:24.286214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" event={"ID":"c00b501a-5f87-40e0-bf1d-405bb9696e00","Type":"ContainerStarted","Data":"8fc7e362360e6e3f55070d5185b71b7df13e78fb9b9b06f916440aedfbda5475"} Jul 15 19:21:25.233998 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:25.233959 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:28.253095 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.253060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-w2xtg" Jul 15 19:21:28.311590 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.311551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" event={"ID":"c00b501a-5f87-40e0-bf1d-405bb9696e00","Type":"ContainerStarted","Data":"9cad970c9acfac52d66c43b332c51f04c5da7b65c5b9edb161922907c72ad5d3"} Jul 15 19:21:28.311777 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.311645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:28.313365 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.313337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" event={"ID":"bd195e34-e6df-459a-a64d-9d2d4868478b","Type":"ContainerStarted","Data":"94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135"} Jul 15 19:21:28.313487 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.313399 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:28.334773 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.334712 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" podStartSLOduration=2.1227938 podStartE2EDuration="5.334686646s" totalImagesPullingTime="3.211892846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:28.33432112 +0000 UTC m=+444.478765753" watchObservedRunningTime="2026-07-15 19:21:28.334686646 +0000 UTC m=+444.479131544" Jul 15 19:21:28.356332 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:28.356264 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" podStartSLOduration=2.356107192 podStartE2EDuration="9.356249438s" totalImagesPullingTime="7.000142246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:28.354495171 +0000 UTC m=+444.498939828" watchObservedRunningTime="2026-07-15 19:21:28.356249438 +0000 UTC m=+444.500694141" Jul 15 19:21:39.320436 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:39.320398 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kkxb8" Jul 15 19:21:39.320894 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:39.320567 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.198398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.198366 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln"] Jul 15 19:21:41.201955 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.201938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.217712 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.217655 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln"] Jul 15 19:21:41.281655 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.281622 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh"] Jul 15 19:21:41.281822 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.281801 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" containerName="manager" containerID="cri-o://94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135" gracePeriod=2 Jul 15 19:21:41.294818 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.294791 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh"] Jul 15 19:21:41.311836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.311807 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln"] Jul 15 19:21:41.312127 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.312103 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mmf5r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" Jul 15 19:21:41.316179 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.316144 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln"] Jul 15 19:21:41.324737 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.324709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmf5r\" (UniqueName: \"kubernetes.io/projected/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-kube-api-access-mmf5r\") pod \"kuadrant-operator-controller-manager-86878c769f-rmtln\" (UID: \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.324883 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.324757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rmtln\" (UID: \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.331270 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.331242 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn"] Jul 15 19:21:41.331508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.331482 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" containerName="manager" containerID="cri-o://57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7" gracePeriod=2 Jul 15 19:21:41.342923 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.342895 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn"] Jul 15 19:21:41.346072 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.346033 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"afb94860-d98b-4f4f-bc3b-b57f66ac86cd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-lt6wn\": pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.348613 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.348544 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.371773 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.371736 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg"] Jul 15 19:21:41.372387 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.372368 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" containerName="manager" Jul 15 19:21:41.372387 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.372390 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" containerName="manager" Jul 15 19:21:41.372526 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.372417 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" containerName="manager" Jul 15 19:21:41.372526 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.372426 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" containerName="manager" Jul 15 19:21:41.372526 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.372514 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" containerName="manager" Jul 15 19:21:41.372653 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.372530 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" containerName="manager" Jul 15 19:21:41.375826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.375804 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.378570 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.378534 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.382546 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.382524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.384374 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.384337 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.385358 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.385256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg"] Jul 15 19:21:41.386771 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.386738 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.389351 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.389284 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.392965 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.392933 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.399796 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.399759 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.403696 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.403670 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9"] Jul 15 19:21:41.404936 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.404916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.407207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.407188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:21:41.425864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.425832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmf5r\" (UniqueName: \"kubernetes.io/projected/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-kube-api-access-mmf5r\") pod \"kuadrant-operator-controller-manager-86878c769f-rmtln\" (UID: \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.425864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.425888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rmtln\" (UID: \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.426231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.426209 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rmtln\" (UID: \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.427993 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.427973 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9"] Jul 15 19:21:41.433209 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.433184 2581 projected.go:196] Error preparing data for projected volume kube-api-access-mmf5r for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-rmtln" not found Jul 15 19:21:41.433339 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.433308 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-kube-api-access-mmf5r podName:c6a82cab-b055-4ab0-892c-59fe6dd4c59f nodeName:}" failed. No retries permitted until 2026-07-15 19:21:41.933270929 +0000 UTC m=+458.077715556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mmf5r" (UniqueName: "kubernetes.io/projected/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-kube-api-access-mmf5r") pod "kuadrant-operator-controller-manager-86878c769f-rmtln" (UID: "c6a82cab-b055-4ab0-892c-59fe6dd4c59f") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-rmtln" not found Jul 15 19:21:41.452807 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.452771 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.455733 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.455705 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.497992 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.497953 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.526773 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.526742 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-extensions-socket-volume\") pod \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\" (UID: \"c6a82cab-b055-4ab0-892c-59fe6dd4c59f\") " Jul 15 19:21:41.526934 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.526916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zczdg\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.526987 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.526947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfhg\" (UniqueName: \"kubernetes.io/projected/dcabec3f-3856-4875-8c7a-d1da8e638d32-kube-api-access-bsfhg\") pod \"limitador-operator-controller-manager-859d7b78bd-664x9\" (UID: \"dcabec3f-3856-4875-8c7a-d1da8e638d32\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:21:41.527037 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.526983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8nq\" (UniqueName: \"kubernetes.io/projected/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-kube-api-access-tw8nq\") pod \"kuadrant-operator-controller-manager-86878c769f-zczdg\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.527074 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.527044 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c6a82cab-b055-4ab0-892c-59fe6dd4c59f" (UID: "c6a82cab-b055-4ab0-892c-59fe6dd4c59f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:21:41.527222 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.527204 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-extensions-socket-volume\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:21:41.527275 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.527228 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmf5r\" (UniqueName: \"kubernetes.io/projected/c6a82cab-b055-4ab0-892c-59fe6dd4c59f-kube-api-access-mmf5r\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:21:41.568977 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.568947 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.572397 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.572359 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.576340 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.576276 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.579429 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.579405 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.593089 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.593068 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.596126 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.596101 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:41.598635 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.598613 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:41.601744 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:41.601724 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:41.628155 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.628127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zczdg\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.628276 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.628162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfhg\" (UniqueName: \"kubernetes.io/projected/dcabec3f-3856-4875-8c7a-d1da8e638d32-kube-api-access-bsfhg\") pod \"limitador-operator-controller-manager-859d7b78bd-664x9\" (UID: \"dcabec3f-3856-4875-8c7a-d1da8e638d32\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:21:41.628276 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.628180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8nq\" (UniqueName: \"kubernetes.io/projected/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-kube-api-access-tw8nq\") pod \"kuadrant-operator-controller-manager-86878c769f-zczdg\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.628585 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.628561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zczdg\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.650882 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.650849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8nq\" (UniqueName: \"kubernetes.io/projected/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-kube-api-access-tw8nq\") pod \"kuadrant-operator-controller-manager-86878c769f-zczdg\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.650976 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.650920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfhg\" (UniqueName: \"kubernetes.io/projected/dcabec3f-3856-4875-8c7a-d1da8e638d32-kube-api-access-bsfhg\") pod \"limitador-operator-controller-manager-859d7b78bd-664x9\" (UID: \"dcabec3f-3856-4875-8c7a-d1da8e638d32\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:21:41.713762 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.713673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:41.720434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.720399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:21:41.729362 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.729338 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk5qg\" (UniqueName: \"kubernetes.io/projected/bd195e34-e6df-459a-a64d-9d2d4868478b-kube-api-access-hk5qg\") pod \"bd195e34-e6df-459a-a64d-9d2d4868478b\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " Jul 15 19:21:41.729488 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.729386 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd195e34-e6df-459a-a64d-9d2d4868478b-extensions-socket-volume\") pod \"bd195e34-e6df-459a-a64d-9d2d4868478b\" (UID: \"bd195e34-e6df-459a-a64d-9d2d4868478b\") " Jul 15 19:21:41.729549 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.729488 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr277\" (UniqueName: \"kubernetes.io/projected/afb94860-d98b-4f4f-bc3b-b57f66ac86cd-kube-api-access-nr277\") pod \"afb94860-d98b-4f4f-bc3b-b57f66ac86cd\" (UID: \"afb94860-d98b-4f4f-bc3b-b57f66ac86cd\") " Jul 15 19:21:41.729903 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.729876 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd195e34-e6df-459a-a64d-9d2d4868478b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bd195e34-e6df-459a-a64d-9d2d4868478b" (UID: "bd195e34-e6df-459a-a64d-9d2d4868478b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:21:41.731533 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.731502 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd195e34-e6df-459a-a64d-9d2d4868478b-kube-api-access-hk5qg" (OuterVolumeSpecName: "kube-api-access-hk5qg") pod "bd195e34-e6df-459a-a64d-9d2d4868478b" (UID: "bd195e34-e6df-459a-a64d-9d2d4868478b"). InnerVolumeSpecName "kube-api-access-hk5qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:21:41.731914 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.731893 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afb94860-d98b-4f4f-bc3b-b57f66ac86cd-kube-api-access-nr277" (OuterVolumeSpecName: "kube-api-access-nr277") pod "afb94860-d98b-4f4f-bc3b-b57f66ac86cd" (UID: "afb94860-d98b-4f4f-bc3b-b57f66ac86cd"). InnerVolumeSpecName "kube-api-access-nr277". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:21:41.830848 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.830820 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd195e34-e6df-459a-a64d-9d2d4868478b-extensions-socket-volume\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:21:41.830848 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.830845 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr277\" (UniqueName: \"kubernetes.io/projected/afb94860-d98b-4f4f-bc3b-b57f66ac86cd-kube-api-access-nr277\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:21:41.830848 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.830855 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk5qg\" (UniqueName: \"kubernetes.io/projected/bd195e34-e6df-459a-a64d-9d2d4868478b-kube-api-access-hk5qg\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:21:41.869565 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.869537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg"] Jul 15 19:21:41.872165 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:21:41.872138 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b3bbb0_c513_4cc1_986c_79d26cd99a1f.slice/crio-df66f598ed5272c4957a9bbf675e8e9fa9bb8cad458bb5fbc515badb9ffabec4 WatchSource:0}: Error finding container df66f598ed5272c4957a9bbf675e8e9fa9bb8cad458bb5fbc515badb9ffabec4: Status 404 returned error can't find the container with id df66f598ed5272c4957a9bbf675e8e9fa9bb8cad458bb5fbc515badb9ffabec4 Jul 15 19:21:41.879388 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:41.879366 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9"] Jul 15 19:21:41.881956 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:21:41.881934 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcabec3f_3856_4875_8c7a_d1da8e638d32.slice/crio-f6c06bf8c26c9932909caac6c8f43e0e62e43efc59368a47e969dfa82ed3bcb1 WatchSource:0}: Error finding container f6c06bf8c26c9932909caac6c8f43e0e62e43efc59368a47e969dfa82ed3bcb1: Status 404 returned error can't find the container with id f6c06bf8c26c9932909caac6c8f43e0e62e43efc59368a47e969dfa82ed3bcb1 Jul 15 19:21:42.381598 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.381559 2581 generic.go:356] "Generic (PLEG): container finished" podID="bd195e34-e6df-459a-a64d-9d2d4868478b" containerID="94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135" exitCode=0 Jul 15 19:21:42.382011 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.381606 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:42.382011 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.381659 2581 scope.go:117] "RemoveContainer" containerID="94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135" Jul 15 19:21:42.383431 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.383406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" event={"ID":"05b3bbb0-c513-4cc1-986c-79d26cd99a1f","Type":"ContainerStarted","Data":"02edb3957ac011bbbe825f7462df69e263499ea5e35b19715595f8e9bad43d8c"} Jul 15 19:21:42.383565 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.383456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" event={"ID":"05b3bbb0-c513-4cc1-986c-79d26cd99a1f","Type":"ContainerStarted","Data":"df66f598ed5272c4957a9bbf675e8e9fa9bb8cad458bb5fbc515badb9ffabec4"} Jul 15 19:21:42.383565 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.383486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:42.384543 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.384515 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:42.384866 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.384843 2581 generic.go:356] "Generic (PLEG): container finished" podID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" containerID="57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7" exitCode=0 Jul 15 19:21:42.384947 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.384879 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:42.386708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.386693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:42.386796 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.386736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" event={"ID":"dcabec3f-3856-4875-8c7a-d1da8e638d32","Type":"ContainerStarted","Data":"03c4e6231d85a7fcf6872f3c0b35566b37ddcdc5b67d30db88125ff6b17faca6"} Jul 15 19:21:42.386796 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.386774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" event={"ID":"dcabec3f-3856-4875-8c7a-d1da8e638d32","Type":"ContainerStarted","Data":"f6c06bf8c26c9932909caac6c8f43e0e62e43efc59368a47e969dfa82ed3bcb1"} Jul 15 19:21:42.387156 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.387133 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:21:42.387753 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.387714 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:42.390269 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.390242 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:42.392581 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.392566 2581 scope.go:117] "RemoveContainer" containerID="94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135" Jul 15 19:21:42.392858 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.392827 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135\": container with ID starting with 94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135 not found: ID does not exist" containerID="94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135" Jul 15 19:21:42.392954 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.392854 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135"} err="failed to get container status \"94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135\": rpc error: code = NotFound desc = could not find container \"94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135\": container with ID starting with 94594f2d8383725bf29e02391a29f2eadcf11fa9c9656d0a4dfbd33d5c95c135 not found: ID does not exist" Jul 15 19:21:42.392954 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.392876 2581 scope.go:117] "RemoveContainer" containerID="57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7" Jul 15 19:21:42.392954 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.392884 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lt6wn\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lt6wn" Jul 15 19:21:42.400710 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.400694 2581 scope.go:117] "RemoveContainer" containerID="57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7" Jul 15 19:21:42.400943 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.400925 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7\": container with ID starting with 57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7 not found: ID does not exist" containerID="57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7" Jul 15 19:21:42.400992 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.400950 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7"} err="failed to get container status \"57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7\": rpc error: code = NotFound desc = could not find container \"57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7\": container with ID starting with 57d6deae20aeb8a34e8a9b6fb1285845da1ea67c049c6b50e3ade066cb15f8d7 not found: ID does not exist" Jul 15 19:21:42.409026 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.409004 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afb94860-d98b-4f4f-bc3b-b57f66ac86cd" path="/var/lib/kubelet/pods/afb94860-d98b-4f4f-bc3b-b57f66ac86cd/volumes" Jul 15 19:21:42.409392 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.409378 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" path="/var/lib/kubelet/pods/bd195e34-e6df-459a-a64d-9d2d4868478b/volumes" Jul 15 19:21:42.409655 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.409643 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" path="/var/lib/kubelet/pods/c6a82cab-b055-4ab0-892c-59fe6dd4c59f/volumes" Jul 15 19:21:42.421477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.421428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" podStartSLOduration=1.4214085920000001 podStartE2EDuration="1.421408592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:42.419841008 +0000 UTC m=+458.564285651" watchObservedRunningTime="2026-07-15 19:21:42.421408592 +0000 UTC m=+458.565853226" Jul 15 19:21:42.422507 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.422483 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rmtln\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="c6a82cab-b055-4ab0-892c-59fe6dd4c59f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmtln" Jul 15 19:21:42.424774 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:21:42.424753 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cn5rh\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="bd195e34-e6df-459a-a64d-9d2d4868478b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cn5rh" Jul 15 19:21:42.454261 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:42.454207 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" podStartSLOduration=1.454189563 podStartE2EDuration="1.454189563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:42.453554634 +0000 UTC m=+458.597999268" watchObservedRunningTime="2026-07-15 19:21:42.454189563 +0000 UTC m=+458.598634268" Jul 15 19:21:53.395173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:53.395137 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:21:53.395569 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:21:53.395225 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-664x9" Jul 15 19:22:10.074349 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.074313 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz"] Jul 15 19:22:10.079080 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.079055 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.085123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.085098 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tp9nq\"" Jul 15 19:22:10.111052 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.111019 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz"] Jul 15 19:22:10.173063 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173063 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173272 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173272 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173272 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173272 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/979ceaea-7a23-40f2-81eb-030e3e98801c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173493 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173493 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5p26\" (UniqueName: \"kubernetes.io/projected/979ceaea-7a23-40f2-81eb-030e3e98801c-kube-api-access-t5p26\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.173493 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.173397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274482 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274482 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/979ceaea-7a23-40f2-81eb-030e3e98801c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5p26\" (UniqueName: \"kubernetes.io/projected/979ceaea-7a23-40f2-81eb-030e3e98801c-kube-api-access-t5p26\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.274784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.275135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.274927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.275135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.275034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.275135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.275089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.275239 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.275178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.275565 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.275543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/979ceaea-7a23-40f2-81eb-030e3e98801c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.276996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.276972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.277150 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.277136 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.285490 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.285461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5p26\" (UniqueName: \"kubernetes.io/projected/979ceaea-7a23-40f2-81eb-030e3e98801c-kube-api-access-t5p26\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.287124 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.287102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/979ceaea-7a23-40f2-81eb-030e3e98801c-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-jnsmz\" (UID: \"979ceaea-7a23-40f2-81eb-030e3e98801c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.389516 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.389427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:10.532252 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.532169 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz"] Jul 15 19:22:10.534916 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:22:10.534889 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979ceaea_7a23_40f2_81eb_030e3e98801c.slice/crio-62208e03838f8437a7a795806acf3bfbf66e1f6ff404ff33ecaf48e4c0938a6c WatchSource:0}: Error finding container 62208e03838f8437a7a795806acf3bfbf66e1f6ff404ff33ecaf48e4c0938a6c: Status 404 returned error can't find the container with id 62208e03838f8437a7a795806acf3bfbf66e1f6ff404ff33ecaf48e4c0938a6c Jul 15 19:22:10.536921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.536891 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:22:10.536976 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.536955 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:22:10.537016 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:10.536983 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:22:11.522717 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:11.522677 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" event={"ID":"979ceaea-7a23-40f2-81eb-030e3e98801c","Type":"ContainerStarted","Data":"2f3b230922bfc444a3c1d9c4f4fdab2865f8f27dbc0aaea3b944a9392e203fb2"} Jul 15 19:22:11.523106 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:11.522763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" event={"ID":"979ceaea-7a23-40f2-81eb-030e3e98801c","Type":"ContainerStarted","Data":"62208e03838f8437a7a795806acf3bfbf66e1f6ff404ff33ecaf48e4c0938a6c"} Jul 15 19:22:11.559722 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:11.559673 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" podStartSLOduration=1.5596560849999999 podStartE2EDuration="1.559656085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:11.557387597 +0000 UTC m=+487.701832232" watchObservedRunningTime="2026-07-15 19:22:11.559656085 +0000 UTC m=+487.704100798" Jul 15 19:22:12.390611 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:12.390575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:12.395228 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:12.395202 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:12.527734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:12.527704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:12.528514 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:12.528495 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:22:13.829542 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:13.829511 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-sl2jh"] Jul 15 19:22:13.831970 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:13.831950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:13.836228 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:13.836209 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fdgt2\"" Jul 15 19:22:13.845654 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:13.845632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sl2jh"] Jul 15 19:22:13.908854 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:13.908807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lxdp\" (UniqueName: \"kubernetes.io/projected/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848-kube-api-access-7lxdp\") pod \"authorino-58cd955675-sl2jh\" (UID: \"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848\") " pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:14.010204 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.010170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lxdp\" (UniqueName: \"kubernetes.io/projected/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848-kube-api-access-7lxdp\") pod \"authorino-58cd955675-sl2jh\" (UID: \"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848\") " pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:14.027321 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.027263 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lxdp\" (UniqueName: \"kubernetes.io/projected/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848-kube-api-access-7lxdp\") pod \"authorino-58cd955675-sl2jh\" (UID: \"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848\") " pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:14.032871 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.032843 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nlndx"] Jul 15 19:22:14.035410 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.035390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:14.047506 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.047482 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nlndx"] Jul 15 19:22:14.111561 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.111477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q2xd\" (UniqueName: \"kubernetes.io/projected/fce1f18e-c251-4abe-bdce-c16dd59e050a-kube-api-access-6q2xd\") pod \"authorino-75d556bd77-nlndx\" (UID: \"fce1f18e-c251-4abe-bdce-c16dd59e050a\") " pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:14.141354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.141318 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:14.212730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.212694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2xd\" (UniqueName: \"kubernetes.io/projected/fce1f18e-c251-4abe-bdce-c16dd59e050a-kube-api-access-6q2xd\") pod \"authorino-75d556bd77-nlndx\" (UID: \"fce1f18e-c251-4abe-bdce-c16dd59e050a\") " pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:14.243686 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.243651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q2xd\" (UniqueName: \"kubernetes.io/projected/fce1f18e-c251-4abe-bdce-c16dd59e050a-kube-api-access-6q2xd\") pod \"authorino-75d556bd77-nlndx\" (UID: \"fce1f18e-c251-4abe-bdce-c16dd59e050a\") " pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:14.294790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.294764 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sl2jh"] Jul 15 19:22:14.296451 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:22:14.296417 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5be9b0a7_e75e_4cc3_a8c4_9965c71a5848.slice/crio-80a6d32336d9c7c807763961c6e8f6dbc406473f5358e3a498fdca85427a6637 WatchSource:0}: Error finding container 80a6d32336d9c7c807763961c6e8f6dbc406473f5358e3a498fdca85427a6637: Status 404 returned error can't find the container with id 80a6d32336d9c7c807763961c6e8f6dbc406473f5358e3a498fdca85427a6637 Jul 15 19:22:14.344399 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.344358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:14.487488 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.487459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nlndx"] Jul 15 19:22:14.489434 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:22:14.489403 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfce1f18e_c251_4abe_bdce_c16dd59e050a.slice/crio-1488d8f54b1685a57914440af5bb0e208e368da344823e6c328904f3f7346f45 WatchSource:0}: Error finding container 1488d8f54b1685a57914440af5bb0e208e368da344823e6c328904f3f7346f45: Status 404 returned error can't find the container with id 1488d8f54b1685a57914440af5bb0e208e368da344823e6c328904f3f7346f45 Jul 15 19:22:14.538170 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.538134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nlndx" event={"ID":"fce1f18e-c251-4abe-bdce-c16dd59e050a","Type":"ContainerStarted","Data":"1488d8f54b1685a57914440af5bb0e208e368da344823e6c328904f3f7346f45"} Jul 15 19:22:14.539279 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:14.539256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sl2jh" event={"ID":"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848","Type":"ContainerStarted","Data":"80a6d32336d9c7c807763961c6e8f6dbc406473f5358e3a498fdca85427a6637"} Jul 15 19:22:18.565866 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:18.565830 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nlndx" event={"ID":"fce1f18e-c251-4abe-bdce-c16dd59e050a","Type":"ContainerStarted","Data":"a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d"} Jul 15 19:22:18.567276 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:18.567253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sl2jh" event={"ID":"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848","Type":"ContainerStarted","Data":"899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721"} Jul 15 19:22:18.586127 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:18.586048 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nlndx" podStartSLOduration=1.166616988 podStartE2EDuration="4.586034656s" totalImagesPullingTime="3.419417668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:18.584684892 +0000 UTC m=+494.729129524" watchObservedRunningTime="2026-07-15 19:22:18.586034656 +0000 UTC m=+494.730479289" Jul 15 19:22:18.613751 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:18.613698 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-sl2jh" podStartSLOduration=1.990321989 podStartE2EDuration="5.6136806s" totalImagesPullingTime="3.623358611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:18.613348026 +0000 UTC m=+494.757792672" watchObservedRunningTime="2026-07-15 19:22:18.6136806 +0000 UTC m=+494.758125233" Jul 15 19:22:18.634849 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:18.634809 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sl2jh"] Jul 15 19:22:20.577306 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:20.577262 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-sl2jh" podUID="5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" containerName="authorino" containerID="cri-o://899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721" gracePeriod=30 Jul 15 19:22:20.831071 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:20.831007 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:20.976497 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:20.976460 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lxdp\" (UniqueName: \"kubernetes.io/projected/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848-kube-api-access-7lxdp\") pod \"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848\" (UID: \"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848\") " Jul 15 19:22:20.978575 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:20.978552 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848-kube-api-access-7lxdp" (OuterVolumeSpecName: "kube-api-access-7lxdp") pod "5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" (UID: "5be9b0a7-e75e-4cc3-a8c4-9965c71a5848"). InnerVolumeSpecName "kube-api-access-7lxdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:22:21.077861 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.077822 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lxdp\" (UniqueName: \"kubernetes.io/projected/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848-kube-api-access-7lxdp\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:22:21.585823 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.585789 2581 generic.go:356] "Generic (PLEG): container finished" podID="5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" containerID="899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721" exitCode=0 Jul 15 19:22:21.585823 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.585826 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sl2jh" Jul 15 19:22:21.586223 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.585849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sl2jh" event={"ID":"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848","Type":"ContainerDied","Data":"899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721"} Jul 15 19:22:21.586223 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.585879 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sl2jh" event={"ID":"5be9b0a7-e75e-4cc3-a8c4-9965c71a5848","Type":"ContainerDied","Data":"80a6d32336d9c7c807763961c6e8f6dbc406473f5358e3a498fdca85427a6637"} Jul 15 19:22:21.586223 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.585895 2581 scope.go:117] "RemoveContainer" containerID="899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721" Jul 15 19:22:21.594381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.594366 2581 scope.go:117] "RemoveContainer" containerID="899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721" Jul 15 19:22:21.594626 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:22:21.594606 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721\": container with ID starting with 899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721 not found: ID does not exist" containerID="899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721" Jul 15 19:22:21.594671 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.594633 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721"} err="failed to get container status \"899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721\": rpc error: code = NotFound desc = could not find container \"899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721\": container with ID starting with 899734d1c147771e6a98387db9e44997b6dfbac0d3ac8fbe3687db56e2b61721 not found: ID does not exist" Jul 15 19:22:21.612871 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.612844 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sl2jh"] Jul 15 19:22:21.619262 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:21.619235 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-sl2jh"] Jul 15 19:22:22.409178 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:22.409148 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" path="/var/lib/kubelet/pods/5be9b0a7-e75e-4cc3-a8c4-9965c71a5848/volumes" Jul 15 19:22:41.762253 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.762216 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f659r"] Jul 15 19:22:41.762740 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.762583 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" containerName="authorino" Jul 15 19:22:41.762740 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.762596 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" containerName="authorino" Jul 15 19:22:41.762740 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.762706 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be9b0a7-e75e-4cc3-a8c4-9965c71a5848" containerName="authorino" Jul 15 19:22:41.768805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.768777 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:41.778766 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.778739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f659r"] Jul 15 19:22:41.854820 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.854784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cps4l\" (UniqueName: \"kubernetes.io/projected/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f-kube-api-access-cps4l\") pod \"authorino-5d4b67c446-f659r\" (UID: \"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f\") " pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:41.955457 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.955419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps4l\" (UniqueName: \"kubernetes.io/projected/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f-kube-api-access-cps4l\") pod \"authorino-5d4b67c446-f659r\" (UID: \"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f\") " pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:41.970402 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:41.970370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cps4l\" (UniqueName: \"kubernetes.io/projected/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f-kube-api-access-cps4l\") pod \"authorino-5d4b67c446-f659r\" (UID: \"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f\") " pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:42.013713 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.013625 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f659r"] Jul 15 19:22:42.013918 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.013905 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:42.169414 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.169379 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f659r"] Jul 15 19:22:42.172721 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:22:42.172692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cd7081e_9da3_426f_9d3d_1c06ae9cb36f.slice/crio-6dec6d9eb30a3450c682f3eab06cc27b42217cde72789862c11eab225ab858d8 WatchSource:0}: Error finding container 6dec6d9eb30a3450c682f3eab06cc27b42217cde72789862c11eab225ab858d8: Status 404 returned error can't find the container with id 6dec6d9eb30a3450c682f3eab06cc27b42217cde72789862c11eab225ab858d8 Jul 15 19:22:42.208232 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.208193 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77475f79f5-n47kz"] Jul 15 19:22:42.213692 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.213668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.216495 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.216472 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 19:22:42.223766 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.223744 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77475f79f5-n47kz"] Jul 15 19:22:42.259474 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.259442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-tls-cert\") pod \"authorino-77475f79f5-n47kz\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.259644 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.259494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttfz9\" (UniqueName: \"kubernetes.io/projected/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-kube-api-access-ttfz9\") pod \"authorino-77475f79f5-n47kz\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.361085 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.360989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-tls-cert\") pod \"authorino-77475f79f5-n47kz\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.361085 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.361041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttfz9\" (UniqueName: \"kubernetes.io/projected/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-kube-api-access-ttfz9\") pod \"authorino-77475f79f5-n47kz\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.363513 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.363492 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-tls-cert\") pod \"authorino-77475f79f5-n47kz\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.374250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.374227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttfz9\" (UniqueName: \"kubernetes.io/projected/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-kube-api-access-ttfz9\") pod \"authorino-77475f79f5-n47kz\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.524163 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.524125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:22:42.678431 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.678405 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77475f79f5-n47kz"] Jul 15 19:22:42.680960 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:22:42.680930 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdd7e7ad_7ce9_4b6d_a0a0_17ebfc7dd42d.slice/crio-7c2b16bac80c5a3475ba635794c8482a2706d7c95378eb1e22dbbd9aae2b4e99 WatchSource:0}: Error finding container 7c2b16bac80c5a3475ba635794c8482a2706d7c95378eb1e22dbbd9aae2b4e99: Status 404 returned error can't find the container with id 7c2b16bac80c5a3475ba635794c8482a2706d7c95378eb1e22dbbd9aae2b4e99 Jul 15 19:22:42.692176 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.692144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77475f79f5-n47kz" event={"ID":"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d","Type":"ContainerStarted","Data":"7c2b16bac80c5a3475ba635794c8482a2706d7c95378eb1e22dbbd9aae2b4e99"} Jul 15 19:22:42.693962 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.693934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f659r" event={"ID":"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f","Type":"ContainerStarted","Data":"b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60"} Jul 15 19:22:42.694068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.693973 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f659r" event={"ID":"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f","Type":"ContainerStarted","Data":"6dec6d9eb30a3450c682f3eab06cc27b42217cde72789862c11eab225ab858d8"} Jul 15 19:22:42.694128 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.694053 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-f659r" podUID="1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" containerName="authorino" containerID="cri-o://b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60" gracePeriod=30 Jul 15 19:22:42.713210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.713167 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-f659r" podStartSLOduration=1.349949275 podStartE2EDuration="1.713150652s" totalImagesPullingTime="363.201377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:42.711698143 +0000 UTC m=+518.856142776" watchObservedRunningTime="2026-07-15 19:22:42.713150652 +0000 UTC m=+518.857595291" Jul 15 19:22:42.945113 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.945087 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:42.967135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.967105 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cps4l\" (UniqueName: \"kubernetes.io/projected/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f-kube-api-access-cps4l\") pod \"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f\" (UID: \"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f\") " Jul 15 19:22:42.969303 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:42.969268 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f-kube-api-access-cps4l" (OuterVolumeSpecName: "kube-api-access-cps4l") pod "1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" (UID: "1cd7081e-9da3-426f-9d3d-1c06ae9cb36f"). InnerVolumeSpecName "kube-api-access-cps4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:22:43.068057 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.068031 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cps4l\" (UniqueName: \"kubernetes.io/projected/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f-kube-api-access-cps4l\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:22:43.704971 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.704925 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77475f79f5-n47kz" event={"ID":"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d","Type":"ContainerStarted","Data":"84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257"} Jul 15 19:22:43.706128 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.706096 2581 generic.go:356] "Generic (PLEG): container finished" podID="1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" containerID="b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60" exitCode=0 Jul 15 19:22:43.706257 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.706147 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f659r" Jul 15 19:22:43.706257 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.706182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f659r" event={"ID":"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f","Type":"ContainerDied","Data":"b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60"} Jul 15 19:22:43.706257 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.706218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f659r" event={"ID":"1cd7081e-9da3-426f-9d3d-1c06ae9cb36f","Type":"ContainerDied","Data":"6dec6d9eb30a3450c682f3eab06cc27b42217cde72789862c11eab225ab858d8"} Jul 15 19:22:43.706257 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.706238 2581 scope.go:117] "RemoveContainer" containerID="b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60" Jul 15 19:22:43.714589 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.714572 2581 scope.go:117] "RemoveContainer" containerID="b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60" Jul 15 19:22:43.714842 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:22:43.714822 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60\": container with ID starting with b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60 not found: ID does not exist" containerID="b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60" Jul 15 19:22:43.714884 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.714853 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60"} err="failed to get container status \"b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60\": rpc error: code = NotFound desc = could not find container \"b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60\": container with ID starting with b15c13cbc2327c9f244ead33b75c2247a9b5962d9989d79671fad3bd6a458d60 not found: ID does not exist" Jul 15 19:22:43.725202 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.725160 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77475f79f5-n47kz" podStartSLOduration=1.366363704 podStartE2EDuration="1.725146185s" totalImagesPullingTime="358.782481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:43.723804633 +0000 UTC m=+519.868249265" watchObservedRunningTime="2026-07-15 19:22:43.725146185 +0000 UTC m=+519.869590838" Jul 15 19:22:43.740629 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.740599 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f659r"] Jul 15 19:22:43.743633 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.743603 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f659r"] Jul 15 19:22:43.756192 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.756161 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nlndx"] Jul 15 19:22:43.756404 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:43.756378 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nlndx" podUID="fce1f18e-c251-4abe-bdce-c16dd59e050a" containerName="authorino" containerID="cri-o://a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d" gracePeriod=30 Jul 15 19:22:44.026060 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.026031 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:44.078017 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.077981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q2xd\" (UniqueName: \"kubernetes.io/projected/fce1f18e-c251-4abe-bdce-c16dd59e050a-kube-api-access-6q2xd\") pod \"fce1f18e-c251-4abe-bdce-c16dd59e050a\" (UID: \"fce1f18e-c251-4abe-bdce-c16dd59e050a\") " Jul 15 19:22:44.080118 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.080092 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce1f18e-c251-4abe-bdce-c16dd59e050a-kube-api-access-6q2xd" (OuterVolumeSpecName: "kube-api-access-6q2xd") pod "fce1f18e-c251-4abe-bdce-c16dd59e050a" (UID: "fce1f18e-c251-4abe-bdce-c16dd59e050a"). InnerVolumeSpecName "kube-api-access-6q2xd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:22:44.178804 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.178773 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q2xd\" (UniqueName: \"kubernetes.io/projected/fce1f18e-c251-4abe-bdce-c16dd59e050a-kube-api-access-6q2xd\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:22:44.409864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.409826 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" path="/var/lib/kubelet/pods/1cd7081e-9da3-426f-9d3d-1c06ae9cb36f/volumes" Jul 15 19:22:44.716736 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.716638 2581 generic.go:356] "Generic (PLEG): container finished" podID="fce1f18e-c251-4abe-bdce-c16dd59e050a" containerID="a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d" exitCode=0 Jul 15 19:22:44.716736 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.716683 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nlndx" Jul 15 19:22:44.716736 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.716723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nlndx" event={"ID":"fce1f18e-c251-4abe-bdce-c16dd59e050a","Type":"ContainerDied","Data":"a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d"} Jul 15 19:22:44.716995 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.716762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nlndx" event={"ID":"fce1f18e-c251-4abe-bdce-c16dd59e050a","Type":"ContainerDied","Data":"1488d8f54b1685a57914440af5bb0e208e368da344823e6c328904f3f7346f45"} Jul 15 19:22:44.716995 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.716780 2581 scope.go:117] "RemoveContainer" containerID="a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d" Jul 15 19:22:44.725207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.725186 2581 scope.go:117] "RemoveContainer" containerID="a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d" Jul 15 19:22:44.725531 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:22:44.725512 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d\": container with ID starting with a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d not found: ID does not exist" containerID="a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d" Jul 15 19:22:44.725597 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.725539 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d"} err="failed to get container status \"a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d\": rpc error: code = NotFound desc = could not find container \"a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d\": container with ID starting with a88e53cd1bce53c96fa512b594e9197683d7fd28621fb3137b6a89416574fa2d not found: ID does not exist" Jul 15 19:22:44.749608 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.749569 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nlndx"] Jul 15 19:22:44.757004 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:44.756980 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nlndx"] Jul 15 19:22:46.409443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:22:46.409410 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce1f18e-c251-4abe-bdce-c16dd59e050a" path="/var/lib/kubelet/pods/fce1f18e-c251-4abe-bdce-c16dd59e050a/volumes" Jul 15 19:23:34.958738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:34.958702 2581 generic.go:356] "Generic (PLEG): container finished" podID="979ceaea-7a23-40f2-81eb-030e3e98801c" containerID="2f3b230922bfc444a3c1d9c4f4fdab2865f8f27dbc0aaea3b944a9392e203fb2" exitCode=0 Jul 15 19:23:34.959125 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:34.958787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" event={"ID":"979ceaea-7a23-40f2-81eb-030e3e98801c","Type":"ContainerDied","Data":"2f3b230922bfc444a3c1d9c4f4fdab2865f8f27dbc0aaea3b944a9392e203fb2"} Jul 15 19:23:34.959284 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:34.959267 2581 scope.go:117] "RemoveContainer" containerID="2f3b230922bfc444a3c1d9c4f4fdab2865f8f27dbc0aaea3b944a9392e203fb2" Jul 15 19:23:34.960332 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:34.960300 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:23:34.960432 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:34.960370 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:23:34.960432 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:34.960407 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:23:35.966247 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:35.966211 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" event={"ID":"979ceaea-7a23-40f2-81eb-030e3e98801c","Type":"ContainerStarted","Data":"0fd736041125b08ef8e8dd1e505383cdb4cd52950f36438ec0825a22ef078c1e"} Jul 15 19:23:36.390704 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:36.390617 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:23:36.390866 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:36.390844 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-jnsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 15 19:23:36.390916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:36.390897 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" podUID="979ceaea-7a23-40f2-81eb-030e3e98801c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 15 19:23:37.390574 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:37.390541 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-jnsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 15 19:23:37.390955 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:37.390606 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" podUID="979ceaea-7a23-40f2-81eb-030e3e98801c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 15 19:23:38.390854 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:38.390819 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-jnsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 15 19:23:38.391240 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:38.390876 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" podUID="979ceaea-7a23-40f2-81eb-030e3e98801c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 15 19:23:39.389842 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:39.389810 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-jnsmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 15 19:23:39.389989 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:39.389869 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" podUID="979ceaea-7a23-40f2-81eb-030e3e98801c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 15 19:23:40.394819 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:40.394784 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:23:40.395230 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:40.395094 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:23:40.395850 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:40.395830 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-jnsmz" Jul 15 19:23:54.302781 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.302745 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs"] Jul 15 19:23:54.303131 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.303118 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce1f18e-c251-4abe-bdce-c16dd59e050a" containerName="authorino" Jul 15 19:23:54.303131 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.303128 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce1f18e-c251-4abe-bdce-c16dd59e050a" containerName="authorino" Jul 15 19:23:54.303203 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.303143 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" containerName="authorino" Jul 15 19:23:54.303203 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.303148 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" containerName="authorino" Jul 15 19:23:54.303267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.303214 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce1f18e-c251-4abe-bdce-c16dd59e050a" containerName="authorino" Jul 15 19:23:54.303267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.303221 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7081e-9da3-426f-9d3d-1c06ae9cb36f" containerName="authorino" Jul 15 19:23:54.307422 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.306047 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.311038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.311013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vclgr\"" Jul 15 19:23:54.311186 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.311037 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 19:23:54.311186 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.311107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 19:23:54.311339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.311214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 19:23:54.330986 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.330948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs"] Jul 15 19:23:54.387243 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.387212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8p6w\" (UniqueName: \"kubernetes.io/projected/e5482add-ae7e-44b9-ab11-dd28afe82680-kube-api-access-k8p6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.387450 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.387261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.387450 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.387309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5482add-ae7e-44b9-ab11-dd28afe82680-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.387450 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.387349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.387450 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.387422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.387602 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.387472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.488590 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.488561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.488784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.488608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.488784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.488638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8p6w\" (UniqueName: \"kubernetes.io/projected/e5482add-ae7e-44b9-ab11-dd28afe82680-kube-api-access-k8p6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.488784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.488672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.488784 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.488756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5482add-ae7e-44b9-ab11-dd28afe82680-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.489027 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.488812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.489083 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.489031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.489134 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.489085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.489134 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.489114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.491003 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.490980 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5482add-ae7e-44b9-ab11-dd28afe82680-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.491178 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.491158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5482add-ae7e-44b9-ab11-dd28afe82680-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.500974 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.500950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8p6w\" (UniqueName: \"kubernetes.io/projected/e5482add-ae7e-44b9-ab11-dd28afe82680-kube-api-access-k8p6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs\" (UID: \"e5482add-ae7e-44b9-ab11-dd28afe82680\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.619722 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.619632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:23:54.769623 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:54.769591 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs"] Jul 15 19:23:54.773069 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:23:54.773032 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5482add_ae7e_44b9_ab11_dd28afe82680.slice/crio-f39da22b10b70e0e93802ceb5bd0a6bca609a89cae5059ac21b0bd66f1b96398 WatchSource:0}: Error finding container f39da22b10b70e0e93802ceb5bd0a6bca609a89cae5059ac21b0bd66f1b96398: Status 404 returned error can't find the container with id f39da22b10b70e0e93802ceb5bd0a6bca609a89cae5059ac21b0bd66f1b96398 Jul 15 19:23:55.057648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:55.057601 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" event={"ID":"e5482add-ae7e-44b9-ab11-dd28afe82680","Type":"ContainerStarted","Data":"f39da22b10b70e0e93802ceb5bd0a6bca609a89cae5059ac21b0bd66f1b96398"} Jul 15 19:23:56.064626 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:56.064592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" event={"ID":"e5482add-ae7e-44b9-ab11-dd28afe82680","Type":"ContainerStarted","Data":"2d6302afb86cff90bd52cb22de7c0d55f77ffd68bc19c8e4466d3e385909e4a6"} Jul 15 19:23:56.091449 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:23:56.091401 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" podStartSLOduration=0.915456002 podStartE2EDuration="2.091384875s" totalImagesPullingTime="1.175928873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:23:56.090039196 +0000 UTC m=+592.234483829" watchObservedRunningTime="2026-07-15 19:23:56.091384875 +0000 UTC m=+592.235829507" Jul 15 19:24:04.299218 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.299190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:24:04.301705 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.301680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:24:04.306972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.306951 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:24:04.309357 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.309339 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:24:04.620153 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.620056 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:24:04.620153 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.620123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:24:04.632580 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:04.632557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:24:05.117373 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:05.117344 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs" Jul 15 19:24:25.631427 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.631394 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp"] Jul 15 19:24:25.635695 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.635674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.638808 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.638783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 19:24:25.647607 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.647580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp"] Jul 15 19:24:25.673176 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.673128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28769e42-838a-44f0-842e-9011a470576c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.673390 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.673249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.673390 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.673307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.673390 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.673337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnj2b\" (UniqueName: \"kubernetes.io/projected/28769e42-838a-44f0-842e-9011a470576c-kube-api-access-wnj2b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.673553 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.673421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.673553 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.673495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775006 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.774969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28769e42-838a-44f0-842e-9011a470576c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnj2b\" (UniqueName: \"kubernetes.io/projected/28769e42-838a-44f0-842e-9011a470576c-kube-api-access-wnj2b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775564 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775542 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775615 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.775650 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.775634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.777380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.777355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28769e42-838a-44f0-842e-9011a470576c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.777535 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.777516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28769e42-838a-44f0-842e-9011a470576c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.787266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.787245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnj2b\" (UniqueName: \"kubernetes.io/projected/28769e42-838a-44f0-842e-9011a470576c-kube-api-access-wnj2b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp\" (UID: \"28769e42-838a-44f0-842e-9011a470576c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:25.946348 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:25.946309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:26.091351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:26.091316 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp"] Jul 15 19:24:26.094852 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:24:26.094824 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28769e42_838a_44f0_842e_9011a470576c.slice/crio-adf51778a105c220f92f456e81b3bbc9dabb24df8f03b8190dbab56a2a9baba9 WatchSource:0}: Error finding container adf51778a105c220f92f456e81b3bbc9dabb24df8f03b8190dbab56a2a9baba9: Status 404 returned error can't find the container with id adf51778a105c220f92f456e81b3bbc9dabb24df8f03b8190dbab56a2a9baba9 Jul 15 19:24:26.096321 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:26.096301 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 19:24:26.220858 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:26.220748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" event={"ID":"28769e42-838a-44f0-842e-9011a470576c","Type":"ContainerStarted","Data":"adf51778a105c220f92f456e81b3bbc9dabb24df8f03b8190dbab56a2a9baba9"} Jul 15 19:24:27.226942 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:27.226900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" event={"ID":"28769e42-838a-44f0-842e-9011a470576c","Type":"ContainerStarted","Data":"a36ff64db6bfa2309d9978e85cf4c3cab4f62690ad454c220c53120e815ad190"} Jul 15 19:24:27.248978 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:27.248927 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" podStartSLOduration=2.057647055 podStartE2EDuration="2.248909664s" totalImagesPullingTime="191.262609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:27.247113304 +0000 UTC m=+623.391557937" watchObservedRunningTime="2026-07-15 19:24:27.248909664 +0000 UTC m=+623.393354297" Jul 15 19:24:35.947095 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:35.947050 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:35.947656 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:35.947122 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:35.959991 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:35.959965 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:36.283417 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:36.283336 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp" Jul 15 19:24:48.104765 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.104725 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj"] Jul 15 19:24:48.109520 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.109498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.112513 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.112494 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 15 19:24:48.118929 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.118908 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj"] Jul 15 19:24:48.182122 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.182085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.182122 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.182123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pck72\" (UniqueName: \"kubernetes.io/projected/de6b88d3-8615-4b45-889f-cc239e8deac6-kube-api-access-pck72\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.182415 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.182264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6b88d3-8615-4b45-889f-cc239e8deac6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.182415 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.182334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.182415 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.182381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.182415 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.182406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.283552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.283513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.283552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.283551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.283790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.283582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.283790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.283602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pck72\" (UniqueName: \"kubernetes.io/projected/de6b88d3-8615-4b45-889f-cc239e8deac6-kube-api-access-pck72\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.283790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.283669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6b88d3-8615-4b45-889f-cc239e8deac6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.283790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.283701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.284066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.284039 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.284066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.284053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.284182 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.284067 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.285728 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.285705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de6b88d3-8615-4b45-889f-cc239e8deac6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.286057 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.286035 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de6b88d3-8615-4b45-889f-cc239e8deac6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.293685 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.293656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pck72\" (UniqueName: \"kubernetes.io/projected/de6b88d3-8615-4b45-889f-cc239e8deac6-kube-api-access-pck72\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj\" (UID: \"de6b88d3-8615-4b45-889f-cc239e8deac6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.420306 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.420268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:48.562390 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:48.562367 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj"] Jul 15 19:24:48.564362 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:24:48.564328 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde6b88d3_8615_4b45_889f_cc239e8deac6.slice/crio-993efb927ea0c6e9ad65bfe5b395179ffbb0d886bc49703fa2fd0c927259105a WatchSource:0}: Error finding container 993efb927ea0c6e9ad65bfe5b395179ffbb0d886bc49703fa2fd0c927259105a: Status 404 returned error can't find the container with id 993efb927ea0c6e9ad65bfe5b395179ffbb0d886bc49703fa2fd0c927259105a Jul 15 19:24:49.341306 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:49.341255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" event={"ID":"de6b88d3-8615-4b45-889f-cc239e8deac6","Type":"ContainerStarted","Data":"a1e0f5b4f75ca0bb1429332b5224d55991d34e9c9c09d6c42f10fa938f37ee1c"} Jul 15 19:24:49.341716 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:49.341319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" event={"ID":"de6b88d3-8615-4b45-889f-cc239e8deac6","Type":"ContainerStarted","Data":"993efb927ea0c6e9ad65bfe5b395179ffbb0d886bc49703fa2fd0c927259105a"} Jul 15 19:24:49.372883 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:49.372826 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" podStartSLOduration=1.190735529 podStartE2EDuration="1.372809689s" totalImagesPullingTime="182.07416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:49.371389059 +0000 UTC m=+645.515833692" watchObservedRunningTime="2026-07-15 19:24:49.372809689 +0000 UTC m=+645.517254322" Jul 15 19:24:58.420969 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:58.420932 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:58.421386 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:58.420983 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:58.433568 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:58.433536 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:24:59.413468 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:24:59.413437 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj" Jul 15 19:25:57.900664 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:57.900579 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5654ccdb-56rbm"] Jul 15 19:25:57.904048 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:57.904031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:57.917206 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:57.917180 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5654ccdb-56rbm"] Jul 15 19:25:57.922476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:57.922441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afacf53f-d726-4431-b0ea-5317a5248b39-tls-cert\") pod \"authorino-5654ccdb-56rbm\" (UID: \"afacf53f-d726-4431-b0ea-5317a5248b39\") " pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:57.922597 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:57.922575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrc4w\" (UniqueName: \"kubernetes.io/projected/afacf53f-d726-4431-b0ea-5317a5248b39-kube-api-access-rrc4w\") pod \"authorino-5654ccdb-56rbm\" (UID: \"afacf53f-d726-4431-b0ea-5317a5248b39\") " pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:58.023946 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.023911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrc4w\" (UniqueName: \"kubernetes.io/projected/afacf53f-d726-4431-b0ea-5317a5248b39-kube-api-access-rrc4w\") pod \"authorino-5654ccdb-56rbm\" (UID: \"afacf53f-d726-4431-b0ea-5317a5248b39\") " pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:58.024105 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.023967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afacf53f-d726-4431-b0ea-5317a5248b39-tls-cert\") pod \"authorino-5654ccdb-56rbm\" (UID: \"afacf53f-d726-4431-b0ea-5317a5248b39\") " pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:58.026402 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.026372 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/afacf53f-d726-4431-b0ea-5317a5248b39-tls-cert\") pod \"authorino-5654ccdb-56rbm\" (UID: \"afacf53f-d726-4431-b0ea-5317a5248b39\") " pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:58.041432 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.041406 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrc4w\" (UniqueName: \"kubernetes.io/projected/afacf53f-d726-4431-b0ea-5317a5248b39-kube-api-access-rrc4w\") pod \"authorino-5654ccdb-56rbm\" (UID: \"afacf53f-d726-4431-b0ea-5317a5248b39\") " pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:58.213024 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.212988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5654ccdb-56rbm" Jul 15 19:25:58.359245 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.359219 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5654ccdb-56rbm"] Jul 15 19:25:58.361711 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:25:58.361684 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafacf53f_d726_4431_b0ea_5317a5248b39.slice/crio-b54da5efd1f7087b3f824458e4e932a8c07cb415a9207c8d00c253c69133e640 WatchSource:0}: Error finding container b54da5efd1f7087b3f824458e4e932a8c07cb415a9207c8d00c253c69133e640: Status 404 returned error can't find the container with id b54da5efd1f7087b3f824458e4e932a8c07cb415a9207c8d00c253c69133e640 Jul 15 19:25:58.690941 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:58.690910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5654ccdb-56rbm" event={"ID":"afacf53f-d726-4431-b0ea-5317a5248b39","Type":"ContainerStarted","Data":"b54da5efd1f7087b3f824458e4e932a8c07cb415a9207c8d00c253c69133e640"} Jul 15 19:25:59.699239 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:59.699194 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5654ccdb-56rbm" event={"ID":"afacf53f-d726-4431-b0ea-5317a5248b39","Type":"ContainerStarted","Data":"2fa08125e31db30ad1de8f08e8384e2b4da8e0c0d3a109fb59bfe20ed11c2462"} Jul 15 19:25:59.737441 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:59.737372 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5654ccdb-56rbm" podStartSLOduration=2.357850818 podStartE2EDuration="2.737347333s" totalImagesPullingTime="379.496515ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:25:59.734421571 +0000 UTC m=+715.878866205" watchObservedRunningTime="2026-07-15 19:25:59.737347333 +0000 UTC m=+715.881791967" Jul 15 19:25:59.800311 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:59.800206 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77475f79f5-n47kz"] Jul 15 19:25:59.800537 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:25:59.800501 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-77475f79f5-n47kz" podUID="cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" containerName="authorino" containerID="cri-o://84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257" gracePeriod=30 Jul 15 19:26:00.078979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.078950 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:26:00.143820 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.143785 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-tls-cert\") pod \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " Jul 15 19:26:00.143988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.143954 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttfz9\" (UniqueName: \"kubernetes.io/projected/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-kube-api-access-ttfz9\") pod \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\" (UID: \"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d\") " Jul 15 19:26:00.145899 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.145862 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-kube-api-access-ttfz9" (OuterVolumeSpecName: "kube-api-access-ttfz9") pod "cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" (UID: "cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d"). InnerVolumeSpecName "kube-api-access-ttfz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:26:00.154521 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.154483 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" (UID: "cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 19:26:00.245434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.245351 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttfz9\" (UniqueName: \"kubernetes.io/projected/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-kube-api-access-ttfz9\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:26:00.245434 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.245385 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d-tls-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:26:00.705231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.705194 2581 generic.go:356] "Generic (PLEG): container finished" podID="cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" containerID="84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257" exitCode=0 Jul 15 19:26:00.705708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.705252 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77475f79f5-n47kz" Jul 15 19:26:00.705708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.705256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77475f79f5-n47kz" event={"ID":"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d","Type":"ContainerDied","Data":"84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257"} Jul 15 19:26:00.705708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.705335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77475f79f5-n47kz" event={"ID":"cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d","Type":"ContainerDied","Data":"7c2b16bac80c5a3475ba635794c8482a2706d7c95378eb1e22dbbd9aae2b4e99"} Jul 15 19:26:00.705708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.705363 2581 scope.go:117] "RemoveContainer" containerID="84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257" Jul 15 19:26:00.714485 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.714463 2581 scope.go:117] "RemoveContainer" containerID="84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257" Jul 15 19:26:00.714785 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:26:00.714761 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257\": container with ID starting with 84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257 not found: ID does not exist" containerID="84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257" Jul 15 19:26:00.714883 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.714789 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257"} err="failed to get container status \"84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257\": rpc error: code = NotFound desc = could not find container \"84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257\": container with ID starting with 84d62d83df1a0aa2bace3eed21be7f8794f06fde41d5789070fc6c6c7e595257 not found: ID does not exist" Jul 15 19:26:00.728694 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.728666 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77475f79f5-n47kz"] Jul 15 19:26:00.733577 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:00.733551 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77475f79f5-n47kz"] Jul 15 19:26:02.410153 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:26:02.410119 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" path="/var/lib/kubelet/pods/cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d/volumes" Jul 15 19:29:04.331363 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:29:04.331257 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:29:04.333790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:29:04.332750 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:29:04.340667 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:29:04.340645 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:29:04.341488 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:29:04.341466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:32:11.249340 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:11.249225 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg"] Jul 15 19:32:11.250001 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:11.249518 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" podUID="05b3bbb0-c513-4cc1-986c-79d26cd99a1f" containerName="manager" containerID="cri-o://02edb3957ac011bbbe825f7462df69e263499ea5e35b19715595f8e9bad43d8c" gracePeriod=10 Jul 15 19:32:14.580796 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.580755 2581 generic.go:356] "Generic (PLEG): container finished" podID="05b3bbb0-c513-4cc1-986c-79d26cd99a1f" containerID="02edb3957ac011bbbe825f7462df69e263499ea5e35b19715595f8e9bad43d8c" exitCode=0 Jul 15 19:32:14.581260 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.580826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" event={"ID":"05b3bbb0-c513-4cc1-986c-79d26cd99a1f","Type":"ContainerDied","Data":"02edb3957ac011bbbe825f7462df69e263499ea5e35b19715595f8e9bad43d8c"} Jul 15 19:32:14.610736 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.610705 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:32:14.747881 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.747795 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-extensions-socket-volume\") pod \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " Jul 15 19:32:14.747881 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.747874 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw8nq\" (UniqueName: \"kubernetes.io/projected/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-kube-api-access-tw8nq\") pod \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\" (UID: \"05b3bbb0-c513-4cc1-986c-79d26cd99a1f\") " Jul 15 19:32:14.748180 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.748157 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05b3bbb0-c513-4cc1-986c-79d26cd99a1f" (UID: "05b3bbb0-c513-4cc1-986c-79d26cd99a1f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:32:14.749866 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.749843 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-kube-api-access-tw8nq" (OuterVolumeSpecName: "kube-api-access-tw8nq") pod "05b3bbb0-c513-4cc1-986c-79d26cd99a1f" (UID: "05b3bbb0-c513-4cc1-986c-79d26cd99a1f"). InnerVolumeSpecName "kube-api-access-tw8nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:32:14.849146 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.849105 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-extensions-socket-volume\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:32:14.849146 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:14.849139 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw8nq\" (UniqueName: \"kubernetes.io/projected/05b3bbb0-c513-4cc1-986c-79d26cd99a1f-kube-api-access-tw8nq\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:32:15.587400 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:15.587369 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" Jul 15 19:32:15.587814 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:15.587398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg" event={"ID":"05b3bbb0-c513-4cc1-986c-79d26cd99a1f","Type":"ContainerDied","Data":"df66f598ed5272c4957a9bbf675e8e9fa9bb8cad458bb5fbc515badb9ffabec4"} Jul 15 19:32:15.587814 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:15.587457 2581 scope.go:117] "RemoveContainer" containerID="02edb3957ac011bbbe825f7462df69e263499ea5e35b19715595f8e9bad43d8c" Jul 15 19:32:15.613135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:15.613104 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg"] Jul 15 19:32:15.617438 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:15.617410 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zczdg"] Jul 15 19:32:16.415247 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:32:16.415216 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b3bbb0-c513-4cc1-986c-79d26cd99a1f" path="/var/lib/kubelet/pods/05b3bbb0-c513-4cc1-986c-79d26cd99a1f/volumes" Jul 15 19:33:12.386158 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386119 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld"] Jul 15 19:33:12.386661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386530 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" containerName="authorino" Jul 15 19:33:12.386661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386542 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" containerName="authorino" Jul 15 19:33:12.386661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386566 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b3bbb0-c513-4cc1-986c-79d26cd99a1f" containerName="manager" Jul 15 19:33:12.386661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386571 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b3bbb0-c513-4cc1-986c-79d26cd99a1f" containerName="manager" Jul 15 19:33:12.386661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386630 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdd7e7ad-7ce9-4b6d-a0a0-17ebfc7dd42d" containerName="authorino" Jul 15 19:33:12.386661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.386639 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b3bbb0-c513-4cc1-986c-79d26cd99a1f" containerName="manager" Jul 15 19:33:12.389851 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.389831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.392723 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.392702 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r4m2d\"" Jul 15 19:33:12.410597 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.410570 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld"] Jul 15 19:33:12.463106 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.463068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rn7b\" (UniqueName: \"kubernetes.io/projected/c2ae6809-661a-4139-a9ee-69a50b5a5777-kube-api-access-5rn7b\") pod \"kuadrant-operator-controller-manager-86878c769f-qwnld\" (UID: \"c2ae6809-661a-4139-a9ee-69a50b5a5777\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.463273 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.463172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ae6809-661a-4139-a9ee-69a50b5a5777-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qwnld\" (UID: \"c2ae6809-661a-4139-a9ee-69a50b5a5777\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.564282 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.564244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rn7b\" (UniqueName: \"kubernetes.io/projected/c2ae6809-661a-4139-a9ee-69a50b5a5777-kube-api-access-5rn7b\") pod \"kuadrant-operator-controller-manager-86878c769f-qwnld\" (UID: \"c2ae6809-661a-4139-a9ee-69a50b5a5777\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.564473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.564360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ae6809-661a-4139-a9ee-69a50b5a5777-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qwnld\" (UID: \"c2ae6809-661a-4139-a9ee-69a50b5a5777\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.564730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.564713 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2ae6809-661a-4139-a9ee-69a50b5a5777-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qwnld\" (UID: \"c2ae6809-661a-4139-a9ee-69a50b5a5777\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.578446 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.578412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rn7b\" (UniqueName: \"kubernetes.io/projected/c2ae6809-661a-4139-a9ee-69a50b5a5777-kube-api-access-5rn7b\") pod \"kuadrant-operator-controller-manager-86878c769f-qwnld\" (UID: \"c2ae6809-661a-4139-a9ee-69a50b5a5777\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.699816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.699781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:12.839051 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.838888 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld"] Jul 15 19:33:12.842156 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:33:12.842127 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ae6809_661a_4139_a9ee_69a50b5a5777.slice/crio-ae275c47654e6755a9a17045a5245bbddfbe39f2848a4f60d5d42c2ddef5c8e8 WatchSource:0}: Error finding container ae275c47654e6755a9a17045a5245bbddfbe39f2848a4f60d5d42c2ddef5c8e8: Status 404 returned error can't find the container with id ae275c47654e6755a9a17045a5245bbddfbe39f2848a4f60d5d42c2ddef5c8e8 Jul 15 19:33:12.867355 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:12.867321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" event={"ID":"c2ae6809-661a-4139-a9ee-69a50b5a5777","Type":"ContainerStarted","Data":"ae275c47654e6755a9a17045a5245bbddfbe39f2848a4f60d5d42c2ddef5c8e8"} Jul 15 19:33:13.874608 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:13.874568 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" event={"ID":"c2ae6809-661a-4139-a9ee-69a50b5a5777","Type":"ContainerStarted","Data":"264086ded780e9c1b89b0d60b2e47e52060ef066663de73068dc5b11cf881b1c"} Jul 15 19:33:13.875210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:13.875188 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:33:13.900162 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:13.900110 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" podStartSLOduration=1.900094876 podStartE2EDuration="1.900094876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:33:13.896853276 +0000 UTC m=+1150.041297909" watchObservedRunningTime="2026-07-15 19:33:13.900094876 +0000 UTC m=+1150.044539509" Jul 15 19:33:25.886337 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:33:25.886303 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qwnld" Jul 15 19:34:04.367111 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:34:04.367000 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:34:04.371012 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:34:04.367492 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:34:04.383807 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:34:04.383774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:34:04.384084 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:34:04.384058 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:39:04.414217 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:04.414185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:39:04.416865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:04.415166 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:39:04.428144 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:04.427582 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:39:04.428328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:04.428233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:39:32.592573 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.592497 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8"] Jul 15 19:39:32.596711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.596688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.599929 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.599902 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-805941a5-openshift-default-dockercfg-78642\"" Jul 15 19:39:32.617607 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.617579 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8"] Jul 15 19:39:32.707864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.707833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-token\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708028 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.707887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-credential-socket\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708028 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.707975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9twn\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-kube-api-access-h9twn\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708028 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.708025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-socket\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708182 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.708050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-certs\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708182 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.708131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-envoy\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708182 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.708173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-data\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.708225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34745ed3-80f7-4534-bef8-b2ca728ff382-istiod-ca-cert\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.708328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.708248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-podinfo\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9twn\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-kube-api-access-h9twn\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-socket\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-certs\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-envoy\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-data\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34745ed3-80f7-4534-bef8-b2ca728ff382-istiod-ca-cert\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-podinfo\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-token\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.809966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-credential-socket\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.810395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-credential-socket\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.810695 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-data\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.810981 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-socket\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.811243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-certs\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.811402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34745ed3-80f7-4534-bef8-b2ca728ff382-istiod-ca-cert\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.813599 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.812618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-envoy\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.814475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.814060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-podinfo\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.820026 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.819998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9twn\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-kube-api-access-h9twn\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.820026 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.820015 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-token\") pod \"e2e-ait-805941a5-openshift-default-6888769665-92pc8\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:32.907209 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:32.907115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:33.057108 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.057081 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8"] Jul 15 19:39:33.058861 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:39:33.058834 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34745ed3_80f7_4534_bef8_b2ca728ff382.slice/crio-ec094c8a5ffc12e3506add2ade38bba06f6c7bf4123caaa368fcd4bbe448f230 WatchSource:0}: Error finding container ec094c8a5ffc12e3506add2ade38bba06f6c7bf4123caaa368fcd4bbe448f230: Status 404 returned error can't find the container with id ec094c8a5ffc12e3506add2ade38bba06f6c7bf4123caaa368fcd4bbe448f230 Jul 15 19:39:33.060997 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.060966 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:39:33.061054 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.061029 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:39:33.061094 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.061061 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:39:33.756185 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.756148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" event={"ID":"34745ed3-80f7-4534-bef8-b2ca728ff382","Type":"ContainerStarted","Data":"72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c"} Jul 15 19:39:33.756600 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.756203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" event={"ID":"34745ed3-80f7-4534-bef8-b2ca728ff382","Type":"ContainerStarted","Data":"ec094c8a5ffc12e3506add2ade38bba06f6c7bf4123caaa368fcd4bbe448f230"} Jul 15 19:39:33.785934 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.785876 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" podStartSLOduration=1.7858578170000001 podStartE2EDuration="1.785857817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:33.783068499 +0000 UTC m=+1529.927513153" watchObservedRunningTime="2026-07-15 19:39:33.785857817 +0000 UTC m=+1529.930302450" Jul 15 19:39:33.907694 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:33.907661 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:34.913860 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:34.913830 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:35.765626 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:35.765591 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:35.766553 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:35.766531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:49.837805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:49.837765 2581 generic.go:356] "Generic (PLEG): container finished" podID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerID="72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c" exitCode=0 Jul 15 19:39:49.838266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:49.837837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" event={"ID":"34745ed3-80f7-4534-bef8-b2ca728ff382","Type":"ContainerDied","Data":"72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c"} Jul 15 19:39:49.838266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:49.838235 2581 scope.go:117] "RemoveContainer" containerID="72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c" Jul 15 19:39:49.839192 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:49.839158 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:39:49.839306 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:49.839226 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:39:49.839306 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:49.839260 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:39:50.766334 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:50.766283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:50.848944 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:50.848898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" event={"ID":"34745ed3-80f7-4534-bef8-b2ca728ff382","Type":"ContainerStarted","Data":"e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424"} Jul 15 19:39:50.908055 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:50.908018 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:50.909359 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:50.909335 2581 patch_prober.go:28] interesting pod/e2e-ait-805941a5-openshift-default-6888769665-92pc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 15 19:39:50.909428 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:50.909385 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 15 19:39:51.908586 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:51.908543 2581 patch_prober.go:28] interesting pod/e2e-ait-805941a5-openshift-default-6888769665-92pc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 15 19:39:51.909075 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:51.908612 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 15 19:39:52.907820 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:52.907774 2581 patch_prober.go:28] interesting pod/e2e-ait-805941a5-openshift-default-6888769665-92pc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 15 19:39:52.907990 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:52.907843 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 15 19:39:53.907668 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:53.907635 2581 patch_prober.go:28] interesting pod/e2e-ait-805941a5-openshift-default-6888769665-92pc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 15 19:39:53.908072 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:53.907688 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 15 19:39:54.912381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:54.912354 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:54.912777 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:54.912629 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:39:54.913404 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:39:54.913383 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:41:04.209134 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.209052 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8"] Jul 15 19:41:04.209584 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.209316 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" containerID="cri-o://e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424" gracePeriod=30 Jul 15 19:41:04.801547 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.801365 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh"] Jul 15 19:41:04.806604 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.806579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.810136 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.810112 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c29a5b8d-gw-openshift-default-dockercfg-b2p5l\"" Jul 15 19:41:04.820814 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.820788 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh"] Jul 15 19:41:04.939346 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-data\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-istio-token\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-certs\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-credential-socket\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwbw\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-kube-api-access-tzwbw\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939523 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-envoy\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939932 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17de591-3e02-4372-bca5-6c61181e4bef-istiod-ca-cert\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939932 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17de591-3e02-4372-bca5-6c61181e4bef-istio-podinfo\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:04.939932 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:04.939652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-socket\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040307 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-socket\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-data\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-istio-token\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040477 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-certs\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040592 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-credential-socket\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040592 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwbw\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-kube-api-access-tzwbw\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040592 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-envoy\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040737 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17de591-3e02-4372-bca5-6c61181e4bef-istiod-ca-cert\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040737 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17de591-3e02-4372-bca5-6c61181e4bef-istio-podinfo\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040737 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040726 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-socket\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040906 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040833 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-certs\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.040906 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-credential-socket\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.041042 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.040966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-data\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.041356 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.041334 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17de591-3e02-4372-bca5-6c61181e4bef-istiod-ca-cert\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.042900 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.042878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-envoy\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.043018 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.042996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17de591-3e02-4372-bca5-6c61181e4bef-istio-podinfo\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.054064 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.054001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwbw\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-kube-api-access-tzwbw\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.054260 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.054241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-istio-token\") pod \"e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.117379 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.117325 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:05.273531 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.273502 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh"] Jul 15 19:41:05.276312 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:41:05.276251 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17de591_3e02_4372_bca5_6c61181e4bef.slice/crio-1f9163f531d72a9390ca9f79cf13fc1222c7dbe9205282b3250dda6828973813 WatchSource:0}: Error finding container 1f9163f531d72a9390ca9f79cf13fc1222c7dbe9205282b3250dda6828973813: Status 404 returned error can't find the container with id 1f9163f531d72a9390ca9f79cf13fc1222c7dbe9205282b3250dda6828973813 Jul 15 19:41:05.278440 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.278402 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:41:05.278542 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.278474 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:41:05.278542 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:05.278502 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:41:06.230019 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:06.229984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" event={"ID":"e17de591-3e02-4372-bca5-6c61181e4bef","Type":"ContainerStarted","Data":"0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481"} Jul 15 19:41:06.230206 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:06.230047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" event={"ID":"e17de591-3e02-4372-bca5-6c61181e4bef","Type":"ContainerStarted","Data":"1f9163f531d72a9390ca9f79cf13fc1222c7dbe9205282b3250dda6828973813"} Jul 15 19:41:06.256411 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:06.256353 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podStartSLOduration=2.256336522 podStartE2EDuration="2.256336522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:06.254063012 +0000 UTC m=+1622.398507658" watchObservedRunningTime="2026-07-15 19:41:06.256336522 +0000 UTC m=+1622.400781156" Jul 15 19:41:07.118445 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:07.118393 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:07.123489 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:07.123461 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:07.236912 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:07.236877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:07.237943 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:07.237919 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:09.462381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.462357 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:41:09.586814 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586784 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-envoy\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.586988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586839 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-certs\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.586988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586883 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9twn\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-kube-api-access-h9twn\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.586988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586907 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-token\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.586988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586929 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-socket\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.586988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586962 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-podinfo\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.586988 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.586987 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-data\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.587264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587014 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34745ed3-80f7-4534-bef8-b2ca728ff382-istiod-ca-cert\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.587264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-credential-socket\") pod \"34745ed3-80f7-4534-bef8-b2ca728ff382\" (UID: \"34745ed3-80f7-4534-bef8-b2ca728ff382\") " Jul 15 19:41:09.587264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587245 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:41:09.587439 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587426 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.587508 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587483 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34745ed3-80f7-4534-bef8-b2ca728ff382-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:41:09.587578 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587490 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:41:09.587701 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.587655 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:41:09.588192 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.588172 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-data" (OuterVolumeSpecName: "istio-data") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:41:09.589016 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.588986 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:41:09.589363 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.589343 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-token" (OuterVolumeSpecName: "istio-token") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:41:09.589625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.589598 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:41:09.589711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.589606 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-kube-api-access-h9twn" (OuterVolumeSpecName: "kube-api-access-h9twn") pod "34745ed3-80f7-4534-bef8-b2ca728ff382" (UID: "34745ed3-80f7-4534-bef8-b2ca728ff382"). InnerVolumeSpecName "kube-api-access-h9twn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:41:09.688053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688012 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688046 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688055 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688053 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688063 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688071 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34745ed3-80f7-4534-bef8-b2ca728ff382-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688079 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688087 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34745ed3-80f7-4534-bef8-b2ca728ff382-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:09.688380 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:09.688095 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9twn\" (UniqueName: \"kubernetes.io/projected/34745ed3-80f7-4534-bef8-b2ca728ff382-kube-api-access-h9twn\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:41:10.253557 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.253524 2581 generic.go:356] "Generic (PLEG): container finished" podID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerID="e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424" exitCode=0 Jul 15 19:41:10.253734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.253568 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" Jul 15 19:41:10.253734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.253579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" event={"ID":"34745ed3-80f7-4534-bef8-b2ca728ff382","Type":"ContainerDied","Data":"e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424"} Jul 15 19:41:10.253734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.253622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8" event={"ID":"34745ed3-80f7-4534-bef8-b2ca728ff382","Type":"ContainerDied","Data":"ec094c8a5ffc12e3506add2ade38bba06f6c7bf4123caaa368fcd4bbe448f230"} Jul 15 19:41:10.253734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.253642 2581 scope.go:117] "RemoveContainer" containerID="e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424" Jul 15 19:41:10.263024 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.262996 2581 scope.go:117] "RemoveContainer" containerID="72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c" Jul 15 19:41:10.271080 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.271060 2581 scope.go:117] "RemoveContainer" containerID="e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424" Jul 15 19:41:10.271346 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:41:10.271328 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424\": container with ID starting with e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424 not found: ID does not exist" containerID="e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424" Jul 15 19:41:10.271404 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.271367 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424"} err="failed to get container status \"e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424\": rpc error: code = NotFound desc = could not find container \"e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424\": container with ID starting with e40781a56dd2ab4317f18e68b99152ec92892832a7c36ff9cff38e7cbc7da424 not found: ID does not exist" Jul 15 19:41:10.271404 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.271385 2581 scope.go:117] "RemoveContainer" containerID="72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c" Jul 15 19:41:10.271651 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:41:10.271632 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c\": container with ID starting with 72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c not found: ID does not exist" containerID="72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c" Jul 15 19:41:10.271694 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.271657 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c"} err="failed to get container status \"72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c\": rpc error: code = NotFound desc = could not find container \"72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c\": container with ID starting with 72d1b1a1c9d69c0467d14dc02ed33ed42fa6d560914ea01d0bec74e4b751480c not found: ID does not exist" Jul 15 19:41:10.277968 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.277945 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8"] Jul 15 19:41:10.285537 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.285513 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-805941a5-openshift-default-6888769665-92pc8"] Jul 15 19:41:10.409962 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:10.409927 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" path="/var/lib/kubelet/pods/34745ed3-80f7-4534-bef8-b2ca728ff382/volumes" Jul 15 19:41:21.320473 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:21.320437 2581 generic.go:356] "Generic (PLEG): container finished" podID="e17de591-3e02-4372-bca5-6c61181e4bef" containerID="0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481" exitCode=0 Jul 15 19:41:21.320894 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:21.320509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" event={"ID":"e17de591-3e02-4372-bca5-6c61181e4bef","Type":"ContainerDied","Data":"0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481"} Jul 15 19:41:21.320952 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:21.320934 2581 scope.go:117] "RemoveContainer" containerID="0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481" Jul 15 19:41:21.322079 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:21.322044 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:41:21.322186 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:21.322120 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:41:21.322186 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:21.322158 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:41:22.237311 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:22.237251 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:22.327447 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:22.327405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" event={"ID":"e17de591-3e02-4372-bca5-6c61181e4bef","Type":"ContainerStarted","Data":"c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea"} Jul 15 19:41:23.117895 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:23.117855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:23.119153 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:23.119128 2581 patch_prober.go:28] interesting pod/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 15 19:41:23.119270 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:23.119179 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 15 19:41:24.118622 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:24.118584 2581 patch_prober.go:28] interesting pod/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 15 19:41:24.119027 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:24.118643 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 15 19:41:25.118274 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:25.118225 2581 patch_prober.go:28] interesting pod/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 15 19:41:25.118475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:25.118320 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 15 19:41:26.117850 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:26.117813 2581 patch_prober.go:28] interesting pod/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 15 19:41:26.118237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:26.117874 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 15 19:41:27.122606 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:27.122569 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:27.123066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:27.122855 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:41:27.123614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:41:27.123598 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:42:10.744369 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:10.744333 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh"] Jul 15 19:42:10.744796 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:10.744562 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" containerID="cri-o://c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea" gracePeriod=30 Jul 15 19:42:12.125096 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:12.125056 2581 patch_prober.go:28] interesting pod/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 19:42:12.125581 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:12.125123 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 19:42:16.008327 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.008238 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:42:16.130966 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.130933 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-data\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.130966 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.130968 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-istio-token\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.130984 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-socket\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131028 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17de591-3e02-4372-bca5-6c61181e4bef-istiod-ca-cert\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131063 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-envoy\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131109 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-credential-socket\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131177 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzwbw\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-kube-api-access-tzwbw\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131211 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-certs\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131254 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17de591-3e02-4372-bca5-6c61181e4bef-istio-podinfo\") pod \"e17de591-3e02-4372-bca5-6c61181e4bef\" (UID: \"e17de591-3e02-4372-bca5-6c61181e4bef\") " Jul 15 19:42:16.131625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131312 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:42:16.131625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131481 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17de591-3e02-4372-bca5-6c61181e4bef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:42:16.131625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131533 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:42:16.131625 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131623 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.131873 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131642 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e17de591-3e02-4372-bca5-6c61181e4bef-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.131873 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131656 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.131873 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.131692 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:42:16.132078 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.132046 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-data" (OuterVolumeSpecName: "istio-data") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:42:16.133974 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.133948 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-kube-api-access-tzwbw" (OuterVolumeSpecName: "kube-api-access-tzwbw") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "kube-api-access-tzwbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:42:16.133974 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.133971 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-istio-token" (OuterVolumeSpecName: "istio-token") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:42:16.134158 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.134087 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:42:16.134248 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.134223 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e17de591-3e02-4372-bca5-6c61181e4bef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e17de591-3e02-4372-bca5-6c61181e4bef" (UID: "e17de591-3e02-4372-bca5-6c61181e4bef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:42:16.233001 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.232956 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e17de591-3e02-4372-bca5-6c61181e4bef-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.233001 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.233000 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.233001 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.233013 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.233241 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.233026 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.233241 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.233040 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzwbw\" (UniqueName: \"kubernetes.io/projected/e17de591-3e02-4372-bca5-6c61181e4bef-kube-api-access-tzwbw\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.233241 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.233055 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e17de591-3e02-4372-bca5-6c61181e4bef-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:42:16.603184 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.603152 2581 generic.go:356] "Generic (PLEG): container finished" podID="e17de591-3e02-4372-bca5-6c61181e4bef" containerID="c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea" exitCode=0 Jul 15 19:42:16.603401 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.603205 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" Jul 15 19:42:16.603401 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.603232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" event={"ID":"e17de591-3e02-4372-bca5-6c61181e4bef","Type":"ContainerDied","Data":"c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea"} Jul 15 19:42:16.603401 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.603308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh" event={"ID":"e17de591-3e02-4372-bca5-6c61181e4bef","Type":"ContainerDied","Data":"1f9163f531d72a9390ca9f79cf13fc1222c7dbe9205282b3250dda6828973813"} Jul 15 19:42:16.603401 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.603321 2581 scope.go:117] "RemoveContainer" containerID="c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea" Jul 15 19:42:16.612529 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.612510 2581 scope.go:117] "RemoveContainer" containerID="0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481" Jul 15 19:42:16.620396 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.620377 2581 scope.go:117] "RemoveContainer" containerID="c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea" Jul 15 19:42:16.620669 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:42:16.620651 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea\": container with ID starting with c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea not found: ID does not exist" containerID="c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea" Jul 15 19:42:16.620739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.620680 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea"} err="failed to get container status \"c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea\": rpc error: code = NotFound desc = could not find container \"c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea\": container with ID starting with c7968274817cdbbd983f434277cf2c1e467f27c027c06cd2684f4891e89853ea not found: ID does not exist" Jul 15 19:42:16.620739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.620697 2581 scope.go:117] "RemoveContainer" containerID="0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481" Jul 15 19:42:16.620955 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:42:16.620937 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481\": container with ID starting with 0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481 not found: ID does not exist" containerID="0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481" Jul 15 19:42:16.621007 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.620957 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481"} err="failed to get container status \"0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481\": rpc error: code = NotFound desc = could not find container \"0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481\": container with ID starting with 0bfcd1b0b04c7d72e8167b536134d2e6e738743a97320ce57811354cc5d83481 not found: ID does not exist" Jul 15 19:42:16.626836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.626813 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh"] Jul 15 19:42:16.639008 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:16.638984 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c29a5b8d-gw-openshift-default-78c7f7976c-bm4gh"] Jul 15 19:42:17.814522 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.814422 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w"] Jul 15 19:42:17.815027 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815003 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" Jul 15 19:42:17.815027 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815027 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815054 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815064 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815076 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815085 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815108 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815118 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" Jul 15 19:42:17.815210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815210 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" Jul 15 19:42:17.815588 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815221 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" Jul 15 19:42:17.815588 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.815231 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" containerName="istio-proxy" Jul 15 19:42:17.820057 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.820034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.823442 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.823419 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e3a43be3-openshift-default-dockercfg-wb788\"" Jul 15 19:42:17.837621 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.837595 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w"] Jul 15 19:42:17.950756 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.950723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tcvf\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-kube-api-access-7tcvf\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.950921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.950767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-podinfo\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.950921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.950843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-credential-socket\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.950996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.950922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-data\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.950996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.950956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-certs\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.950996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.950978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-token\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.951094 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.951008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-envoy\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.951094 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.951045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952466ef-49ae-4025-8dc8-fa64424b16a9-istiod-ca-cert\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:17.951157 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:17.951106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-socket\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051638 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-credential-socket\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-data\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-certs\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-token\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-envoy\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952466ef-49ae-4025-8dc8-fa64424b16a9-istiod-ca-cert\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-socket\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.051826 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tcvf\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-kube-api-access-7tcvf\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.052096 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.051847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-podinfo\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.052096 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.052053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-credential-socket\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.052204 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.052171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-socket\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.052327 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.052277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-certs\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.052480 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.052324 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-data\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.052570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.052546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952466ef-49ae-4025-8dc8-fa64424b16a9-istiod-ca-cert\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.054198 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.054181 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-envoy\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.054382 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.054364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-podinfo\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.062332 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.062310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-token\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.062439 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.062400 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tcvf\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-kube-api-access-7tcvf\") pod \"e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.133352 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.133227 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:18.285829 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.285799 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w"] Jul 15 19:42:18.287925 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:42:18.287897 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952466ef_49ae_4025_8dc8_fa64424b16a9.slice/crio-d8b4d549a46282e197c023a7ab9a700e90b4ff56d76309733d6501747f42531c WatchSource:0}: Error finding container d8b4d549a46282e197c023a7ab9a700e90b4ff56d76309733d6501747f42531c: Status 404 returned error can't find the container with id d8b4d549a46282e197c023a7ab9a700e90b4ff56d76309733d6501747f42531c Jul 15 19:42:18.289991 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.289957 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:42:18.290071 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.290024 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:42:18.290071 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.290052 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:42:18.410584 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.410555 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17de591-3e02-4372-bca5-6c61181e4bef" path="/var/lib/kubelet/pods/e17de591-3e02-4372-bca5-6c61181e4bef/volumes" Jul 15 19:42:18.616938 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.616893 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" event={"ID":"952466ef-49ae-4025-8dc8-fa64424b16a9","Type":"ContainerStarted","Data":"690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25"} Jul 15 19:42:18.617108 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.617002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" event={"ID":"952466ef-49ae-4025-8dc8-fa64424b16a9","Type":"ContainerStarted","Data":"d8b4d549a46282e197c023a7ab9a700e90b4ff56d76309733d6501747f42531c"} Jul 15 19:42:18.652183 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:18.652126 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" podStartSLOduration=1.6521089180000001 podStartE2EDuration="1.652108918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:18.650314777 +0000 UTC m=+1694.794759404" watchObservedRunningTime="2026-07-15 19:42:18.652108918 +0000 UTC m=+1694.796553550" Jul 15 19:42:19.134395 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:19.134343 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:19.140412 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:19.140384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:19.621439 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:19.621408 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:19.622510 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:19.622488 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:29.682515 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:29.682481 2581 generic.go:356] "Generic (PLEG): container finished" podID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerID="690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25" exitCode=0 Jul 15 19:42:29.682924 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:29.682557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" event={"ID":"952466ef-49ae-4025-8dc8-fa64424b16a9","Type":"ContainerDied","Data":"690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25"} Jul 15 19:42:29.682924 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:29.682922 2581 scope.go:117] "RemoveContainer" containerID="690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25" Jul 15 19:42:29.683909 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:29.683882 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:42:29.683961 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:29.683949 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:42:29.683996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:29.683981 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:42:30.688905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:30.688869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" event={"ID":"952466ef-49ae-4025-8dc8-fa64424b16a9","Type":"ContainerStarted","Data":"8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0"} Jul 15 19:42:31.134220 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:31.134044 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:31.135919 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:31.135551 2581 patch_prober.go:28] interesting pod/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 15 19:42:31.135919 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:31.135627 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 15 19:42:32.134441 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:32.134396 2581 patch_prober.go:28] interesting pod/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 15 19:42:32.134959 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:32.134473 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 15 19:42:33.134395 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:33.134356 2581 patch_prober.go:28] interesting pod/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 15 19:42:33.134713 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:33.134677 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 15 19:42:34.133787 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:34.133742 2581 patch_prober.go:28] interesting pod/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 15 19:42:34.134114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:34.134080 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 15 19:42:34.621718 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:34.621680 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:35.138284 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:35.138253 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:42:35.139510 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:42:35.139489 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:43:40.346210 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.346163 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w"] Jul 15 19:43:40.346822 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.346481 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" containerID="cri-o://8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0" gracePeriod=30 Jul 15 19:43:40.660682 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.660643 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs"] Jul 15 19:43:40.661166 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.661147 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="34745ed3-80f7-4534-bef8-b2ca728ff382" containerName="istio-proxy" Jul 15 19:43:40.664116 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.664095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.668512 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.668483 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-65a7a336-openshift-default-dockercfg-lvwjj\"" Jul 15 19:43:40.681127 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.681097 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs"] Jul 15 19:43:40.724873 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.724829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-credential-socket\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.724881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slthc\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-kube-api-access-slthc\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.724923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-token\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.724963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-podinfo\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.724992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-certs\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.725014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istiod-ca-cert\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.725040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-socket\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.725144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-data\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.725381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.725181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-envoy\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826064 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-certs\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826064 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istiod-ca-cert\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-socket\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-data\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-envoy\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-credential-socket\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slthc\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-kube-api-access-slthc\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-token\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826702 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-podinfo\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826702 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-certs\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826702 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826584 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-socket\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826853 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-credential-socket\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826892 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-data\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.826952 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.826934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istiod-ca-cert\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.828518 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.828490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-envoy\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.828779 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.828756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-podinfo\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.837903 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.837873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slthc\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-kube-api-access-slthc\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.838967 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.838947 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-token\") pod \"e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:40.976252 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:40.976150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:41.120861 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:41.120832 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs"] Jul 15 19:43:41.124667 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:43:41.124637 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb2d2de_0b5e_4efa_a17b_314f664f9081.slice/crio-3010c0c9a7400885bb5cae17b5318e539ccddd746675f99edf0db19a2db1e7cb WatchSource:0}: Error finding container 3010c0c9a7400885bb5cae17b5318e539ccddd746675f99edf0db19a2db1e7cb: Status 404 returned error can't find the container with id 3010c0c9a7400885bb5cae17b5318e539ccddd746675f99edf0db19a2db1e7cb Jul 15 19:43:41.127141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:41.127031 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:43:41.127141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:41.127116 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:43:41.127327 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:41.127162 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:43:42.045231 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:42.045190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" event={"ID":"bdb2d2de-0b5e-4efa-a17b-314f664f9081","Type":"ContainerStarted","Data":"8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874"} Jul 15 19:43:42.045768 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:42.045676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" event={"ID":"bdb2d2de-0b5e-4efa-a17b-314f664f9081","Type":"ContainerStarted","Data":"3010c0c9a7400885bb5cae17b5318e539ccddd746675f99edf0db19a2db1e7cb"} Jul 15 19:43:42.077983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:42.077926 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" podStartSLOduration=2.0779081 podStartE2EDuration="2.0779081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:43:42.075214851 +0000 UTC m=+1778.219659507" watchObservedRunningTime="2026-07-15 19:43:42.0779081 +0000 UTC m=+1778.222352733" Jul 15 19:43:42.976836 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:42.976796 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:42.981685 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:42.981657 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:43.050285 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:43.050250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:43.051426 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:43.051407 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:45.616159 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.616085 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:43:45.667485 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667452 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-podinfo\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667485 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667491 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-certs\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667518 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-envoy\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667544 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-token\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667564 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952466ef-49ae-4025-8dc8-fa64424b16a9-istiod-ca-cert\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667591 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-socket\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667655 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tcvf\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-kube-api-access-7tcvf\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.667730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667697 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-data\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.668051 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667736 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-credential-socket\") pod \"952466ef-49ae-4025-8dc8-fa64424b16a9\" (UID: \"952466ef-49ae-4025-8dc8-fa64424b16a9\") " Jul 15 19:43:45.668051 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.667790 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:43:45.668150 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.668082 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/952466ef-49ae-4025-8dc8-fa64424b16a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:43:45.668245 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.668224 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.668678 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.668663 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952466ef-49ae-4025-8dc8-fa64424b16a9-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.669283 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.668219 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:43:45.669451 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.668679 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:43:45.669567 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.668746 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:43:45.670259 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.670225 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:43:45.670539 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.670513 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:43:45.670768 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.670743 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-kube-api-access-7tcvf" (OuterVolumeSpecName: "kube-api-access-7tcvf") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "kube-api-access-7tcvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:43:45.671086 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.671067 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "952466ef-49ae-4025-8dc8-fa64424b16a9" (UID: "952466ef-49ae-4025-8dc8-fa64424b16a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:43:45.770443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770410 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.770443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770438 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.770443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770447 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.770443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770455 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.770708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770463 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tcvf\" (UniqueName: \"kubernetes.io/projected/952466ef-49ae-4025-8dc8-fa64424b16a9-kube-api-access-7tcvf\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.770708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770472 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:45.770708 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:45.770480 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952466ef-49ae-4025-8dc8-fa64424b16a9-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:43:46.071193 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.071156 2581 generic.go:356] "Generic (PLEG): container finished" podID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerID="8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0" exitCode=0 Jul 15 19:43:46.071385 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.071212 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" Jul 15 19:43:46.071385 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.071224 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" event={"ID":"952466ef-49ae-4025-8dc8-fa64424b16a9","Type":"ContainerDied","Data":"8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0"} Jul 15 19:43:46.071385 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.071283 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w" event={"ID":"952466ef-49ae-4025-8dc8-fa64424b16a9","Type":"ContainerDied","Data":"d8b4d549a46282e197c023a7ab9a700e90b4ff56d76309733d6501747f42531c"} Jul 15 19:43:46.071385 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.071342 2581 scope.go:117] "RemoveContainer" containerID="8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0" Jul 15 19:43:46.080626 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.080607 2581 scope.go:117] "RemoveContainer" containerID="690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25" Jul 15 19:43:46.088572 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.088552 2581 scope.go:117] "RemoveContainer" containerID="8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0" Jul 15 19:43:46.088833 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:43:46.088813 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0\": container with ID starting with 8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0 not found: ID does not exist" containerID="8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0" Jul 15 19:43:46.088877 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.088843 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0"} err="failed to get container status \"8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0\": rpc error: code = NotFound desc = could not find container \"8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0\": container with ID starting with 8e6a342820e57de7741a5e9767e6347b91abc6e10deec98fe2320fc0f6ff4df0 not found: ID does not exist" Jul 15 19:43:46.088877 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.088861 2581 scope.go:117] "RemoveContainer" containerID="690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25" Jul 15 19:43:46.089098 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:43:46.089079 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25\": container with ID starting with 690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25 not found: ID does not exist" containerID="690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25" Jul 15 19:43:46.089136 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.089105 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25"} err="failed to get container status \"690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25\": rpc error: code = NotFound desc = could not find container \"690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25\": container with ID starting with 690de03df52558b5146312b4ab48eb736dfc06ecca5df28dc78e7f60a16c6d25 not found: ID does not exist" Jul 15 19:43:46.100160 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.100136 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w"] Jul 15 19:43:46.110437 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.110411 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e3a43be3-openshift-default-75b9795f47-6bs7w"] Jul 15 19:43:46.409703 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:46.409674 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" path="/var/lib/kubelet/pods/952466ef-49ae-4025-8dc8-fa64424b16a9/volumes" Jul 15 19:43:52.102858 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:52.102832 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerID="8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874" exitCode=0 Jul 15 19:43:52.103217 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:52.102867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" event={"ID":"bdb2d2de-0b5e-4efa-a17b-314f664f9081","Type":"ContainerDied","Data":"8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874"} Jul 15 19:43:52.103260 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:52.103234 2581 scope.go:117] "RemoveContainer" containerID="8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874" Jul 15 19:43:52.104274 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:52.104241 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:43:52.104376 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:52.104356 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:43:52.104416 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:52.104407 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:43:53.110112 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:53.110079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" event={"ID":"bdb2d2de-0b5e-4efa-a17b-314f664f9081","Type":"ContainerStarted","Data":"d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05"} Jul 15 19:43:53.976976 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:53.976931 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:53.978202 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:53.978175 2581 patch_prober.go:28] interesting pod/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 15 19:43:53.978339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:53.978225 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 15 19:43:54.976982 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:54.976946 2581 patch_prober.go:28] interesting pod/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 15 19:43:54.977424 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:54.977001 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 15 19:43:55.976511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:55.976475 2581 patch_prober.go:28] interesting pod/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 15 19:43:55.976699 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:55.976529 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 15 19:43:56.981552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:56.981523 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:56.981914 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:56.981870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:43:56.982487 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:43:56.982465 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:44:04.453574 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:44:04.453541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:44:04.453574 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:44:04.453556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:44:04.461643 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:44:04.461622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:44:04.461785 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:44:04.461697 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:45:01.597879 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:01.597846 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs"] Jul 15 19:45:01.598396 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:01.598059 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" containerID="cri-o://d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05" gracePeriod=30 Jul 15 19:45:06.873720 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:06.873644 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:45:07.036979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.036938 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istiod-ca-cert\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037016 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-socket\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037049 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-credential-socket\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037108 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-token\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037145 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-data\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037435 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037213 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-podinfo\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037435 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slthc\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-kube-api-access-slthc\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037435 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037411 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:45:07.037582 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037442 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:45:07.037582 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037452 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:45:07.037582 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037279 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-certs\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037582 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037574 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-envoy\") pod \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\" (UID: \"bdb2d2de-0b5e-4efa-a17b-314f664f9081\") " Jul 15 19:45:07.037783 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037687 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:45:07.037931 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037913 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.038000 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037937 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.038000 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037949 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.038000 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.037962 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.038264 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.038235 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:45:07.039702 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.039674 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:45:07.040022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.039998 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:45:07.040089 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.040016 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:45:07.040089 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.040004 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-kube-api-access-slthc" (OuterVolumeSpecName: "kube-api-access-slthc") pod "bdb2d2de-0b5e-4efa-a17b-314f664f9081" (UID: "bdb2d2de-0b5e-4efa-a17b-314f664f9081"). InnerVolumeSpecName "kube-api-access-slthc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:45:07.139090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.139004 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.139090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.139033 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.139090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.139042 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.139090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.139051 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slthc\" (UniqueName: \"kubernetes.io/projected/bdb2d2de-0b5e-4efa-a17b-314f664f9081-kube-api-access-slthc\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.139090 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.139059 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb2d2de-0b5e-4efa-a17b-314f664f9081-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:45:07.482806 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.482773 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerID="d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05" exitCode=0 Jul 15 19:45:07.482983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.482823 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" Jul 15 19:45:07.482983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.482836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" event={"ID":"bdb2d2de-0b5e-4efa-a17b-314f664f9081","Type":"ContainerDied","Data":"d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05"} Jul 15 19:45:07.482983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.482880 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs" event={"ID":"bdb2d2de-0b5e-4efa-a17b-314f664f9081","Type":"ContainerDied","Data":"3010c0c9a7400885bb5cae17b5318e539ccddd746675f99edf0db19a2db1e7cb"} Jul 15 19:45:07.482983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.482904 2581 scope.go:117] "RemoveContainer" containerID="d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05" Jul 15 19:45:07.493165 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.493143 2581 scope.go:117] "RemoveContainer" containerID="8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874" Jul 15 19:45:07.501541 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.501520 2581 scope.go:117] "RemoveContainer" containerID="d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05" Jul 15 19:45:07.501827 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:45:07.501805 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05\": container with ID starting with d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05 not found: ID does not exist" containerID="d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05" Jul 15 19:45:07.501886 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.501839 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05"} err="failed to get container status \"d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05\": rpc error: code = NotFound desc = could not find container \"d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05\": container with ID starting with d07f89abe1be4c26d61c0e358b6fbf9a16af965f726f979e06ecad4256d27c05 not found: ID does not exist" Jul 15 19:45:07.501886 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.501861 2581 scope.go:117] "RemoveContainer" containerID="8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874" Jul 15 19:45:07.502109 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:45:07.502088 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874\": container with ID starting with 8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874 not found: ID does not exist" containerID="8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874" Jul 15 19:45:07.502201 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.502114 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874"} err="failed to get container status \"8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874\": rpc error: code = NotFound desc = could not find container \"8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874\": container with ID starting with 8203efad9ba090ccfb4612436fc05d9156e2b3b7622eb45b9357b58565bc4874 not found: ID does not exist" Jul 15 19:45:07.509659 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.509628 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs"] Jul 15 19:45:07.512159 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:07.512134 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-65a7a336-openshift-default-5c4647dc8c-mm4qs"] Jul 15 19:45:08.409928 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:45:08.409895 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" path="/var/lib/kubelet/pods/bdb2d2de-0b5e-4efa-a17b-314f664f9081/volumes" Jul 15 19:46:41.646203 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646167 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk"] Jul 15 19:46:41.646832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646744 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" Jul 15 19:46:41.646832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646765 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" Jul 15 19:46:41.646832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646798 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" Jul 15 19:46:41.646832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646807 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" Jul 15 19:46:41.646832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646821 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" Jul 15 19:46:41.646832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646831 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" Jul 15 19:46:41.647137 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646843 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" Jul 15 19:46:41.647137 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646851 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" Jul 15 19:46:41.647137 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646951 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" Jul 15 19:46:41.647137 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646963 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" Jul 15 19:46:41.647137 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.646974 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="952466ef-49ae-4025-8dc8-fa64424b16a9" containerName="istio-proxy" Jul 15 19:46:41.650189 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.650169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.652827 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.652805 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3b5f1eb0-openshift-default-dockercfg-kdltb\"" Jul 15 19:46:41.671197 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.671169 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk"] Jul 15 19:46:41.724263 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2tt8\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-kube-api-access-x2tt8\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724468 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-credential-socket\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724468 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-envoy\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724468 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71773b72-5e71-43a1-85da-9a8e4d84740e-istiod-ca-cert\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724590 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-token\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724590 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-certs\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724670 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-socket\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724670 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-data\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.724670 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.724649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-podinfo\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825280 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-token\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-certs\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-socket\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-data\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-podinfo\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tt8\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-kube-api-access-x2tt8\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-credential-socket\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825813 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-envoy\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825813 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71773b72-5e71-43a1-85da-9a8e4d84740e-istiod-ca-cert\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825813 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-certs\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-socket\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.825972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.825901 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-data\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.826079 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.826033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-credential-socket\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.826242 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.826222 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71773b72-5e71-43a1-85da-9a8e4d84740e-istiod-ca-cert\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.827913 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.827881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-envoy\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.828223 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.828204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-podinfo\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.835734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.835703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2tt8\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-kube-api-access-x2tt8\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.835884 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.835843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-token\") pod \"e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:41.961025 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:41.960993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:42.104965 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.104934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk"] Jul 15 19:46:42.106812 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:46:42.106784 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71773b72_5e71_43a1_85da_9a8e4d84740e.slice/crio-ed4aa2e48abffb3bce2a868259e70f91304ff83f96d85740448bab6fc4b85443 WatchSource:0}: Error finding container ed4aa2e48abffb3bce2a868259e70f91304ff83f96d85740448bab6fc4b85443: Status 404 returned error can't find the container with id ed4aa2e48abffb3bce2a868259e70f91304ff83f96d85740448bab6fc4b85443 Jul 15 19:46:42.109014 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.108974 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:46:42.109116 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.109042 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:46:42.109116 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.109078 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:46:42.945945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.945908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" event={"ID":"71773b72-5e71-43a1-85da-9a8e4d84740e","Type":"ContainerStarted","Data":"ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115"} Jul 15 19:46:42.946395 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.945974 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" event={"ID":"71773b72-5e71-43a1-85da-9a8e4d84740e","Type":"ContainerStarted","Data":"ed4aa2e48abffb3bce2a868259e70f91304ff83f96d85740448bab6fc4b85443"} Jul 15 19:46:42.962093 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.962059 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:42.968301 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:42.968247 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" podStartSLOduration=1.96823208 podStartE2EDuration="1.96823208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:42.967783104 +0000 UTC m=+1959.112227750" watchObservedRunningTime="2026-07-15 19:46:42.96823208 +0000 UTC m=+1959.112676788" Jul 15 19:46:43.967480 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:43.967442 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:44.955367 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:44.955326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:44.956546 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:44.956519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:46:59.023532 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.023498 2581 generic.go:356] "Generic (PLEG): container finished" podID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerID="ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115" exitCode=0 Jul 15 19:46:59.023954 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.023571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" event={"ID":"71773b72-5e71-43a1-85da-9a8e4d84740e","Type":"ContainerDied","Data":"ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115"} Jul 15 19:46:59.023996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.023957 2581 scope.go:117] "RemoveContainer" containerID="ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115" Jul 15 19:46:59.024945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.024917 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:46:59.024993 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.024982 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:46:59.025027 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.025017 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:46:59.956151 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:46:59.956110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:00.030506 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:00.030474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" event={"ID":"71773b72-5e71-43a1-85da-9a8e4d84740e","Type":"ContainerStarted","Data":"d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e"} Jul 15 19:47:00.961514 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:00.961477 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:00.962236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:00.962206 2581 patch_prober.go:28] interesting pod/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 19:47:00.962379 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:00.962283 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 19:47:01.961404 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:01.961364 2581 patch_prober.go:28] interesting pod/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 19:47:01.961790 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:01.961424 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 19:47:02.961705 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:02.961665 2581 patch_prober.go:28] interesting pod/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 19:47:02.962107 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:02.961725 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 19:47:03.962268 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:03.962228 2581 patch_prober.go:28] interesting pod/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 15 19:47:03.962695 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:03.962316 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 15 19:47:04.965242 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:04.965209 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:04.965672 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:04.965510 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:04.966254 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:04.966236 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:23.277487 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:23.277447 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk"] Jul 15 19:47:23.278073 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:23.277745 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" containerID="cri-o://d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e" gracePeriod=30 Jul 15 19:47:28.524451 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.524423 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:28.578614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578524 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-data\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578567 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-envoy\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578595 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2tt8\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-kube-api-access-x2tt8\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578615 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-credential-socket\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578645 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-certs\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578702 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-podinfo\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578751 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71773b72-5e71-43a1-85da-9a8e4d84740e-istiod-ca-cert\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578805 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-socket\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.578921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578838 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-token\") pod \"71773b72-5e71-43a1-85da-9a8e4d84740e\" (UID: \"71773b72-5e71-43a1-85da-9a8e4d84740e\") " Jul 15 19:47:28.579189 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.578998 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:47:28.579189 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.579145 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.579709 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.579364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:47:28.579709 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.579400 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71773b72-5e71-43a1-85da-9a8e4d84740e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:47:28.579709 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.579467 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-data" (OuterVolumeSpecName: "istio-data") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:47:28.579709 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.579569 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:47:28.581005 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.580971 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-kube-api-access-x2tt8" (OuterVolumeSpecName: "kube-api-access-x2tt8") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "kube-api-access-x2tt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:47:28.581104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.581075 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:47:28.581184 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.581170 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:47:28.587807 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.581392 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-token" (OuterVolumeSpecName: "istio-token") pod "71773b72-5e71-43a1-85da-9a8e4d84740e" (UID: "71773b72-5e71-43a1-85da-9a8e4d84740e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:47:28.679872 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679833 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.679872 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679864 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.679872 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679874 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2tt8\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-kube-api-access-x2tt8\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.679872 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679884 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.680142 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679893 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.680142 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679901 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71773b72-5e71-43a1-85da-9a8e4d84740e-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.680142 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679908 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71773b72-5e71-43a1-85da-9a8e4d84740e-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:28.680142 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:28.679915 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71773b72-5e71-43a1-85da-9a8e4d84740e-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:47:29.185050 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.185013 2581 generic.go:356] "Generic (PLEG): container finished" podID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerID="d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e" exitCode=0 Jul 15 19:47:29.185267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.185084 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" Jul 15 19:47:29.185267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.185105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" event={"ID":"71773b72-5e71-43a1-85da-9a8e4d84740e","Type":"ContainerDied","Data":"d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e"} Jul 15 19:47:29.185267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.185206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk" event={"ID":"71773b72-5e71-43a1-85da-9a8e4d84740e","Type":"ContainerDied","Data":"ed4aa2e48abffb3bce2a868259e70f91304ff83f96d85740448bab6fc4b85443"} Jul 15 19:47:29.185267 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.185238 2581 scope.go:117] "RemoveContainer" containerID="d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e" Jul 15 19:47:29.194987 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.194968 2581 scope.go:117] "RemoveContainer" containerID="ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115" Jul 15 19:47:29.203609 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.203589 2581 scope.go:117] "RemoveContainer" containerID="d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e" Jul 15 19:47:29.203871 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:47:29.203852 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e\": container with ID starting with d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e not found: ID does not exist" containerID="d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e" Jul 15 19:47:29.203928 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.203882 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e"} err="failed to get container status \"d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e\": rpc error: code = NotFound desc = could not find container \"d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e\": container with ID starting with d77c559c94e6c32593a4557d51b6fa6f414ae31ad2db6451bb5b9525795d5c2e not found: ID does not exist" Jul 15 19:47:29.203928 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.203900 2581 scope.go:117] "RemoveContainer" containerID="ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115" Jul 15 19:47:29.204126 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:47:29.204109 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115\": container with ID starting with ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115 not found: ID does not exist" containerID="ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115" Jul 15 19:47:29.204171 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.204130 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115"} err="failed to get container status \"ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115\": rpc error: code = NotFound desc = could not find container \"ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115\": container with ID starting with ef963b9ceab1bfa889033efe9d180bf361d98285e4cb7c9e544c5bdc14531115 not found: ID does not exist" Jul 15 19:47:29.209232 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.209209 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk"] Jul 15 19:47:29.217362 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:29.217339 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3b5f1eb0-openshift-default-7c88d6cc5f-5j4hk"] Jul 15 19:47:30.409718 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:30.409689 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" path="/var/lib/kubelet/pods/71773b72-5e71-43a1-85da-9a8e4d84740e/volumes" Jul 15 19:47:44.917135 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917096 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd"] Jul 15 19:47:44.917559 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917534 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" Jul 15 19:47:44.917559 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917548 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" Jul 15 19:47:44.917644 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917570 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" Jul 15 19:47:44.917644 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917576 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" Jul 15 19:47:44.917644 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917639 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" Jul 15 19:47:44.917734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917646 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb2d2de-0b5e-4efa-a17b-314f664f9081" containerName="istio-proxy" Jul 15 19:47:44.917734 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.917654 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71773b72-5e71-43a1-85da-9a8e4d84740e" containerName="istio-proxy" Jul 15 19:47:44.920581 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.920561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:44.924161 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.924137 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-73d57350-openshift-default-dockercfg-v4lxq\"" Jul 15 19:47:44.952882 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:44.952837 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd"] Jul 15 19:47:45.036123 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-credential-socket\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-socket\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d068bc1e-7433-46b8-be69-472d1aea224f-istiod-ca-cert\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-certs\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-data\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgqlv\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-kube-api-access-vgqlv\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036635 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-envoy\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036635 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d068bc1e-7433-46b8-be69-472d1aea224f-istio-podinfo\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.036635 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.036456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-istio-token\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137612 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-envoy\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137612 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d068bc1e-7433-46b8-be69-472d1aea224f-istio-podinfo\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-istio-token\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-credential-socket\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-socket\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d068bc1e-7433-46b8-be69-472d1aea224f-istiod-ca-cert\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.137865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.137760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-certs\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138137 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-data\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138195 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-socket\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138195 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgqlv\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-kube-api-access-vgqlv\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138319 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138255 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-credential-socket\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138483 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138460 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-data\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138555 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-certs\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.138878 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.138857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d068bc1e-7433-46b8-be69-472d1aea224f-istiod-ca-cert\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.140146 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.140121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-envoy\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.140690 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.140668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d068bc1e-7433-46b8-be69-472d1aea224f-istio-podinfo\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.153310 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.153253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-istio-token\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.154195 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.154172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgqlv\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-kube-api-access-vgqlv\") pod \"e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.231878 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.231782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:45.396607 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.396575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd"] Jul 15 19:47:45.400686 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:47:45.400643 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd068bc1e_7433_46b8_be69_472d1aea224f.slice/crio-9ad39cb53f70d00874eb7f59ce1c4a194aa32aa25e58b4dc2f25ec233777211d WatchSource:0}: Error finding container 9ad39cb53f70d00874eb7f59ce1c4a194aa32aa25e58b4dc2f25ec233777211d: Status 404 returned error can't find the container with id 9ad39cb53f70d00874eb7f59ce1c4a194aa32aa25e58b4dc2f25ec233777211d Jul 15 19:47:45.402714 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.402681 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:47:45.402803 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.402746 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:47:45.402803 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:45.402779 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:47:46.277004 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:46.276959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" event={"ID":"d068bc1e-7433-46b8-be69-472d1aea224f","Type":"ContainerStarted","Data":"a32169d1b64f43c8a4a9fc582a9245017550c5071a3e33002c443ed03847842d"} Jul 15 19:47:46.277439 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:46.277061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" event={"ID":"d068bc1e-7433-46b8-be69-472d1aea224f","Type":"ContainerStarted","Data":"9ad39cb53f70d00874eb7f59ce1c4a194aa32aa25e58b4dc2f25ec233777211d"} Jul 15 19:47:46.303556 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:46.303492 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podStartSLOduration=2.303469574 podStartE2EDuration="2.303469574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:46.302537537 +0000 UTC m=+2022.446982170" watchObservedRunningTime="2026-07-15 19:47:46.303469574 +0000 UTC m=+2022.447914210" Jul 15 19:47:47.232321 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:47.232268 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:47.238425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:47.238395 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:47.282559 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:47.282526 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:47:47.283782 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:47:47.283763 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:48:03.324511 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:03.324465 2581 patch_prober.go:28] interesting pod/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 19:48:03.324968 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:03.324542 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 19:48:04.379478 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:04.379446 2581 generic.go:356] "Generic (PLEG): container finished" podID="d068bc1e-7433-46b8-be69-472d1aea224f" containerID="a32169d1b64f43c8a4a9fc582a9245017550c5071a3e33002c443ed03847842d" exitCode=0 Jul 15 19:48:04.379952 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:04.379517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" event={"ID":"d068bc1e-7433-46b8-be69-472d1aea224f","Type":"ContainerDied","Data":"a32169d1b64f43c8a4a9fc582a9245017550c5071a3e33002c443ed03847842d"} Jul 15 19:48:04.379952 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:04.379947 2581 scope.go:117] "RemoveContainer" containerID="a32169d1b64f43c8a4a9fc582a9245017550c5071a3e33002c443ed03847842d" Jul 15 19:48:04.380985 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:04.380956 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:48:04.381088 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:04.381036 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:48:04.381154 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:04.381083 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:48:05.386204 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:05.386167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" event={"ID":"d068bc1e-7433-46b8-be69-472d1aea224f","Type":"ContainerStarted","Data":"4727496a3b530edcaef3ddc95464d0a6e36f5fc6dbe7b1385f609b1020f14694"} Jul 15 19:48:06.232177 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:06.232135 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:48:06.232466 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:06.232428 2581 patch_prober.go:28] interesting pod/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 15 19:48:06.232707 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:06.232676 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 15 19:48:07.232762 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:07.232720 2581 patch_prober.go:28] interesting pod/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 15 19:48:07.233387 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:07.233350 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 15 19:48:08.232681 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:08.232642 2581 patch_prober.go:28] interesting pod/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 15 19:48:08.232995 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:08.232962 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 15 19:48:09.232993 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:09.232953 2581 patch_prober.go:28] interesting pod/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 15 19:48:09.233396 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:09.233035 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 15 19:48:10.236337 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:10.236306 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:48:10.236816 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:10.236586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:48:10.237360 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:48:10.237343 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:49:04.482222 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:49:04.482190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:49:04.484132 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:49:04.484108 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:49:04.490437 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:49:04.490417 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:49:04.492499 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:49:04.492483 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:50:14.889156 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:14.889076 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd"] Jul 15 19:50:14.889648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:14.889353 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" containerID="cri-o://4727496a3b530edcaef3ddc95464d0a6e36f5fc6dbe7b1385f609b1020f14694" gracePeriod=30 Jul 15 19:50:20.070106 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.070064 2581 generic.go:356] "Generic (PLEG): container finished" podID="d068bc1e-7433-46b8-be69-472d1aea224f" containerID="4727496a3b530edcaef3ddc95464d0a6e36f5fc6dbe7b1385f609b1020f14694" exitCode=0 Jul 15 19:50:20.070561 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.070238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" event={"ID":"d068bc1e-7433-46b8-be69-472d1aea224f","Type":"ContainerDied","Data":"4727496a3b530edcaef3ddc95464d0a6e36f5fc6dbe7b1385f609b1020f14694"} Jul 15 19:50:20.070561 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.070327 2581 scope.go:117] "RemoveContainer" containerID="a32169d1b64f43c8a4a9fc582a9245017550c5071a3e33002c443ed03847842d" Jul 15 19:50:20.155638 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.155559 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:50:20.219563 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219534 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-istio-token\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219749 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219635 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-envoy\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219749 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219661 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d068bc1e-7433-46b8-be69-472d1aea224f-istio-podinfo\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219749 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219707 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-certs\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219749 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219737 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgqlv\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-kube-api-access-vgqlv\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219807 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-socket\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219834 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d068bc1e-7433-46b8-be69-472d1aea224f-istiod-ca-cert\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219878 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-credential-socket\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.219979 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.219903 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-data\") pod \"d068bc1e-7433-46b8-be69-472d1aea224f\" (UID: \"d068bc1e-7433-46b8-be69-472d1aea224f\") " Jul 15 19:50:20.220922 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.220840 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:50:20.220922 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.220859 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d068bc1e-7433-46b8-be69-472d1aea224f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:50:20.223669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.223614 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:50:20.223806 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.223698 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:50:20.223878 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.223845 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d068bc1e-7433-46b8-be69-472d1aea224f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:50:20.224564 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.224540 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:50:20.227461 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.227431 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:50:20.237967 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.237445 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-kube-api-access-vgqlv" (OuterVolumeSpecName: "kube-api-access-vgqlv") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "kube-api-access-vgqlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:50:20.239956 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.239915 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d068bc1e-7433-46b8-be69-472d1aea224f" (UID: "d068bc1e-7433-46b8-be69-472d1aea224f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:50:20.321903 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321872 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.321903 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321901 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.321903 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321913 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d068bc1e-7433-46b8-be69-472d1aea224f-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.322141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321921 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.322141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321931 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgqlv\" (UniqueName: \"kubernetes.io/projected/d068bc1e-7433-46b8-be69-472d1aea224f-kube-api-access-vgqlv\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.322141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321940 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.322141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321948 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d068bc1e-7433-46b8-be69-472d1aea224f-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.322141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321956 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:20.322141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:20.321964 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d068bc1e-7433-46b8-be69-472d1aea224f-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:50:21.075970 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:21.075938 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" Jul 15 19:50:21.076471 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:21.075980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd" event={"ID":"d068bc1e-7433-46b8-be69-472d1aea224f","Type":"ContainerDied","Data":"9ad39cb53f70d00874eb7f59ce1c4a194aa32aa25e58b4dc2f25ec233777211d"} Jul 15 19:50:21.076471 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:21.076057 2581 scope.go:117] "RemoveContainer" containerID="4727496a3b530edcaef3ddc95464d0a6e36f5fc6dbe7b1385f609b1020f14694" Jul 15 19:50:21.177138 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:21.177047 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd"] Jul 15 19:50:21.179276 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:21.179245 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-73d57350-openshift-default-6d84f46787-2fbqd"] Jul 15 19:50:22.410778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:50:22.410741 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" path="/var/lib/kubelet/pods/d068bc1e-7433-46b8-be69-472d1aea224f/volumes" Jul 15 19:51:17.440546 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.440506 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm"] Jul 15 19:51:17.441121 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.441100 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" Jul 15 19:51:17.441205 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.441125 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" Jul 15 19:51:17.441205 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.441150 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" Jul 15 19:51:17.441205 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.441159 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" Jul 15 19:51:17.441382 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.441272 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" Jul 15 19:51:17.441382 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.441321 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d068bc1e-7433-46b8-be69-472d1aea224f" containerName="istio-proxy" Jul 15 19:51:17.444277 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.444255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.448795 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.448777 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9130b1-openshift-default-dockercfg-m9f9w\"" Jul 15 19:51:17.463022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.462997 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm"] Jul 15 19:51:17.538907 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.538864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-envoy\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539126 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.538937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b157155e-5b12-4181-a859-1dcf87fce36c-istiod-ca-cert\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539126 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-credential-socket\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539126 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8nwd\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-kube-api-access-c8nwd\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-istio-token\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b157155e-5b12-4181-a859-1dcf87fce36c-istio-podinfo\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-certs\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-data\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.539345 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.539278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-socket\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.641860 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.641819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b157155e-5b12-4181-a859-1dcf87fce36c-istiod-ca-cert\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642067 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.641899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-credential-socket\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642067 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.641934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8nwd\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-kube-api-access-c8nwd\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642067 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.641972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-istio-token\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642067 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.642006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b157155e-5b12-4181-a859-1dcf87fce36c-istio-podinfo\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642269 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.642076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-certs\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642269 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.642102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-data\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642269 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.642138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-socket\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.642269 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.642216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-envoy\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.645151 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.645116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-envoy\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.645812 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.645786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b157155e-5b12-4181-a859-1dcf87fce36c-istiod-ca-cert\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.646069 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.646046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-credential-socket\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.647829 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.647795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-socket\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.647957 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.647863 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-certs\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.648389 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.648363 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-data\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.649602 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.649581 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b157155e-5b12-4181-a859-1dcf87fce36c-istio-podinfo\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.657081 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.657044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-istio-token\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.657749 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.657727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8nwd\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-kube-api-access-c8nwd\") pod \"e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.754883 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.754789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:17.904182 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.904153 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm"] Jul 15 19:51:17.905662 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:51:17.905638 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb157155e_5b12_4181_a859_1dcf87fce36c.slice/crio-fb87f2267e66cd2360c761d5b3a30cc1e0917aca0d26fc94c0a8c3c0c2ee70a6 WatchSource:0}: Error finding container fb87f2267e66cd2360c761d5b3a30cc1e0917aca0d26fc94c0a8c3c0c2ee70a6: Status 404 returned error can't find the container with id fb87f2267e66cd2360c761d5b3a30cc1e0917aca0d26fc94c0a8c3c0c2ee70a6 Jul 15 19:51:17.907706 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.907666 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:17.907800 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.907735 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:17.907800 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:17.907764 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:18.364484 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:18.364452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" event={"ID":"b157155e-5b12-4181-a859-1dcf87fce36c","Type":"ContainerStarted","Data":"3a0cc4a4f685d614e9e1fcce563a67b111a8be82b1f31966424f44bf3ee19949"} Jul 15 19:51:18.364686 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:18.364515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" event={"ID":"b157155e-5b12-4181-a859-1dcf87fce36c","Type":"ContainerStarted","Data":"fb87f2267e66cd2360c761d5b3a30cc1e0917aca0d26fc94c0a8c3c0c2ee70a6"} Jul 15 19:51:18.403908 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:18.403846 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podStartSLOduration=1.403825505 podStartE2EDuration="1.403825505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:51:18.403397372 +0000 UTC m=+2234.547842004" watchObservedRunningTime="2026-07-15 19:51:18.403825505 +0000 UTC m=+2234.548270139" Jul 15 19:51:18.756015 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:18.755975 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:18.757468 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:18.757440 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 15 19:51:18.757588 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:18.757488 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 15 19:51:19.759740 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:19.759708 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:20.377967 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:20.377931 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:20.378813 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:20.378793 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:25.760982 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.760947 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8"] Jul 15 19:51:25.764786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.764769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.770364 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.770341 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2908a6-openshift-default-dockercfg-46rhg\"" Jul 15 19:51:25.783654 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.783626 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8"] Jul 15 19:51:25.810869 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.810834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-certs\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811055 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.810880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spl69\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-kube-api-access-spl69\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811055 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.810943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-envoy\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811055 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.810993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-istio-token\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811336 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.811116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-socket\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811336 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.811198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73591176-a96e-4499-bec7-54830d6a2a9e-istio-podinfo\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811336 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.811241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-credential-socket\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811336 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.811285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73591176-a96e-4499-bec7-54830d6a2a9e-istiod-ca-cert\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.811336 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.811328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-data\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-certs\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912661 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spl69\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-kube-api-access-spl69\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-envoy\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-istio-token\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-socket\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73591176-a96e-4499-bec7-54830d6a2a9e-istio-podinfo\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-credential-socket\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73591176-a96e-4499-bec7-54830d6a2a9e-istiod-ca-cert\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.912926 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.912861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-data\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.913279 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.913104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-certs\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.913279 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.913134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-socket\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.913413 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.913332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-credential-socket\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.913413 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.913336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-data\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.913778 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.913756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73591176-a96e-4499-bec7-54830d6a2a9e-istiod-ca-cert\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.915171 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.915145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-envoy\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.915304 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.915274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73591176-a96e-4499-bec7-54830d6a2a9e-istio-podinfo\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.923787 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.923761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-istio-token\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:25.924844 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:25.924822 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spl69\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-kube-api-access-spl69\") pod \"e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:26.075628 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.075544 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:26.224443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.224415 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8"] Jul 15 19:51:26.226428 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:51:26.226400 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73591176_a96e_4499_bec7_54830d6a2a9e.slice/crio-b2ce32169e034d9a245770da28933ac6910b407c3d53624af83ae8a700607f95 WatchSource:0}: Error finding container b2ce32169e034d9a245770da28933ac6910b407c3d53624af83ae8a700607f95: Status 404 returned error can't find the container with id b2ce32169e034d9a245770da28933ac6910b407c3d53624af83ae8a700607f95 Jul 15 19:51:26.228536 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.228506 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:26.228598 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.228570 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:26.228640 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.228597 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:26.412038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.411998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" event={"ID":"73591176-a96e-4499-bec7-54830d6a2a9e","Type":"ContainerStarted","Data":"1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063"} Jul 15 19:51:26.412209 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.412056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" event={"ID":"73591176-a96e-4499-bec7-54830d6a2a9e","Type":"ContainerStarted","Data":"b2ce32169e034d9a245770da28933ac6910b407c3d53624af83ae8a700607f95"} Jul 15 19:51:26.436921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:26.436865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" podStartSLOduration=1.436844286 podStartE2EDuration="1.436844286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:51:26.435718225 +0000 UTC m=+2242.580162860" watchObservedRunningTime="2026-07-15 19:51:26.436844286 +0000 UTC m=+2242.581288920" Jul 15 19:51:27.076712 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:27.076676 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:27.082102 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:27.082073 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:27.417356 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:27.417328 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:27.418237 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:27.418222 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:36.420460 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:36.420414 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 19:51:36.420874 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:36.420476 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 19:51:37.478701 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:37.478667 2581 generic.go:356] "Generic (PLEG): container finished" podID="b157155e-5b12-4181-a859-1dcf87fce36c" containerID="3a0cc4a4f685d614e9e1fcce563a67b111a8be82b1f31966424f44bf3ee19949" exitCode=0 Jul 15 19:51:37.479249 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:37.478725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" event={"ID":"b157155e-5b12-4181-a859-1dcf87fce36c","Type":"ContainerDied","Data":"3a0cc4a4f685d614e9e1fcce563a67b111a8be82b1f31966424f44bf3ee19949"} Jul 15 19:51:37.479347 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:37.479259 2581 scope.go:117] "RemoveContainer" containerID="3a0cc4a4f685d614e9e1fcce563a67b111a8be82b1f31966424f44bf3ee19949" Jul 15 19:51:37.480381 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:37.480350 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:37.480478 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:37.480420 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:37.480478 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:37.480470 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:38.487308 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:38.487246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" event={"ID":"b157155e-5b12-4181-a859-1dcf87fce36c","Type":"ContainerStarted","Data":"aae5d646c35a64fe046ae608e2478172005d56beaecad0686ef1b8c9dfd507b9"} Jul 15 19:51:38.755647 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:38.755542 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:38.755835 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:38.755675 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 15 19:51:38.755835 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:38.755717 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 15 19:51:39.755567 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:39.755527 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 15 19:51:39.756173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:39.756140 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 15 19:51:40.755738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:40.755693 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 15 19:51:40.756249 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:40.755782 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 15 19:51:41.755476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:41.755434 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 15 19:51:41.755770 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:41.755743 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 15 19:51:42.756401 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:42.756230 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 15 19:51:42.756401 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:42.756334 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 15 19:51:43.759470 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:43.759434 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:43.759910 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:43.759823 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:43.760552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:43.760538 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:51:46.528112 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:46.528075 2581 generic.go:356] "Generic (PLEG): container finished" podID="73591176-a96e-4499-bec7-54830d6a2a9e" containerID="1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063" exitCode=0 Jul 15 19:51:46.528569 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:46.528164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" event={"ID":"73591176-a96e-4499-bec7-54830d6a2a9e","Type":"ContainerDied","Data":"1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063"} Jul 15 19:51:46.528614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:46.528594 2581 scope.go:117] "RemoveContainer" containerID="1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063" Jul 15 19:51:46.529750 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:46.529719 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:46.529856 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:46.529830 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:46.529920 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:46.529880 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:51:47.538015 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:47.537968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" event={"ID":"73591176-a96e-4499-bec7-54830d6a2a9e","Type":"ContainerStarted","Data":"962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc"} Jul 15 19:51:48.076324 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:48.076273 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:48.076539 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:48.076516 2581 patch_prober.go:28] interesting pod/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 19:51:48.076596 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:48.076577 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 19:51:49.076828 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:49.076792 2581 patch_prober.go:28] interesting pod/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 19:51:49.077207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:49.076853 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 19:51:50.076892 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:50.076856 2581 patch_prober.go:28] interesting pod/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 19:51:50.077313 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:50.076917 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 19:51:51.076142 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:51.076100 2581 patch_prober.go:28] interesting pod/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 15 19:51:51.076339 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:51.076167 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 15 19:51:52.079223 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:52.079197 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:52.079609 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:52.079513 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:51:52.080088 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:51:52.080068 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:53:29.926768 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:29.926689 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm"] Jul 15 19:53:29.927279 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:29.926903 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" containerID="cri-o://aae5d646c35a64fe046ae608e2478172005d56beaecad0686ef1b8c9dfd507b9" gracePeriod=30 Jul 15 19:53:35.094326 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.094268 2581 generic.go:356] "Generic (PLEG): container finished" podID="b157155e-5b12-4181-a859-1dcf87fce36c" containerID="aae5d646c35a64fe046ae608e2478172005d56beaecad0686ef1b8c9dfd507b9" exitCode=0 Jul 15 19:53:35.094759 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.094346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" event={"ID":"b157155e-5b12-4181-a859-1dcf87fce36c","Type":"ContainerDied","Data":"aae5d646c35a64fe046ae608e2478172005d56beaecad0686ef1b8c9dfd507b9"} Jul 15 19:53:35.094759 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.094426 2581 scope.go:117] "RemoveContainer" containerID="3a0cc4a4f685d614e9e1fcce563a67b111a8be82b1f31966424f44bf3ee19949" Jul 15 19:53:35.186947 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.186920 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:53:35.278363 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278225 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-credential-socket\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278548 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278371 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-istio-token\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278548 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278422 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b157155e-5b12-4181-a859-1dcf87fce36c-istiod-ca-cert\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278548 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278448 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-envoy\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278727 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278580 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b157155e-5b12-4181-a859-1dcf87fce36c-istio-podinfo\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278727 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278637 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-certs\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278727 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278665 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-socket\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278727 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278580 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:53:35.278727 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278697 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8nwd\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-kube-api-access-c8nwd\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278760 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-data\") pod \"b157155e-5b12-4181-a859-1dcf87fce36c\" (UID: \"b157155e-5b12-4181-a859-1dcf87fce36c\") " Jul 15 19:53:35.278983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278782 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b157155e-5b12-4181-a859-1dcf87fce36c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:53:35.278983 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.278943 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:53:35.279140 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.279049 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:53:35.279198 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.279153 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b157155e-5b12-4181-a859-1dcf87fce36c-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.279198 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.279173 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.279198 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.279187 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.279379 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.279200 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.279935 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.279905 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:53:35.280646 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.280629 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:53:35.280863 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.280849 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-kube-api-access-c8nwd" (OuterVolumeSpecName: "kube-api-access-c8nwd") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "kube-api-access-c8nwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:53:35.281084 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.281062 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:53:35.281084 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.281070 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b157155e-5b12-4181-a859-1dcf87fce36c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b157155e-5b12-4181-a859-1dcf87fce36c" (UID: "b157155e-5b12-4181-a859-1dcf87fce36c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:53:35.380621 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.380589 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.380621 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.380617 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.380823 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.380634 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b157155e-5b12-4181-a859-1dcf87fce36c-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.380823 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.380643 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b157155e-5b12-4181-a859-1dcf87fce36c-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:35.380823 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:35.380655 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8nwd\" (UniqueName: \"kubernetes.io/projected/b157155e-5b12-4181-a859-1dcf87fce36c-kube-api-access-c8nwd\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:53:36.100423 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:36.100395 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" Jul 15 19:53:36.100886 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:36.100426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm" event={"ID":"b157155e-5b12-4181-a859-1dcf87fce36c","Type":"ContainerDied","Data":"fb87f2267e66cd2360c761d5b3a30cc1e0917aca0d26fc94c0a8c3c0c2ee70a6"} Jul 15 19:53:36.100886 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:36.100482 2581 scope.go:117] "RemoveContainer" containerID="aae5d646c35a64fe046ae608e2478172005d56beaecad0686ef1b8c9dfd507b9" Jul 15 19:53:36.127552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:36.127525 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm"] Jul 15 19:53:36.133815 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:36.133791 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9130b1-openshift-default-66dc8d8c7c-pd9dm"] Jul 15 19:53:36.411003 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:36.410972 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" path="/var/lib/kubelet/pods/b157155e-5b12-4181-a859-1dcf87fce36c/volumes" Jul 15 19:53:56.349303 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:56.349251 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8"] Jul 15 19:53:56.349768 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:56.349565 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" containerID="cri-o://962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc" gracePeriod=30 Jul 15 19:53:57.382730 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.382694 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4"] Jul 15 19:53:57.383274 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.383253 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" Jul 15 19:53:57.383388 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.383277 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" Jul 15 19:53:57.383388 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.383339 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" Jul 15 19:53:57.383388 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.383349 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" Jul 15 19:53:57.383552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.383477 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" Jul 15 19:53:57.383552 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.383494 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b157155e-5b12-4181-a859-1dcf87fce36c" containerName="istio-proxy" Jul 15 19:53:57.386651 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.386630 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.400581 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:53:57.400551 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.404305 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:53:57.400573 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-api-a-ee1301-openshift-default-dockercfg-79526\" is forbidden: User \"system:node:ip-10-0-139-42.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-42.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ee1301-openshift-default-dockercfg-79526\"" type="*v1.Secret" Jul 15 19:53:57.411483 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.411453 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4"] Jul 15 19:53:57.491127 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-podinfo\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-envoy\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491179 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-credential-socket\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-data\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-socket\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-certs\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491626 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istiod-ca-cert\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491626 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491467 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-token\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.491626 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.491509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6l79\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-kube-api-access-c6l79\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.592728 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-token\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.592728 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6l79\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-kube-api-access-c6l79\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.592953 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-podinfo\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.592953 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-envoy\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.592953 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-credential-socket\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.592953 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-data\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593173 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.592957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-socket\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593239 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-certs\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593338 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-credential-socket\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593338 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istiod-ca-cert\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593467 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-socket\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593544 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-certs\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593802 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593775 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-data\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.593939 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.593920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istiod-ca-cert\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.595193 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.595172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-envoy\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.595482 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.595465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-podinfo\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.608266 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.608236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-token\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:57.609447 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:57.609429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6l79\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-kube-api-access-c6l79\") pod \"e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:58.696832 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.696793 2581 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 15 19:53:58.697236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.696868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:58.844711 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.844681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ee1301-openshift-default-dockercfg-79526\"" Jul 15 19:53:58.866304 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.866261 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4"] Jul 15 19:53:58.868475 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:53:58.868446 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bafcb98_27a9_42dd_bf59_90d7a4d36661.slice/crio-dff3cacc4af87fcc7358c6f9f2560dc5408b47e9e6038129a08ae20067bbdcdf WatchSource:0}: Error finding container dff3cacc4af87fcc7358c6f9f2560dc5408b47e9e6038129a08ae20067bbdcdf: Status 404 returned error can't find the container with id dff3cacc4af87fcc7358c6f9f2560dc5408b47e9e6038129a08ae20067bbdcdf Jul 15 19:53:58.870550 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.870516 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:53:58.870613 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.870585 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:53:58.870657 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:58.870613 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:53:59.216581 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:59.216544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" event={"ID":"8bafcb98-27a9-42dd-bf59-90d7a4d36661","Type":"ContainerStarted","Data":"e613f46300c12c4e4da129717d9c7ec5f5a087b2d05b86b3c2169d2af87e7d87"} Jul 15 19:53:59.216786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:59.216598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" event={"ID":"8bafcb98-27a9-42dd-bf59-90d7a4d36661","Type":"ContainerStarted","Data":"dff3cacc4af87fcc7358c6f9f2560dc5408b47e9e6038129a08ae20067bbdcdf"} Jul 15 19:53:59.249697 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:59.249643 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podStartSLOduration=2.249621239 podStartE2EDuration="2.249621239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:53:59.24875211 +0000 UTC m=+2395.393196742" watchObservedRunningTime="2026-07-15 19:53:59.249621239 +0000 UTC m=+2395.394065874" Jul 15 19:53:59.697631 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:59.697597 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:53:59.702893 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:53:59.702866 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:00.223374 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:00.223342 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:00.224535 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:00.224515 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:01.621534 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.621454 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:54:01.631412 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631370 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-credential-socket\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631589 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631440 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-data\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631589 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631475 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-istio-token\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631589 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631506 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-socket\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631589 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631584 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-certs\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631809 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631608 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spl69\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-kube-api-access-spl69\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631809 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631645 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-envoy\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631809 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631668 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73591176-a96e-4499-bec7-54830d6a2a9e-istiod-ca-cert\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.631809 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631718 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:54:01.631809 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.631790 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73591176-a96e-4499-bec7-54830d6a2a9e-istio-podinfo\") pod \"73591176-a96e-4499-bec7-54830d6a2a9e\" (UID: \"73591176-a96e-4499-bec7-54830d6a2a9e\") " Jul 15 19:54:01.632130 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.632011 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73591176-a96e-4499-bec7-54830d6a2a9e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:54:01.632786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.632196 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73591176-a96e-4499-bec7-54830d6a2a9e-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.632786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.632215 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.632786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.632356 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-data" (OuterVolumeSpecName: "istio-data") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:54:01.632786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.632594 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:54:01.632786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.632745 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:54:01.634384 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.634358 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:54:01.634483 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.634431 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73591176-a96e-4499-bec7-54830d6a2a9e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:54:01.634846 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.634810 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-kube-api-access-spl69" (OuterVolumeSpecName: "kube-api-access-spl69") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "kube-api-access-spl69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:54:01.635315 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.635275 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73591176-a96e-4499-bec7-54830d6a2a9e" (UID: "73591176-a96e-4499-bec7-54830d6a2a9e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:54:01.733659 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733610 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73591176-a96e-4499-bec7-54830d6a2a9e-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.733659 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733649 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.733659 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733666 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.733890 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733679 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.733890 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733691 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.733890 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733707 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spl69\" (UniqueName: \"kubernetes.io/projected/73591176-a96e-4499-bec7-54830d6a2a9e-kube-api-access-spl69\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:01.733890 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:01.733720 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73591176-a96e-4499-bec7-54830d6a2a9e-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:54:02.237622 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.237583 2581 generic.go:356] "Generic (PLEG): container finished" podID="73591176-a96e-4499-bec7-54830d6a2a9e" containerID="962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc" exitCode=0 Jul 15 19:54:02.237928 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.237885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" event={"ID":"73591176-a96e-4499-bec7-54830d6a2a9e","Type":"ContainerDied","Data":"962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc"} Jul 15 19:54:02.237928 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.237926 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" Jul 15 19:54:02.238092 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.237968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8" event={"ID":"73591176-a96e-4499-bec7-54830d6a2a9e","Type":"ContainerDied","Data":"b2ce32169e034d9a245770da28933ac6910b407c3d53624af83ae8a700607f95"} Jul 15 19:54:02.238092 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.238006 2581 scope.go:117] "RemoveContainer" containerID="962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc" Jul 15 19:54:02.247911 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.247891 2581 scope.go:117] "RemoveContainer" containerID="1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063" Jul 15 19:54:02.256752 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.256731 2581 scope.go:117] "RemoveContainer" containerID="962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc" Jul 15 19:54:02.257057 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:54:02.257038 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc\": container with ID starting with 962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc not found: ID does not exist" containerID="962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc" Jul 15 19:54:02.257112 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.257066 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc"} err="failed to get container status \"962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc\": rpc error: code = NotFound desc = could not find container \"962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc\": container with ID starting with 962fa47b61779819c3f93602a2602de7e72d410adf787e0857e3d1a5bcf38ccc not found: ID does not exist" Jul 15 19:54:02.257112 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.257085 2581 scope.go:117] "RemoveContainer" containerID="1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063" Jul 15 19:54:02.257351 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:54:02.257330 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063\": container with ID starting with 1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063 not found: ID does not exist" containerID="1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063" Jul 15 19:54:02.257424 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.257356 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063"} err="failed to get container status \"1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063\": rpc error: code = NotFound desc = could not find container \"1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063\": container with ID starting with 1546611a68cbb5205ae1a0b62ee7ef0badd3682e16d2bcf777fa6d4ec4d06063 not found: ID does not exist" Jul 15 19:54:02.277375 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.277337 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8"] Jul 15 19:54:02.279742 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.279717 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2908a6-openshift-default-758bcd45dc-6krf8"] Jul 15 19:54:02.415738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:02.415703 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" path="/var/lib/kubelet/pods/73591176-a96e-4499-bec7-54830d6a2a9e/volumes" Jul 15 19:54:04.511465 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:04.511438 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:54:04.514668 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:04.514645 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:54:04.519891 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:04.519869 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:54:04.522921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:04.522904 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:54:06.626070 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.626035 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc"] Jul 15 19:54:06.626648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.626627 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" Jul 15 19:54:06.626749 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.626651 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" Jul 15 19:54:06.626810 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.626766 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" Jul 15 19:54:06.626810 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.626782 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" Jul 15 19:54:06.631971 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.631944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.636224 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.636199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-58f4c5-openshift-default-dockercfg-x7r4v\"" Jul 15 19:54:06.680087 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.680044 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc"] Jul 15 19:54:06.684861 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.684825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-socket\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.684879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-certs\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.684924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-envoy\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.685000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-podinfo\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685038 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.685036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh54j\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-kube-api-access-xh54j\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.685075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-token\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.685103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-data\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.685130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-credential-socket\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.685328 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.685155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istiod-ca-cert\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-podinfo\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786114 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh54j\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-kube-api-access-xh54j\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-token\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-data\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-credential-socket\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istiod-ca-cert\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-socket\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-certs\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786448 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-envoy\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.786975 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.786938 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-socket\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.787236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.787201 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-certs\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.787236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.787225 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-data\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.787416 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.787382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istiod-ca-cert\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.787489 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.787451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-credential-socket\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.788805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.788779 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-envoy\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.789490 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.789468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-podinfo\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.802232 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.802205 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-token\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.808786 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.808753 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh54j\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-kube-api-access-xh54j\") pod \"e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:06.943425 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:06.943378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:07.128717 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.128694 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc"] Jul 15 19:54:07.130772 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:54:07.130740 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8afdac9_5fda_4aae_ad13_f3d5f44601c5.slice/crio-d0a7c116e499a912e777b43873437e46e13ec4889b958472577e8bb47fe46c58 WatchSource:0}: Error finding container d0a7c116e499a912e777b43873437e46e13ec4889b958472577e8bb47fe46c58: Status 404 returned error can't find the container with id d0a7c116e499a912e777b43873437e46e13ec4889b958472577e8bb47fe46c58 Jul 15 19:54:07.133127 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.133096 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:07.133207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.133161 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:07.133207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.133190 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:07.266617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.266506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" event={"ID":"a8afdac9-5fda-4aae-ad13-f3d5f44601c5","Type":"ContainerStarted","Data":"3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319"} Jul 15 19:54:07.266617 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.266572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" event={"ID":"a8afdac9-5fda-4aae-ad13-f3d5f44601c5","Type":"ContainerStarted","Data":"d0a7c116e499a912e777b43873437e46e13ec4889b958472577e8bb47fe46c58"} Jul 15 19:54:07.314389 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.314326 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podStartSLOduration=1.314310379 podStartE2EDuration="1.314310379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:07.312904599 +0000 UTC m=+2403.457349250" watchObservedRunningTime="2026-07-15 19:54:07.314310379 +0000 UTC m=+2403.458755011" Jul 15 19:54:07.943864 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:07.943824 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:08.949356 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:08.949325 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:09.276493 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:09.276402 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:09.277452 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:09.277426 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:16.265499 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:16.265451 2581 patch_prober.go:28] interesting pod/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 19:54:16.266034 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:16.265514 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 19:54:18.326405 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:18.326373 2581 generic.go:356] "Generic (PLEG): container finished" podID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerID="e613f46300c12c4e4da129717d9c7ec5f5a087b2d05b86b3c2169d2af87e7d87" exitCode=0 Jul 15 19:54:18.326819 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:18.326402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" event={"ID":"8bafcb98-27a9-42dd-bf59-90d7a4d36661","Type":"ContainerDied","Data":"e613f46300c12c4e4da129717d9c7ec5f5a087b2d05b86b3c2169d2af87e7d87"} Jul 15 19:54:18.326866 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:18.326842 2581 scope.go:117] "RemoveContainer" containerID="e613f46300c12c4e4da129717d9c7ec5f5a087b2d05b86b3c2169d2af87e7d87" Jul 15 19:54:18.327890 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:18.327859 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:18.327998 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:18.327943 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:18.327998 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:18.327988 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:19.337812 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:19.337762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" event={"ID":"8bafcb98-27a9-42dd-bf59-90d7a4d36661","Type":"ContainerStarted","Data":"005a22cd22bec15685867dd1da81aaabc034e0a4aefda6ae76ade2c142e39fdf"} Jul 15 19:54:19.697166 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:19.697122 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:19.697399 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:19.697352 2581 patch_prober.go:28] interesting pod/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 19:54:19.697476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:19.697409 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 19:54:20.698218 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:20.698163 2581 patch_prober.go:28] interesting pod/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 19:54:20.698671 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:20.698247 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 19:54:21.697546 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:21.697507 2581 patch_prober.go:28] interesting pod/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 19:54:21.697739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:21.697562 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 19:54:22.698366 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:22.698329 2581 patch_prober.go:28] interesting pod/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 15 19:54:22.698758 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:22.698386 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 15 19:54:23.701565 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:23.701530 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:23.701972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:23.701804 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:23.702426 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:23.702407 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:54:25.318526 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:25.318473 2581 patch_prober.go:28] interesting pod/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 19:54:25.318905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:25.318548 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 19:54:27.392104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:27.392010 2581 generic.go:356] "Generic (PLEG): container finished" podID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerID="3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319" exitCode=0 Jul 15 19:54:27.392104 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:27.392089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" event={"ID":"a8afdac9-5fda-4aae-ad13-f3d5f44601c5","Type":"ContainerDied","Data":"3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319"} Jul 15 19:54:27.392557 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:27.392528 2581 scope.go:117] "RemoveContainer" containerID="3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319" Jul 15 19:54:27.393536 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:27.393510 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:27.393614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:27.393574 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:27.393614 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:27.393607 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:54:28.399358 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:28.399326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" event={"ID":"a8afdac9-5fda-4aae-ad13-f3d5f44601c5","Type":"ContainerStarted","Data":"c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c"} Jul 15 19:54:28.944594 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:28.944549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:28.944829 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:28.944798 2581 patch_prober.go:28] interesting pod/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 19:54:28.945066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:28.945037 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 19:54:29.945164 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:29.944706 2581 patch_prober.go:28] interesting pod/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 19:54:29.945164 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:29.944773 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 19:54:30.944972 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:30.944922 2581 patch_prober.go:28] interesting pod/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 19:54:30.945225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:30.944997 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 19:54:31.944338 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:31.944269 2581 patch_prober.go:28] interesting pod/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 15 19:54:31.944558 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:31.944372 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 15 19:54:32.947250 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:32.947210 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:32.947768 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:32.947672 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:32.948335 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:32.948319 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:54:58.368246 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:58.368208 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4"] Jul 15 19:54:58.368690 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:54:58.368463 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" containerID="cri-o://005a22cd22bec15685867dd1da81aaabc034e0a4aefda6ae76ade2c142e39fdf" gracePeriod=30 Jul 15 19:55:03.577493 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.577452 2581 generic.go:356] "Generic (PLEG): container finished" podID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerID="005a22cd22bec15685867dd1da81aaabc034e0a4aefda6ae76ade2c142e39fdf" exitCode=0 Jul 15 19:55:03.577925 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.577521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" event={"ID":"8bafcb98-27a9-42dd-bf59-90d7a4d36661","Type":"ContainerDied","Data":"005a22cd22bec15685867dd1da81aaabc034e0a4aefda6ae76ade2c142e39fdf"} Jul 15 19:55:03.577925 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.577600 2581 scope.go:117] "RemoveContainer" containerID="e613f46300c12c4e4da129717d9c7ec5f5a087b2d05b86b3c2169d2af87e7d87" Jul 15 19:55:03.624905 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.624876 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:55:03.766344 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766271 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-podinfo\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766527 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766366 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-envoy\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766527 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766405 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-token\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766527 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766433 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-data\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766527 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766493 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6l79\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-kube-api-access-c6l79\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766537 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-socket\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766563 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-certs\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766673 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istiod-ca-cert\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.766738 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766713 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-credential-socket\") pod \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\" (UID: \"8bafcb98-27a9-42dd-bf59-90d7a4d36661\") " Jul 15 19:55:03.767057 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.766981 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:03.767253 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.767226 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:03.767253 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.767240 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:03.767497 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.767474 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:55:03.767573 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.767517 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-data" (OuterVolumeSpecName: "istio-data") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:03.768735 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.768697 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:03.768838 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.768761 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-kube-api-access-c6l79" (OuterVolumeSpecName: "kube-api-access-c6l79") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "kube-api-access-c6l79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:55:03.768838 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.768763 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-token" (OuterVolumeSpecName: "istio-token") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:55:03.768838 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.768789 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8bafcb98-27a9-42dd-bf59-90d7a4d36661" (UID: "8bafcb98-27a9-42dd-bf59-90d7a4d36661"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:55:03.868147 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868109 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868147 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868141 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868147 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868151 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868159 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868168 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868175 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868182 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6l79\" (UniqueName: \"kubernetes.io/projected/8bafcb98-27a9-42dd-bf59-90d7a4d36661-kube-api-access-c6l79\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868190 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:03.868398 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:03.868198 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bafcb98-27a9-42dd-bf59-90d7a4d36661-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:04.584192 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:04.584161 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" Jul 15 19:55:04.584615 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:04.584191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4" event={"ID":"8bafcb98-27a9-42dd-bf59-90d7a4d36661","Type":"ContainerDied","Data":"dff3cacc4af87fcc7358c6f9f2560dc5408b47e9e6038129a08ae20067bbdcdf"} Jul 15 19:55:04.584615 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:04.584281 2581 scope.go:117] "RemoveContainer" containerID="005a22cd22bec15685867dd1da81aaabc034e0a4aefda6ae76ade2c142e39fdf" Jul 15 19:55:04.625570 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:04.625548 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4"] Jul 15 19:55:04.648488 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:04.648457 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ee1301-openshift-default-6746d66b57-9f9j4"] Jul 15 19:55:06.411430 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:06.411390 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" path="/var/lib/kubelet/pods/8bafcb98-27a9-42dd-bf59-90d7a4d36661/volumes" Jul 15 19:55:24.800936 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:24.800900 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc"] Jul 15 19:55:24.801455 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:24.801132 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" containerID="cri-o://c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c" gracePeriod=30 Jul 15 19:55:25.950405 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950365 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2"] Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950792 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950804 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="73591176-a96e-4499-bec7-54830d6a2a9e" containerName="istio-proxy" Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950813 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950818 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950828 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950834 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" Jul 15 19:55:25.950885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950890 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" Jul 15 19:55:25.951240 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.950897 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bafcb98-27a9-42dd-bf59-90d7a4d36661" containerName="istio-proxy" Jul 15 19:55:25.954041 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.954021 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:25.966075 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.966049 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-77bf75-openshift-default-dockercfg-797h6\"" Jul 15 19:55:25.983498 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:25.983463 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2"] Jul 15 19:55:26.082207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-certs\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082207 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-podinfo\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082510 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-credential-socket\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082510 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-socket\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082510 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-data\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082520 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243bfc8-ba37-4235-ba9e-2018fb23f414-istiod-ca-cert\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6bxw\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-kube-api-access-v6bxw\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-envoy\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.082669 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.082640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-token\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.183704 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-token\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.183916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-certs\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.183916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-podinfo\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.183916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-credential-socket\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.183916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-socket\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.183916 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-data\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.184189 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243bfc8-ba37-4235-ba9e-2018fb23f414-istiod-ca-cert\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.184189 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.183969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6bxw\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-kube-api-access-v6bxw\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.184189 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.184030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-envoy\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.184378 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.184251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-certs\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.184378 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.184320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-socket\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.184877 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.184851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-credential-socket\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.185011 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.184891 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-data\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.185141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.185108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243bfc8-ba37-4235-ba9e-2018fb23f414-istiod-ca-cert\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.186475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.186451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-envoy\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.186982 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.186961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-podinfo\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.205517 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.205444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-token\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.205646 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.205630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6bxw\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-kube-api-access-v6bxw\") pod \"e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.265631 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.265589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:26.440200 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.440175 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2"] Jul 15 19:55:26.442430 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:55:26.442402 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc243bfc8_ba37_4235_ba9e_2018fb23f414.slice/crio-462107b4c855a98fe4595e4c6653b8b45bef01c6ad27560a7a6b127c51a61f60 WatchSource:0}: Error finding container 462107b4c855a98fe4595e4c6653b8b45bef01c6ad27560a7a6b127c51a61f60: Status 404 returned error can't find the container with id 462107b4c855a98fe4595e4c6653b8b45bef01c6ad27560a7a6b127c51a61f60 Jul 15 19:55:26.444491 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.444456 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:26.444556 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.444531 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:26.444594 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.444562 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:26.696872 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.696839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" event={"ID":"c243bfc8-ba37-4235-ba9e-2018fb23f414","Type":"ContainerStarted","Data":"b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3"} Jul 15 19:55:26.697035 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.696891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" event={"ID":"c243bfc8-ba37-4235-ba9e-2018fb23f414","Type":"ContainerStarted","Data":"462107b4c855a98fe4595e4c6653b8b45bef01c6ad27560a7a6b127c51a61f60"} Jul 15 19:55:26.728485 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:26.728385 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podStartSLOduration=1.728367606 podStartE2EDuration="1.728367606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:26.725685034 +0000 UTC m=+2482.870129661" watchObservedRunningTime="2026-07-15 19:55:26.728367606 +0000 UTC m=+2482.872812238" Jul 15 19:55:27.266319 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:27.266250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:27.271322 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:27.271283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:27.701945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:27.701912 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:27.702837 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:27.702817 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:30.074770 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.074709 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:55:30.225739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225708 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-token\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.225739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-envoy\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225785 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-data\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-certs\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225853 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istiod-ca-cert\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225898 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-socket\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225923 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-podinfo\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225960 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh54j\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-kube-api-access-xh54j\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.225982 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-credential-socket\") pod \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\" (UID: \"a8afdac9-5fda-4aae-ad13-f3d5f44601c5\") " Jul 15 19:55:30.226476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.226225 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:30.226476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.226372 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.226476 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.226447 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:30.226732 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.226705 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:30.226862 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.226834 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 19:55:30.226932 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.226904 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:30.228091 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.228068 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:55:30.228187 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.228144 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 19:55:30.228551 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.228521 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-kube-api-access-xh54j" (OuterVolumeSpecName: "kube-api-access-xh54j") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "kube-api-access-xh54j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 19:55:30.228551 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.228529 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8afdac9-5fda-4aae-ad13-f3d5f44601c5" (UID: "a8afdac9-5fda-4aae-ad13-f3d5f44601c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327751 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327779 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327788 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh54j\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-kube-api-access-xh54j\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327797 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327806 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327814 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327821 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.327847 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.327831 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8afdac9-5fda-4aae-ad13-f3d5f44601c5-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 19:55:30.717975 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.717944 2581 generic.go:356] "Generic (PLEG): container finished" podID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerID="c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c" exitCode=0 Jul 15 19:55:30.718149 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.717983 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" event={"ID":"a8afdac9-5fda-4aae-ad13-f3d5f44601c5","Type":"ContainerDied","Data":"c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c"} Jul 15 19:55:30.718149 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.717992 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" Jul 15 19:55:30.718149 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.718025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc" event={"ID":"a8afdac9-5fda-4aae-ad13-f3d5f44601c5","Type":"ContainerDied","Data":"d0a7c116e499a912e777b43873437e46e13ec4889b958472577e8bb47fe46c58"} Jul 15 19:55:30.718149 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.718046 2581 scope.go:117] "RemoveContainer" containerID="c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c" Jul 15 19:55:30.726775 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.726754 2581 scope.go:117] "RemoveContainer" containerID="3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319" Jul 15 19:55:30.735475 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.735453 2581 scope.go:117] "RemoveContainer" containerID="c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c" Jul 15 19:55:30.735769 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:55:30.735748 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c\": container with ID starting with c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c not found: ID does not exist" containerID="c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c" Jul 15 19:55:30.735845 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.735784 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c"} err="failed to get container status \"c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c\": rpc error: code = NotFound desc = could not find container \"c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c\": container with ID starting with c83a236d6ca1862a19133063316845994b07a07bf6d166fafe5db9384332cf2c not found: ID does not exist" Jul 15 19:55:30.735845 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.735812 2581 scope.go:117] "RemoveContainer" containerID="3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319" Jul 15 19:55:30.736096 ip-10-0-139-42 kubenswrapper[2581]: E0715 19:55:30.736069 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319\": container with ID starting with 3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319 not found: ID does not exist" containerID="3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319" Jul 15 19:55:30.736141 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.736104 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319"} err="failed to get container status \"3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319\": rpc error: code = NotFound desc = could not find container \"3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319\": container with ID starting with 3b14bafadbbd7f73b81cd0ac60fa0b85e870eea5390d412f2a20fbc95894b319 not found: ID does not exist" Jul 15 19:55:30.757314 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.756451 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc"] Jul 15 19:55:30.761640 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:30.761612 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-58f4c5-openshift-default-b4bfc8799-sg4hc"] Jul 15 19:55:32.410978 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:32.410939 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" path="/var/lib/kubelet/pods/a8afdac9-5fda-4aae-ad13-f3d5f44601c5/volumes" Jul 15 19:55:34.256321 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.256256 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb"] Jul 15 19:55:34.256843 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.256822 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" Jul 15 19:55:34.256921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.256845 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" Jul 15 19:55:34.256921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.256873 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" Jul 15 19:55:34.256921 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.256882 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" Jul 15 19:55:34.257068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.257028 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" Jul 15 19:55:34.261739 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.261716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.266682 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.266661 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fcd095-openshift-default-dockercfg-d4qqc\"" Jul 15 19:55:34.296022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.295994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb"] Jul 15 19:55:34.367901 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.367864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-certs\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.367912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-socket\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.367941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5jkl\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-kube-api-access-x5jkl\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.367980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8626d142-af35-44fc-ad37-c62106701a44-istio-podinfo\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.368014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-envoy\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368066 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.368049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-credential-socket\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.368103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8626d142-af35-44fc-ad37-c62106701a44-istiod-ca-cert\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.368128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-istio-token\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.368236 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.368153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-data\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.468770 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8626d142-af35-44fc-ad37-c62106701a44-istiod-ca-cert\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.468770 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-istio-token\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-data\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-certs\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-socket\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5jkl\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-kube-api-access-x5jkl\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8626d142-af35-44fc-ad37-c62106701a44-istio-podinfo\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.468982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-envoy\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469022 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.469011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-credential-socket\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469433 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.469331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-socket\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469433 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.469373 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-certs\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469433 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.469404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-data\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469544 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.469508 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-credential-socket\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.469615 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.469591 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8626d142-af35-44fc-ad37-c62106701a44-istiod-ca-cert\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.471382 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.471361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-envoy\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.471587 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.471569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8626d142-af35-44fc-ad37-c62106701a44-istio-podinfo\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.491352 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.491318 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-istio-token\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.491478 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.491386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5jkl\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-kube-api-access-x5jkl\") pod \"e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.572165 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.572064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:34.744590 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.744564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb"] Jul 15 19:55:34.746363 ip-10-0-139-42 kubenswrapper[2581]: W0715 19:55:34.746336 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8626d142_af35_44fc_ad37_c62106701a44.slice/crio-925aef672a14e5d4b84a6a185fd0656747b1959bd338b424dea591e44daa8359 WatchSource:0}: Error finding container 925aef672a14e5d4b84a6a185fd0656747b1959bd338b424dea591e44daa8359: Status 404 returned error can't find the container with id 925aef672a14e5d4b84a6a185fd0656747b1959bd338b424dea591e44daa8359 Jul 15 19:55:34.748363 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.748331 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:34.748443 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.748392 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:34.748486 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:34.748441 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:35.751648 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:35.751606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" event={"ID":"8626d142-af35-44fc-ad37-c62106701a44","Type":"ContainerStarted","Data":"b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e"} Jul 15 19:55:35.752151 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:35.751674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" event={"ID":"8626d142-af35-44fc-ad37-c62106701a44","Type":"ContainerStarted","Data":"925aef672a14e5d4b84a6a185fd0656747b1959bd338b424dea591e44daa8359"} Jul 15 19:55:35.789035 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:35.788974 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podStartSLOduration=1.788956519 podStartE2EDuration="1.788956519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:35.78775658 +0000 UTC m=+2491.932201212" watchObservedRunningTime="2026-07-15 19:55:35.788956519 +0000 UTC m=+2491.933401151" Jul 15 19:55:36.572780 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:36.572730 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:36.577772 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:36.577737 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:36.761335 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:36.761276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:36.762356 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:36.762334 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:42.703662 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.703623 2581 patch_prober.go:28] interesting pod/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 19:55:42.704102 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.703703 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 19:55:42.791841 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.791804 2581 generic.go:356] "Generic (PLEG): container finished" podID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerID="b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3" exitCode=0 Jul 15 19:55:42.792015 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.791878 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" event={"ID":"c243bfc8-ba37-4235-ba9e-2018fb23f414","Type":"ContainerDied","Data":"b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3"} Jul 15 19:55:42.792331 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.792317 2581 scope.go:117] "RemoveContainer" containerID="b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3" Jul 15 19:55:42.793351 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.793324 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:42.793414 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.793390 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:42.793457 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:42.793422 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:43.799363 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:43.799328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" event={"ID":"c243bfc8-ba37-4235-ba9e-2018fb23f414","Type":"ContainerStarted","Data":"184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746"} Jul 15 19:55:44.265887 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:44.265854 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:44.266110 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:44.266085 2581 patch_prober.go:28] interesting pod/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 19:55:44.266166 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:44.266143 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 19:55:45.266245 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:45.266205 2581 patch_prober.go:28] interesting pod/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 19:55:45.266688 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:45.266265 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 19:55:46.267028 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:46.266990 2581 patch_prober.go:28] interesting pod/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 19:55:46.267483 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:46.267047 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 19:55:47.266865 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:47.266823 2581 patch_prober.go:28] interesting pod/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 15 19:55:47.267068 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:47.266881 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 15 19:55:48.270413 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:48.270383 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:48.270881 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:48.270768 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:48.271402 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:48.271380 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 19:55:57.889184 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:57.889148 2581 generic.go:356] "Generic (PLEG): container finished" podID="8626d142-af35-44fc-ad37-c62106701a44" containerID="b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e" exitCode=0 Jul 15 19:55:57.889657 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:57.889222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" event={"ID":"8626d142-af35-44fc-ad37-c62106701a44","Type":"ContainerDied","Data":"b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e"} Jul 15 19:55:57.889719 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:57.889705 2581 scope.go:117] "RemoveContainer" containerID="b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e" Jul 15 19:55:57.890885 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:57.890857 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:57.890955 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:57.890927 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:57.890996 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:57.890955 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 19:55:58.896040 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:58.896006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" event={"ID":"8626d142-af35-44fc-ad37-c62106701a44","Type":"ContainerStarted","Data":"b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82"} Jul 15 19:55:59.572918 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:59.572885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:55:59.573103 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:59.573060 2581 patch_prober.go:28] interesting pod/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 19:55:59.573149 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:55:59.573109 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 19:56:00.573138 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:00.573099 2581 patch_prober.go:28] interesting pod/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 19:56:00.573586 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:00.573157 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 19:56:01.572922 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:01.572885 2581 patch_prober.go:28] interesting pod/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 19:56:01.573096 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:01.572954 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 19:56:02.572945 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:02.572907 2581 patch_prober.go:28] interesting pod/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 15 19:56:02.573354 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:02.572972 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 15 19:56:03.576610 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:03.576579 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:56:03.576981 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:03.576852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:56:03.577558 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:56:03.577539 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 19:59:04.544805 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:59:04.544730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:59:04.548948 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:59:04.548925 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 19:59:04.553225 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:59:04.553204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 19:59:04.556787 ip-10-0-139-42 kubenswrapper[2581]: I0715 19:59:04.556769 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2h95x_1c3cdddf-7f56-4e85-b223-876eeb838b8d/ovn-acl-logging/0.log" Jul 15 20:02:34.111252 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:34.111213 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2"] Jul 15 20:02:34.111758 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:34.111547 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" containerID="cri-o://184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746" gracePeriod=30 Jul 15 20:02:39.372524 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.372462 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 20:02:39.438049 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438013 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-socket\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438049 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438050 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-certs\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438321 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438081 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-data\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438321 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438143 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-token\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438321 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438189 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-credential-socket\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438321 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438222 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-podinfo\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438570 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438358 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:02:39.438570 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438388 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:02:39.438570 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438446 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-envoy\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438570 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438520 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243bfc8-ba37-4235-ba9e-2018fb23f414-istiod-ca-cert\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438570 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6bxw\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-kube-api-access-v6bxw\") pod \"c243bfc8-ba37-4235-ba9e-2018fb23f414\" (UID: \"c243bfc8-ba37-4235-ba9e-2018fb23f414\") " Jul 15 20:02:39.438570 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438547 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:02:39.438891 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438859 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c243bfc8-ba37-4235-ba9e-2018fb23f414-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:02:39.438955 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438916 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.438955 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438934 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.438955 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.438948 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.439417 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.439388 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-data" (OuterVolumeSpecName: "istio-data") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:02:39.440652 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.440627 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:02:39.440740 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.440656 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 20:02:39.440945 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.440925 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-token" (OuterVolumeSpecName: "istio-token") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:02:39.440985 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.440942 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-kube-api-access-v6bxw" (OuterVolumeSpecName: "kube-api-access-v6bxw") pod "c243bfc8-ba37-4235-ba9e-2018fb23f414" (UID: "c243bfc8-ba37-4235-ba9e-2018fb23f414"). InnerVolumeSpecName "kube-api-access-v6bxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:02:39.540376 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.540343 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.540376 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.540371 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243bfc8-ba37-4235-ba9e-2018fb23f414-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.540376 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.540380 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6bxw\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-kube-api-access-v6bxw\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.540376 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.540388 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.540653 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.540399 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.540653 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.540407 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243bfc8-ba37-4235-ba9e-2018fb23f414-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:02:39.945250 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.945220 2581 generic.go:356] "Generic (PLEG): container finished" podID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerID="184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746" exitCode=0 Jul 15 20:02:39.945461 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.945281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" event={"ID":"c243bfc8-ba37-4235-ba9e-2018fb23f414","Type":"ContainerDied","Data":"184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746"} Jul 15 20:02:39.945461 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.945358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" event={"ID":"c243bfc8-ba37-4235-ba9e-2018fb23f414","Type":"ContainerDied","Data":"462107b4c855a98fe4595e4c6653b8b45bef01c6ad27560a7a6b127c51a61f60"} Jul 15 20:02:39.945461 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.945382 2581 scope.go:117] "RemoveContainer" containerID="184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746" Jul 15 20:02:39.945461 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.945306 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2" Jul 15 20:02:39.955154 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.955137 2581 scope.go:117] "RemoveContainer" containerID="b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3" Jul 15 20:02:39.963719 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.963701 2581 scope.go:117] "RemoveContainer" containerID="184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746" Jul 15 20:02:39.964013 ip-10-0-139-42 kubenswrapper[2581]: E0715 20:02:39.963987 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746\": container with ID starting with 184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746 not found: ID does not exist" containerID="184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746" Jul 15 20:02:39.964094 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.964016 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746"} err="failed to get container status \"184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746\": rpc error: code = NotFound desc = could not find container \"184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746\": container with ID starting with 184beec86ba00281a00df09917a8d7929996f914ff28a2b9f97b71780717a746 not found: ID does not exist" Jul 15 20:02:39.964094 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.964041 2581 scope.go:117] "RemoveContainer" containerID="b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3" Jul 15 20:02:39.964336 ip-10-0-139-42 kubenswrapper[2581]: E0715 20:02:39.964314 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3\": container with ID starting with b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3 not found: ID does not exist" containerID="b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3" Jul 15 20:02:39.964381 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.964345 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3"} err="failed to get container status \"b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3\": rpc error: code = NotFound desc = could not find container \"b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3\": container with ID starting with b6c1b58670afe9d3d5a8c5a4209441430c7b8c8d094e44f5afeff8fcfd45b4c3 not found: ID does not exist" Jul 15 20:02:39.976787 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:39.976760 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2"] Jul 15 20:02:40.012647 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:40.012609 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-77bf75-openshift-default-6ccfcfb6ff-mhnt2"] Jul 15 20:02:40.410267 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:02:40.410231 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" path="/var/lib/kubelet/pods/c243bfc8-ba37-4235-ba9e-2018fb23f414/volumes" Jul 15 20:03:00.472961 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:00.472927 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb"] Jul 15 20:03:00.473406 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:00.473143 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" containerID="cri-o://b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82" gracePeriod=30 Jul 15 20:03:01.168729 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:01.168696 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5654ccdb-56rbm_afacf53f-d726-4431-b0ea-5317a5248b39/authorino/0.log" Jul 15 20:03:03.579902 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:03.579861 2581 patch_prober.go:28] interesting pod/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 20:03:03.580272 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:03.579950 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 20:03:05.735738 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.735669 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 20:03:05.782456 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782420 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-certs\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.782664 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782507 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-envoy\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.782664 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782529 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-credential-socket\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.782664 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782566 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-data\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.782664 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782591 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-istio-token\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.782664 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5jkl\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-kube-api-access-x5jkl\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.783015 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782676 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8626d142-af35-44fc-ad37-c62106701a44-istio-podinfo\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.783015 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782702 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8626d142-af35-44fc-ad37-c62106701a44-istiod-ca-cert\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.783015 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782747 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:03:05.783015 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.782822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-socket\") pod \"8626d142-af35-44fc-ad37-c62106701a44\" (UID: \"8626d142-af35-44fc-ad37-c62106701a44\") " Jul 15 20:03:05.783213 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.783110 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-certs\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.783462 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.783412 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:03:05.783893 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.783837 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8626d142-af35-44fc-ad37-c62106701a44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:03:05.784206 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.784165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-data" (OuterVolumeSpecName: "istio-data") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:03:05.784629 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.784599 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:03:05.785919 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.785892 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-kube-api-access-x5jkl" (OuterVolumeSpecName: "kube-api-access-x5jkl") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "kube-api-access-x5jkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:03:05.786038 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.785961 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:03:05.786341 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.786308 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-istio-token" (OuterVolumeSpecName: "istio-token") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:03:05.786668 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.786642 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8626d142-af35-44fc-ad37-c62106701a44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8626d142-af35-44fc-ad37-c62106701a44" (UID: "8626d142-af35-44fc-ad37-c62106701a44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 20:03:05.883652 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883609 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-credential-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883652 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883644 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-data\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883652 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883654 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-istio-token\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883652 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883662 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5jkl\" (UniqueName: \"kubernetes.io/projected/8626d142-af35-44fc-ad37-c62106701a44-kube-api-access-x5jkl\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883928 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883671 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8626d142-af35-44fc-ad37-c62106701a44-istio-podinfo\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883928 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883679 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8626d142-af35-44fc-ad37-c62106701a44-istiod-ca-cert\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883928 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883687 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-workload-socket\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:05.883928 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:05.883694 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8626d142-af35-44fc-ad37-c62106701a44-istio-envoy\") on node \"ip-10-0-139-42.ec2.internal\" DevicePath \"\"" Jul 15 20:03:06.083202 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.083107 2581 generic.go:356] "Generic (PLEG): container finished" podID="8626d142-af35-44fc-ad37-c62106701a44" containerID="b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82" exitCode=0 Jul 15 20:03:06.083202 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.083160 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" Jul 15 20:03:06.083469 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.083156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" event={"ID":"8626d142-af35-44fc-ad37-c62106701a44","Type":"ContainerDied","Data":"b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82"} Jul 15 20:03:06.083469 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.083321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb" event={"ID":"8626d142-af35-44fc-ad37-c62106701a44","Type":"ContainerDied","Data":"925aef672a14e5d4b84a6a185fd0656747b1959bd338b424dea591e44daa8359"} Jul 15 20:03:06.083469 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.083352 2581 scope.go:117] "RemoveContainer" containerID="b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82" Jul 15 20:03:06.092848 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.092831 2581 scope.go:117] "RemoveContainer" containerID="b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e" Jul 15 20:03:06.102119 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.102099 2581 scope.go:117] "RemoveContainer" containerID="b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82" Jul 15 20:03:06.102422 ip-10-0-139-42 kubenswrapper[2581]: E0715 20:03:06.102396 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82\": container with ID starting with b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82 not found: ID does not exist" containerID="b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82" Jul 15 20:03:06.102477 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.102436 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82"} err="failed to get container status \"b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82\": rpc error: code = NotFound desc = could not find container \"b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82\": container with ID starting with b990dabb47cd169d91fedad37bda75d830c1c35c60bb6bc52158655645ea5c82 not found: ID does not exist" Jul 15 20:03:06.102477 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.102461 2581 scope.go:117] "RemoveContainer" containerID="b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e" Jul 15 20:03:06.102736 ip-10-0-139-42 kubenswrapper[2581]: E0715 20:03:06.102717 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e\": container with ID starting with b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e not found: ID does not exist" containerID="b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e" Jul 15 20:03:06.102797 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.102743 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e"} err="failed to get container status \"b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e\": rpc error: code = NotFound desc = could not find container \"b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e\": container with ID starting with b542ec07fcb102cea5746e4dfcf2dd24aa588acec5af46074d565dec68f8cc6e not found: ID does not exist" Jul 15 20:03:06.122089 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.122060 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb"] Jul 15 20:03:06.125410 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.125389 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fcd095-openshift-default-79768f856c-fv4wb"] Jul 15 20:03:06.409927 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:06.409889 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8626d142-af35-44fc-ad37-c62106701a44" path="/var/lib/kubelet/pods/8626d142-af35-44fc-ad37-c62106701a44/volumes" Jul 15 20:03:07.219731 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:07.219702 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kzqwl_93eefa20-9870-47e8-96b5-54b7d82a0ab8/manager/0.log" Jul 15 20:03:07.350452 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:07.350421 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k42fw_d71c6892-bb80-4042-ae8c-a1e3064c869c/manager/0.log" Jul 15 20:03:07.659248 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:07.659227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5jlbz_45b12b41-64d9-4cf5-b6a2-148e1c8b670e/server/0.log" Jul 15 20:03:07.795253 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:07.795217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6zbr6_27636919-019d-42f5-881f-328506a2bc7a/manager/0.log" Jul 15 20:03:07.934489 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:07.934409 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-jmx2d_c94c412d-762b-4b28-bb59-21c52128bcf4/copy-manifests/0.log" Jul 15 20:03:07.953447 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:07.953419 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-jmx2d_c94c412d-762b-4b28-bb59-21c52128bcf4/manager/0.log" Jul 15 20:03:12.067813 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:12.067780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5654ccdb-56rbm_afacf53f-d726-4431-b0ea-5317a5248b39/authorino/0.log" Jul 15 20:03:12.418693 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:12.418659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kkxb8_c00b501a-5f87-40e0-bf1d-405bb9696e00/manager/0.log" Jul 15 20:03:12.545338 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:12.545303 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-w2xtg_2134bb94-7a1d-4e64-a38e-5e6971428c3b/manager/0.log" Jul 15 20:03:12.822034 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:12.821951 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gz9st_9794268a-6078-43e1-a5ce-258cacab5cb7/registry-server/0.log" Jul 15 20:03:12.953701 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:12.953669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qwnld_c2ae6809-661a-4139-a9ee-69a50b5a5777/manager/0.log" Jul 15 20:03:13.206796 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:13.206766 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-664x9_dcabec3f-3856-4875-8c7a-d1da8e638d32/manager/0.log" Jul 15 20:03:13.582726 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:13.582646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dbw9p_a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8/istio-proxy/0.log" Jul 15 20:03:13.964745 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:13.964717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c95658bf4-dxnlc_8bf20423-ddc3-46eb-afc3-5eecdb52e3b7/kube-auth-proxy/0.log" Jul 15 20:03:14.084763 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:14.084730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/1.log" Jul 15 20:03:14.496191 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:14.496161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59d6798796-8ds8g_2a99eb45-c843-407d-93e8-a804e8f24025/router/0.log" Jul 15 20:03:14.871992 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:14.871907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z47xs_e5482add-ae7e-44b9-ab11-dd28afe82680/main/0.log" Jul 15 20:03:15.311852 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:15.311818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbp2vcp_28769e42-838a-44f0-842e-9011a470576c/main/0.log" Jul 15 20:03:15.556739 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:15.556707 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-86qrj_de6b88d3-8615-4b45-889f-cc239e8deac6/main/0.log" Jul 15 20:03:24.961344 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:24.961313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xv76q_863e847e-a9ad-4621-8e81-fb8a2060f55f/global-pull-secret-syncer/0.log" Jul 15 20:03:25.124928 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:25.124898 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8vnrz_1fda9597-4e31-4cf3-aefa-a6f2c134eef7/konnectivity-agent/0.log" Jul 15 20:03:25.430175 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:25.430148 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-42.ec2.internal_1edd94a745f603ae25b0ce87a74b4849/haproxy/0.log" Jul 15 20:03:30.459275 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:30.459243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5654ccdb-56rbm_afacf53f-d726-4431-b0ea-5317a5248b39/authorino/0.log" Jul 15 20:03:30.558972 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:30.558939 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kkxb8_c00b501a-5f87-40e0-bf1d-405bb9696e00/manager/0.log" Jul 15 20:03:30.606950 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:30.606921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-w2xtg_2134bb94-7a1d-4e64-a38e-5e6971428c3b/manager/0.log" Jul 15 20:03:30.743018 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:30.742908 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gz9st_9794268a-6078-43e1-a5ce-258cacab5cb7/registry-server/0.log" Jul 15 20:03:30.896116 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:30.896086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qwnld_c2ae6809-661a-4139-a9ee-69a50b5a5777/manager/0.log" Jul 15 20:03:31.033274 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:31.033184 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-664x9_dcabec3f-3856-4875-8c7a-d1da8e638d32/manager/0.log" Jul 15 20:03:33.036997 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:33.036964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-qjm44_0b258edf-9d2d-43b1-aba1-8a3a07e67485/cluster-monitoring-operator/0.log" Jul 15 20:03:33.295010 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:33.294932 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gbhl_0a597c66-f08b-4193-9763-13141df7a773/node-exporter/0.log" Jul 15 20:03:33.341890 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:33.341859 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gbhl_0a597c66-f08b-4193-9763-13141df7a773/kube-rbac-proxy/0.log" Jul 15 20:03:33.385000 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:33.384963 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gbhl_0a597c66-f08b-4193-9763-13141df7a773/init-textfile/0.log" Jul 15 20:03:34.735211 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735180 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r"] Jul 15 20:03:34.735624 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735588 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" Jul 15 20:03:34.735624 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735601 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" Jul 15 20:03:34.735624 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735611 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" Jul 15 20:03:34.735624 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735619 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" Jul 15 20:03:34.735754 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735702 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8afdac9-5fda-4aae-ad13-f3d5f44601c5" containerName="istio-proxy" Jul 15 20:03:34.735754 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735718 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" Jul 15 20:03:34.735754 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735724 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c243bfc8-ba37-4235-ba9e-2018fb23f414" containerName="istio-proxy" Jul 15 20:03:34.735754 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735731 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" Jul 15 20:03:34.735754 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.735737 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8626d142-af35-44fc-ad37-c62106701a44" containerName="istio-proxy" Jul 15 20:03:34.738849 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.738831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.746178 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.746155 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4t46\"/\"kube-root-ca.crt\"" Jul 15 20:03:34.747544 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.747522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g4t46\"/\"default-dockercfg-jjljq\"" Jul 15 20:03:34.747647 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.747598 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4t46\"/\"openshift-service-ca.crt\"" Jul 15 20:03:34.778693 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.778658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r"] Jul 15 20:03:34.856454 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.856418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-sys\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.856646 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.856528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-podres\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.856646 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.856549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-proc\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.856646 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.856588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-lib-modules\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.856646 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.856614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmqln\" (UniqueName: \"kubernetes.io/projected/c9e39c7b-1057-485f-9c98-079b4cd994cd-kube-api-access-vmqln\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958068 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-podres\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958068 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-proc\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958068 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-lib-modules\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958486 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmqln\" (UniqueName: \"kubernetes.io/projected/c9e39c7b-1057-485f-9c98-079b4cd994cd-kube-api-access-vmqln\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958486 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-sys\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958486 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-proc\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958486 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958226 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-lib-modules\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958486 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-sys\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.958486 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.958226 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9e39c7b-1057-485f-9c98-079b4cd994cd-podres\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:34.974605 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:34.974575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmqln\" (UniqueName: \"kubernetes.io/projected/c9e39c7b-1057-485f-9c98-079b4cd994cd-kube-api-access-vmqln\") pod \"perf-node-gather-daemonset-h298r\" (UID: \"c9e39c7b-1057-485f-9c98-079b4cd994cd\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:35.048762 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:35.048670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:35.197538 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:35.197509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r"] Jul 15 20:03:35.201353 ip-10-0-139-42 kubenswrapper[2581]: W0715 20:03:35.201326 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9e39c7b_1057_485f_9c98_079b4cd994cd.slice/crio-8a8087507519c255608422851bafc2f0d3e1d55cd5d13316aee18c0a172290a9 WatchSource:0}: Error finding container 8a8087507519c255608422851bafc2f0d3e1d55cd5d13316aee18c0a172290a9: Status 404 returned error can't find the container with id 8a8087507519c255608422851bafc2f0d3e1d55cd5d13316aee18c0a172290a9 Jul 15 20:03:35.242907 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:35.242864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" event={"ID":"c9e39c7b-1057-485f-9c98-079b4cd994cd","Type":"ContainerStarted","Data":"8a8087507519c255608422851bafc2f0d3e1d55cd5d13316aee18c0a172290a9"} Jul 15 20:03:36.249609 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:36.249571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" event={"ID":"c9e39c7b-1057-485f-9c98-079b4cd994cd","Type":"ContainerStarted","Data":"edbcdca462db8984171c82a29f6ad413fed4bbdeb3e808e8fea3877a90663b2d"} Jul 15 20:03:36.250097 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:36.249700 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:36.283617 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:36.283567 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" podStartSLOduration=2.283550489 podStartE2EDuration="2.283550489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:36.282861674 +0000 UTC m=+2972.427306308" watchObservedRunningTime="2026-07-15 20:03:36.283550489 +0000 UTC m=+2972.427995122" Jul 15 20:03:36.936662 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:36.936632 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/2.log" Jul 15 20:03:36.940857 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:36.940827 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jdnzk_ede1146f-2531-47c9-89a5-f840d528eab6/console-operator/3.log" Jul 15 20:03:38.304647 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:38.304610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-vkt66_330ed2ee-5fb3-4428-b551-b933c47ec693/volume-data-source-validator/0.log" Jul 15 20:03:39.706123 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:39.706096 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-brlgd_9f473ffd-ddd4-45df-96b8-5556d3d8cb51/dns/0.log" Jul 15 20:03:39.753723 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:39.753697 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-brlgd_9f473ffd-ddd4-45df-96b8-5556d3d8cb51/kube-rbac-proxy/0.log" Jul 15 20:03:39.971417 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:39.971323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s8pgs_d15bbcc7-4e83-4761-adce-d5d6e90dcbd3/dns-node-resolver/0.log" Jul 15 20:03:40.892527 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:40.892493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nvjrg_980ab03e-aafb-4f74-833b-9085a8080638/node-ca/0.log" Jul 15 20:03:42.137331 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:42.137270 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dbw9p_a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8/istio-proxy/0.log" Jul 15 20:03:42.265698 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:42.265667 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-h298r" Jul 15 20:03:42.369957 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:42.369927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c95658bf4-dxnlc_8bf20423-ddc3-46eb-afc3-5eecdb52e3b7/kube-auth-proxy/0.log" Jul 15 20:03:42.431654 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:42.431611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/0.log" Jul 15 20:03:42.459629 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:42.459598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/1.log" Jul 15 20:03:42.649907 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:42.649871 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59d6798796-8ds8g_2a99eb45-c843-407d-93e8-a804e8f24025/router/0.log" Jul 15 20:03:43.707101 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:43.707068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t2j6_d394df5d-135f-45d9-8647-26db0fcc9eb2/serve-healthcheck-canary/0.log" Jul 15 20:03:44.653194 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.653114 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xlrwl_8e4cbc00-51f7-48af-b137-bc6bb3a6cdec/insights-operator/0.log" Jul 15 20:03:44.653556 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.653537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xlrwl_8e4cbc00-51f7-48af-b137-bc6bb3a6cdec/insights-operator/1.log" Jul 15 20:03:44.725868 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.725840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gd4m_5a158cb5-f00b-44b6-a5ea-a98f557df640/kube-rbac-proxy/0.log" Jul 15 20:03:44.726648 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.726632 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dbw9p_a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8/istio-proxy/0.log" Jul 15 20:03:44.809813 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.809757 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gd4m_5a158cb5-f00b-44b6-a5ea-a98f557df640/exporter/0.log" Jul 15 20:03:44.891285 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.891258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gd4m_5a158cb5-f00b-44b6-a5ea-a98f557df640/extractor/0.log" Jul 15 20:03:44.939928 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.939900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c95658bf4-dxnlc_8bf20423-ddc3-46eb-afc3-5eecdb52e3b7/kube-auth-proxy/0.log" Jul 15 20:03:44.995006 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:44.994974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/0.log" Jul 15 20:03:45.028276 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:45.028243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/1.log" Jul 15 20:03:45.124737 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:45.124712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59d6798796-8ds8g_2a99eb45-c843-407d-93e8-a804e8f24025/router/0.log" Jul 15 20:03:46.433046 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:46.433019 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678dbw9p_a41dbeb4-54ae-4fcb-b63b-72d5dfe9fba8/istio-proxy/0.log" Jul 15 20:03:46.607837 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:46.607810 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c95658bf4-dxnlc_8bf20423-ddc3-46eb-afc3-5eecdb52e3b7/kube-auth-proxy/0.log" Jul 15 20:03:46.637671 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:46.637640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/0.log" Jul 15 20:03:46.672565 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:46.672538 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-jnsmz_979ceaea-7a23-40f2-81eb-030e3e98801c/istio-proxy/1.log" Jul 15 20:03:46.741644 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:46.741619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59d6798796-8ds8g_2a99eb45-c843-407d-93e8-a804e8f24025/router/0.log" Jul 15 20:03:47.861494 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:47.861463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kzqwl_93eefa20-9870-47e8-96b5-54b7d82a0ab8/manager/0.log" Jul 15 20:03:48.018059 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:48.018028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k42fw_d71c6892-bb80-4042-ae8c-a1e3064c869c/manager/0.log" Jul 15 20:03:48.173981 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:48.173951 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5jlbz_45b12b41-64d9-4cf5-b6a2-148e1c8b670e/server/0.log" Jul 15 20:03:48.261976 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:48.261941 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6zbr6_27636919-019d-42f5-881f-328506a2bc7a/manager/0.log" Jul 15 20:03:48.356223 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:48.356192 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-jmx2d_c94c412d-762b-4b28-bb59-21c52128bcf4/manager/0.log" Jul 15 20:03:48.401227 ip-10-0-139-42 kubenswrapper[2581]: I0715 20:03:48.401200 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-jmx2d_c94c412d-762b-4b28-bb59-21c52128bcf4/copy-manifests/0.log"