Jul 02 20:14:31.662706 ip-10-0-136-87 systemd[1]: Starting Kubernetes Kubelet... Jul 02 20:14:32.101238 ip-10-0-136-87 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 20:14:32.101238 ip-10-0-136-87 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 20:14:32.101238 ip-10-0-136-87 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 20:14:32.101238 ip-10-0-136-87 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 20:14:32.101238 ip-10-0-136-87 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 20:14:32.101238 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.093294 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104699 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104715 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104719 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104722 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104726 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104728 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104732 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104736 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104739 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104742 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104744 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104748 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104750 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104754 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104757 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104759 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104762 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104765 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104768 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:14:32.112826 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104770 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104773 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104775 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104778 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104780 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104783 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104785 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104790 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104793 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104796 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104798 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104801 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104803 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104805 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104809 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104811 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104814 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104819 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104823 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:14:32.118198 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104826 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104829 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104832 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104835 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104838 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104841 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104844 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104847 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104850 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104853 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104856 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104859 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104862 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104865 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104868 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104870 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104873 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104875 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104879 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104881 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:14:32.125111 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104884 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104886 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104889 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104891 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104894 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104896 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104899 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104901 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104904 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104906 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104909 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104912 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104916 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104920 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104923 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104926 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104929 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104933 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104937 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104939 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:14:32.130141 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104943 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104946 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104948 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104951 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104953 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104957 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104960 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104962 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104965 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104967 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104970 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104972 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104975 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104977 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104980 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104982 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104985 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104987 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104990 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:14:32.134176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104992 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.104995 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105736 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105744 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105747 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105751 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105756 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105761 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105764 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105767 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105770 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105773 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105775 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105778 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105781 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105783 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105786 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105788 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105791 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:14:32.138756 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105794 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105797 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105799 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105802 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105805 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105807 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105810 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105812 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105815 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105817 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105820 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105822 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105825 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105828 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105830 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105833 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105835 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105838 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105841 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105843 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:14:32.141376 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105848 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105850 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105853 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105856 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105859 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105861 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105864 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105867 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105869 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105872 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105875 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105878 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105880 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105883 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105886 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105888 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105891 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105895 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105900 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105903 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:14:32.145866 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105906 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105908 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105911 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105914 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105917 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105919 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105922 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105926 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105929 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105931 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105934 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105936 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105941 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105943 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105946 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105948 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105951 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105953 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105956 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:14:32.148122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105959 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105963 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105966 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105969 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105971 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105974 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105976 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105979 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105982 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105984 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105986 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105989 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105992 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105994 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105997 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.105999 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106002 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106005 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106007 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:14:32.152362 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106010 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106012 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106015 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106017 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106413 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106418 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106423 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106426 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106429 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106431 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106434 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106437 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106439 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106442 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106444 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106447 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106449 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106451 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106454 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106456 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:14:32.154655 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106460 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106462 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106465 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106467 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106471 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106475 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106478 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106481 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106484 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106487 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106489 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106492 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106500 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106503 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106505 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106508 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106510 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106512 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106516 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106519 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:14:32.158991 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106521 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106525 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106528 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106531 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106534 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106537 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106539 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106542 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106544 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106547 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106549 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106552 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106554 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106558 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106561 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106563 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106566 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106569 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106571 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:14:32.177349 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106574 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106577 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106579 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106582 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106584 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106587 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106590 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106593 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106596 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106598 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106601 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106604 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106607 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106609 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106612 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106614 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106617 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106620 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106622 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:14:32.180306 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106625 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106627 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106631 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106634 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106636 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106639 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106642 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106644 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106648 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106652 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106655 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106657 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106660 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106663 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106665 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106668 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106670 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106679 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106683 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106685 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:14:32.184336 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106688 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:14:32.183130 ip-10-0-136-87 systemd[1]: Started Kubernetes Kubelet. Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106691 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106693 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106696 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.106699 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106769 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106777 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106786 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106793 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106799 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106803 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106809 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106813 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106816 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106819 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106822 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106826 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106829 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106832 2573 flags.go:64] FLAG: --cgroup-root="" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106835 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106837 2573 flags.go:64] FLAG: --client-ca-file="" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106843 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106846 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 20:14:32.196323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106850 2573 flags.go:64] FLAG: --cluster-domain="" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106852 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106855 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106858 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106862 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106865 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106868 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106871 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106874 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106878 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106881 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106883 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106887 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106891 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106895 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106898 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106900 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106903 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106906 2573 flags.go:64] FLAG: --enable-server="true" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106909 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106914 2573 flags.go:64] FLAG: --event-burst="100" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106917 2573 flags.go:64] FLAG: --event-qps="50" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106920 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106923 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 20:14:32.199165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106925 2573 flags.go:64] FLAG: --eviction-hard="" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106930 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106933 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106935 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106939 2573 flags.go:64] FLAG: --eviction-soft="" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106941 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106946 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106950 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106952 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106955 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106958 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106961 2573 flags.go:64] FLAG: --feature-gates="" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106965 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106968 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106971 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106974 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106977 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106980 2573 flags.go:64] FLAG: --help="false" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106983 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106986 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106988 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106994 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.106997 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 20:14:32.203661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107000 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107004 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107007 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107009 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107012 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107015 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107018 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107021 2573 flags.go:64] FLAG: --kube-reserved="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107024 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107027 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107030 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107032 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107035 2573 flags.go:64] FLAG: --lock-file="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107038 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107041 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107045 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107050 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107053 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107056 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107059 2573 flags.go:64] FLAG: --logging-format="text" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107062 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107065 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107068 2573 flags.go:64] FLAG: --manifest-url="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107070 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107074 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 20:14:32.208079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107077 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107082 2573 flags.go:64] FLAG: --max-pods="110" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107084 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107087 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107090 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107096 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107099 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107102 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107105 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107113 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107116 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107119 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107122 2573 flags.go:64] FLAG: --pod-cidr="" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107124 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107130 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107133 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107136 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107139 2573 flags.go:64] FLAG: --port="10250" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107142 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107144 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f79e119ccf59fe6" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107148 2573 flags.go:64] FLAG: --qos-reserved="" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107150 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107154 2573 flags.go:64] FLAG: --register-node="true" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107157 2573 flags.go:64] FLAG: --register-with-taints="" Jul 02 20:14:32.213966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107161 2573 flags.go:64] FLAG: --registry-burst="10" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107164 2573 flags.go:64] FLAG: --registry-qps="5" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107167 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107170 2573 flags.go:64] FLAG: --reserved-memory="" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107173 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107176 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107179 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107182 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107185 2573 flags.go:64] FLAG: --runonce="false" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107188 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107191 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107194 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107197 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107200 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107204 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107207 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107210 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107213 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107216 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107219 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107221 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107224 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107227 2573 flags.go:64] FLAG: --system-cgroups="" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107230 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107235 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 20:14:32.372581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107238 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107240 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107244 2573 flags.go:64] FLAG: --tls-min-version="" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107247 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107250 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107255 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107258 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107261 2573 flags.go:64] FLAG: --v="2" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107264 2573 flags.go:64] FLAG: --version="false" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107269 2573 flags.go:64] FLAG: --vmodule="" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107273 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.107276 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107396 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107413 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107416 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107419 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107422 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107425 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107427 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107430 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107432 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107437 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107439 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:14:32.395545 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107442 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107445 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107447 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107450 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107452 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107455 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107458 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107460 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107463 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107465 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107468 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107470 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107473 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107475 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107481 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107485 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107488 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107491 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107493 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107497 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:14:32.397478 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107499 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107502 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107504 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107507 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107509 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107512 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107514 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107517 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107519 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107522 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107526 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107528 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107531 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107534 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107536 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107539 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107542 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107544 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107547 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:14:32.398235 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107549 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107552 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107554 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107557 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107559 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107562 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107564 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107569 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107572 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107575 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107578 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107580 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107583 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107590 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107593 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107595 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107598 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107600 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107603 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107605 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:14:32.399879 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107608 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107611 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107613 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107617 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107621 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107624 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107627 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107630 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107632 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107637 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107640 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107643 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107646 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107648 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107651 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107654 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107657 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107660 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107662 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:14:32.400683 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107666 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107669 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107671 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107674 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107676 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107679 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107681 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107684 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107687 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.107689 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.108411 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.116332 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.116354 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.116379 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.116392 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 20:14:32.402288 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116507 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116515 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116519 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116524 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116528 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116531 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116535 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116540 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116544 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116547 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116551 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116555 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116559 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116564 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116568 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116572 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116576 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116579 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116583 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116588 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:14:32.403112 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116593 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116597 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116602 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116608 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116612 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116617 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116621 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116624 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116628 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116634 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116638 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116642 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116646 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116650 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116654 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116658 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116664 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116669 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116673 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:14:32.404285 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116677 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116682 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116685 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116689 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116692 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116696 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116700 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116704 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116708 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116712 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116716 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116720 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116724 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116728 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116732 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116736 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116740 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116744 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116748 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116752 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:14:32.405090 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116756 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116760 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116763 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116768 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116772 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116776 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116779 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116783 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116787 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116790 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116795 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116798 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116803 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116806 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116811 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116815 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116818 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116822 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116826 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116831 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:14:32.406721 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116835 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116838 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116842 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116847 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116851 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116855 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116859 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116863 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116867 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116870 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116874 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116878 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116882 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116886 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116890 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116894 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116900 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116905 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116910 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:14:32.407532 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.116914 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.116921 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117087 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117094 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117099 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117103 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117107 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117111 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117120 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117125 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117129 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117133 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117138 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117142 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117147 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:14:32.410425 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117151 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117154 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117158 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117162 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117166 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117169 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117173 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117177 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117181 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117184 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117188 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117192 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117196 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117200 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117204 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117209 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117212 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117216 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117220 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117224 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:14:32.411212 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117228 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117232 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117235 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117239 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117243 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117249 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117253 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117256 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117260 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117264 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117268 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117272 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117276 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117280 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117286 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117290 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117295 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117300 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117303 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:14:32.412828 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117307 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117311 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117315 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117319 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117323 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117327 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117330 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117334 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117338 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117343 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117347 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117350 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117355 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117359 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117362 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117366 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117372 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117376 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117382 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:14:32.413650 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117386 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117391 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117395 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117421 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117426 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117430 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117434 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117438 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117441 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117445 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117449 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117453 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117457 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117461 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117465 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117469 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117472 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117476 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117480 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117486 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:14:32.414475 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117490 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117493 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117497 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117502 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117506 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117509 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117513 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:32.117517 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.117524 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.117670 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.120441 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.122200 2573 server.go:1019] "Starting client certificate rotation" Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.122299 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 20:14:32.415269 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.122330 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.125449 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.126984 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.141769 2573 log.go:25] "Validated CRI v1 runtime API" Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.144191 2573 log.go:25] "Validated CRI v1 image API" Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.145669 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.148168 2573 fs.go:135] Filesystem UUIDs: map[141e4de7-aa00-4245-829e-e2e40a78935e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 809708a9-9ac3-458c-a5a2-085ee6c9030e:/dev/nvme0n1p4] Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.148185 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 20:14:32.418392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.153501 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.154441 2573 manager.go:216] Machine: {Timestamp:2026-07-02 20:14:32.15232834 +0000 UTC m=+0.381954388 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112103 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22a6cd961fa4212b9833cf5c34edeb SystemUUID:ec22a6cd-961f-a421-2b98-33cf5c34edeb BootID:c3d00521-fa36-4337-9039-1f0c21d6dcba Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:c7:94:2c:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:c7:94:2c:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:f9:35:07:63:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.154551 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.154641 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.158329 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.158361 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.160014 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.160025 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.160033 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.161417 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.163669 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168461 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168595 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168624 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168633 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168650 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168661 2573 kubelet.go:398] "Adding apiserver pod source" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.168670 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 20:14:32.419605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.169129 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.169151 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.171513 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.174241 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.174279 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177348 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177366 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177372 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177378 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177387 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177393 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177419 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177427 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177435 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177440 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177449 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.177454 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.178426 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.178436 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.179885 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.179994 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.182185 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.182345 2573 server.go:1268] "Started kubelet" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.182837 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.188368 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.184313 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.196299 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.197259 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.200026 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.201218 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-87.ec2.internal.18be92381cae79ae default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-87.ec2.internal,UID:ip-10-0-136-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-87.ec2.internal,},FirstTimestamp:2026-07-02 20:14:32.182315438 +0000 UTC m=+0.411941486,LastTimestamp:2026-07-02 20:14:32.182315438 +0000 UTC m=+0.411941486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-87.ec2.internal,}" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.205052 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.205051 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.205251 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.205974 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.205992 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.205979 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.206501 2573 factory.go:55] Registering systemd factory Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.206518 2573 factory.go:223] Registration of the systemd container factory successfully Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208324 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208337 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208520 2573 factory.go:153] Registering CRI-O factory Jul 02 20:14:32.420235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208572 2573 factory.go:223] Registration of the crio container factory successfully Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208644 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208746 2573 factory.go:103] Registering Raw factory Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.208804 2573 manager.go:1196] Started watching for new ooms in manager Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.209537 2573 manager.go:349] Starting recovery of all containers Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.214144 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8kc4d" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.217294 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.219987 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8kc4d" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.220965 2573 manager.go:354] Recovery completed Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.224672 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.225517 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228216 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228246 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228260 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228805 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228818 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228824 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.228834 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.229591 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.229618 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.229630 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.230002 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.231006 2573 policy_none.go:49] "None policy: Start" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.231019 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.231028 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.232991 2573 policy_none.go:47] "Start" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.305632 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.359940 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.359979 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.360004 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.360036 2573 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.363126 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.423160 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429039 2573 manager.go:337] "Starting Device Plugin manager" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.429078 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429092 2573 server.go:87] "Starting device plugin registration server" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429361 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429373 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429458 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429533 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.429542 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.429544 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-87.ec2.internal\" not found" node="ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.430089 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.430142 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.460632 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal"] Jul 02 20:14:32.579435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.460707 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.461674 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.461696 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.461706 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464009 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464138 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464766 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464767 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464794 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464810 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464812 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.464841 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.467051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.467078 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.468043 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.468059 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.468068 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.491076 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-87.ec2.internal\" not found" node="ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.495579 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-87.ec2.internal\" not found" node="ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.524157 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b999edc2fdf380ea06e0ce75b2a467b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"b999edc2fdf380ea06e0ce75b2a467b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.524185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b999edc2fdf380ea06e0ce75b2a467b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"b999edc2fdf380ea06e0ce75b2a467b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.524203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ecdd7f5cd600edbcf6d8937cb7364b4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-87.ec2.internal\" (UID: \"1ecdd7f5cd600edbcf6d8937cb7364b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.530043 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.530970 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.530991 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.531001 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.531024 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.541484 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.541502 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-87.ec2.internal\": node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.580987 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.568494 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.703719 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.668694 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.768886 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.810327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b999edc2fdf380ea06e0ce75b2a467b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"b999edc2fdf380ea06e0ce75b2a467b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.810371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b999edc2fdf380ea06e0ce75b2a467b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"b999edc2fdf380ea06e0ce75b2a467b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.810392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ecdd7f5cd600edbcf6d8937cb7364b4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-87.ec2.internal\" (UID: \"1ecdd7f5cd600edbcf6d8937cb7364b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.810440 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ecdd7f5cd600edbcf6d8937cb7364b4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-87.ec2.internal\" (UID: \"1ecdd7f5cd600edbcf6d8937cb7364b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.810448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b999edc2fdf380ea06e0ce75b2a467b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"b999edc2fdf380ea06e0ce75b2a467b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:32.843387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:32.810460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b999edc2fdf380ea06e0ce75b2a467b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"b999edc2fdf380ea06e0ce75b2a467b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:33.014709 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.870913 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.014709 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:32.975288 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.129232 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.079829 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.129232 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.095103 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:33.129232 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.099764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 02 20:14:33.129232 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.122446 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 20:14:33.129232 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.122607 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 20:14:33.129232 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.122629 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 20:14:33.180626 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.180595 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.223868 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.223811 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 20:09:32 +0000 UTC" deadline="2027-12-09 11:40:28.71443372 +0000 UTC" Jul 02 20:14:33.223868 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.223857 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12591h25m55.490579612s" Jul 02 20:14:33.282602 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.282512 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.383506 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.383477 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.482947 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.482917 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:14:33.483640 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.483620 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.585277 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.585174 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.685916 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:33.685880 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 02 20:14:33.706772 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.706743 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:14:33.805591 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.805564 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 02 20:14:33.818616 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.818589 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 20:14:33.820031 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.820016 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 02 20:14:33.826544 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.826525 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 20:14:33.861445 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:33.861415 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb999edc2fdf380ea06e0ce75b2a467b3.slice/crio-ccee7f24d8bb2f42d61eb18fcb40b42a1d53c9189dde4406d016c05b00d33e0d WatchSource:0}: Error finding container ccee7f24d8bb2f42d61eb18fcb40b42a1d53c9189dde4406d016c05b00d33e0d: Status 404 returned error can't find the container with id ccee7f24d8bb2f42d61eb18fcb40b42a1d53c9189dde4406d016c05b00d33e0d Jul 02 20:14:33.862043 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:33.862023 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecdd7f5cd600edbcf6d8937cb7364b4.slice/crio-cba539ad791e2597d645a85a1883c85e6bc8df3818d53ebd339f868abfc607ff WatchSource:0}: Error finding container cba539ad791e2597d645a85a1883c85e6bc8df3818d53ebd339f868abfc607ff: Status 404 returned error can't find the container with id cba539ad791e2597d645a85a1883c85e6bc8df3818d53ebd339f868abfc607ff Jul 02 20:14:33.866940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:33.866916 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:14:34.144991 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.144897 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:14:34.172782 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.172739 2573 apiserver.go:52] "Watching apiserver" Jul 02 20:14:34.178016 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.177993 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 20:14:34.179228 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.179205 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-nnr94","kube-system/global-pull-secret-syncer-fc9mb","kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal","openshift-dns/node-resolver-psmhp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal","openshift-multus/multus-wph8f","openshift-multus/network-metrics-daemon-lq2dw","openshift-network-diagnostics/network-check-target-l7ssm","openshift-network-operator/iptables-alerter-z6gvf","kube-system/konnectivity-agent-vqtn2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4","openshift-cluster-node-tuning-operator/tuned-sqs2m","openshift-image-registry/node-ca-2v4jt","openshift-multus/multus-additional-cni-plugins-dwvm5"] Jul 02 20:14:34.183120 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.183104 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.183196 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.183176 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:34.185350 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.185336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.187237 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.187212 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 20:14:34.187506 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.187487 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.187583 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.187551 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5srvv\"" Jul 02 20:14:34.187631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.187601 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.187885 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.187864 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.189843 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.189823 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 20:14:34.189971 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.189848 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.190117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.190101 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rchhd\"" Jul 02 20:14:34.190220 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.190205 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.190290 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.190264 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 20:14:34.190376 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.190302 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 20:14:34.190376 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.190365 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.193274 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.192506 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.193274 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.192892 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96pdj\"" Jul 02 20:14:34.193274 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.193231 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.194355 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.194336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:34.194460 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.194397 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:34.196714 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.196697 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.198617 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.198597 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t72zp\"" Jul 02 20:14:34.198716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.198654 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 20:14:34.198979 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.198961 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.200928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.200907 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.201028 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.200971 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.201028 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.200983 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-24z9b\"" Jul 02 20:14:34.201147 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.201044 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 20:14:34.201408 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.201391 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.203424 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.203398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltlnm\"" Jul 02 20:14:34.203652 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.203606 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.203721 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.203700 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.203777 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.203727 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 20:14:34.203887 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.203870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.203969 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.203950 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:34.206009 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.205990 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 20:14:34.206244 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.206221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.208581 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.208560 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 20:14:34.208692 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.208613 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 20:14:34.208692 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.208638 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pwzwz\"" Jul 02 20:14:34.208867 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.208852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.210915 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.210896 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.211013 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.210898 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.211201 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.211182 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 20:14:34.211201 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.211195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.211353 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.211218 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 20:14:34.211353 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.211220 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 20:14:34.211555 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.211538 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2ts52\"" Jul 02 20:14:34.211832 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.211814 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 20:14:34.213285 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.213270 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:14:34.213631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.213607 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 20:14:34.213708 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.213693 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tkbjk\"" Jul 02 20:14:34.216152 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.216133 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 20:14:34.219756 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.219845 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219763 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa79b396-59d6-442a-b571-acd5c4aae7cf-host\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.219845 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ntcz\" (UniqueName: \"kubernetes.io/projected/fa79b396-59d6-442a-b571-acd5c4aae7cf-kube-api-access-2ntcz\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.219845 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-registration-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.219960 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-host-slash\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.219960 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-dbus\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.219960 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219927 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e6d1c3-c826-4e46-958f-0ba71390bd70-tmp-dir\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.220064 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-etc-kubernetes\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220064 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.219989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.220064 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-device-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.220064 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzpj\" (UniqueName: \"kubernetes.io/projected/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-kube-api-access-dtzpj\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.220219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-cnibin\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.220219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220091 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/402779b2-26bc-41cb-a41e-6ad8b986f920-agent-certs\") pod \"konnectivity-agent-vqtn2\" (UID: \"402779b2-26bc-41cb-a41e-6ad8b986f920\") " pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.220219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220133 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5e6d1c3-c826-4e46-958f-0ba71390bd70-hosts-file\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.220219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-k8s-cni-cncf-io\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220202 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/402779b2-26bc-41cb-a41e-6ad8b986f920-konnectivity-ca\") pod \"konnectivity-agent-vqtn2\" (UID: \"402779b2-26bc-41cb-a41e-6ad8b986f920\") " pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw4hm\" (UniqueName: \"kubernetes.io/projected/d5e6d1c3-c826-4e46-958f-0ba71390bd70-kube-api-access-bw4hm\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbsx8\" (UniqueName: \"kubernetes.io/projected/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-kube-api-access-pbsx8\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-socket-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-cni-bin\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-kubelet\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-sys-fs\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrmn9\" (UniqueName: \"kubernetes.io/projected/80339ccf-b5ba-4802-b7ed-85683cd123c6-kube-api-access-rrmn9\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsjl\" (UniqueName: \"kubernetes.io/projected/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-kube-api-access-bdsjl\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa79b396-59d6-442a-b571-acd5c4aae7cf-serviceca\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-os-release\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9eeb65e-7db1-449f-b52a-f17296528b06-cni-binary-copy\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-socket-dir-parent\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-hostroot\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-daemon-config\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-iptables-alerter-script\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-kubelet-config\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.220827 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220840 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-system-cni-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-netns\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-conf-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-system-cni-dir\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-os-release\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.220987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-cni-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.221014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-cnibin\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.221040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-cni-multus\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.221070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-multus-certs\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.221363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.221097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5g7l\" (UniqueName: \"kubernetes.io/projected/d9eeb65e-7db1-449f-b52a-f17296528b06-kube-api-access-r5g7l\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.240805 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.240783 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvswl" Jul 02 20:14:34.249817 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.249795 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvswl" Jul 02 20:14:34.306599 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.306573 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 20:14:34.322235 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322205 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-iptables-alerter-script\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.322358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovnkube-config\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.322358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-env-overrides\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.322358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5e6d1c3-c826-4e46-958f-0ba71390bd70-hosts-file\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.322358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-system-cni-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-netns\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-conf-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-os-release\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-system-cni-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-cni-netd\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-netns\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5e6d1c3-c826-4e46-958f-0ba71390bd70-hosts-file\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322445 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-conf-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-cnibin\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-os-release\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-cni-multus\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-cnibin\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-multus-certs\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-cni-multus\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.322562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322556 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e6d1c3-c826-4e46-958f-0ba71390bd70-tmp-dir\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-ovn\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-multus-certs\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqjb\" (UniqueName: \"kubernetes.io/projected/92574db6-84a0-45a0-bf40-27ca1a70ff46-kube-api-access-dvqjb\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b38cea36-902c-40b8-8daa-93ae96b371ec-tmp\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-host-slash\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322779 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-host-slash\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-var-lib-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-var-lib-kubelet\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322846 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-host\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322871 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-iptables-alerter-script\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-etc-kubernetes\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322921 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-etc-kubernetes\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzpj\" (UniqueName: \"kubernetes.io/projected/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-kube-api-access-dtzpj\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.323391 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e6d1c3-c826-4e46-958f-0ba71390bd70-tmp-dir\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-cnibin\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.322983 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysctl-d\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-cnibin\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/402779b2-26bc-41cb-a41e-6ad8b986f920-konnectivity-ca\") pod \"konnectivity-agent-vqtn2\" (UID: \"402779b2-26bc-41cb-a41e-6ad8b986f920\") " pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbsx8\" (UniqueName: \"kubernetes.io/projected/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-kube-api-access-pbsx8\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysctl-conf\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-systemd-units\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-kubelet\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-sys-fs\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323241 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-kubelet\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrmn9\" (UniqueName: \"kubernetes.io/projected/80339ccf-b5ba-4802-b7ed-85683cd123c6-kube-api-access-rrmn9\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsjl\" (UniqueName: \"kubernetes.io/projected/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-kube-api-access-bdsjl\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa79b396-59d6-442a-b571-acd5c4aae7cf-serviceca\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-node-log\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.324170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-sys-fs\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-dbus\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-os-release\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-daemon-config\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-os-release\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323567 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/402779b2-26bc-41cb-a41e-6ad8b986f920-konnectivity-ca\") pod \"konnectivity-agent-vqtn2\" (UID: \"402779b2-26bc-41cb-a41e-6ad8b986f920\") " pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-kubelet-config\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.323609 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-dbus\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323663 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-kubelet-config\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-cni-bin\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovnkube-script-lib\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.323742 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:34.823718127 +0000 UTC m=+3.053344184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysconfig\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-kubernetes\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa79b396-59d6-442a-b571-acd5c4aae7cf-host\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323859 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa79b396-59d6-442a-b571-acd5c4aae7cf-serviceca\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.324909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ntcz\" (UniqueName: \"kubernetes.io/projected/fa79b396-59d6-442a-b571-acd5c4aae7cf-kube-api-access-2ntcz\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/402779b2-26bc-41cb-a41e-6ad8b986f920-agent-certs\") pod \"konnectivity-agent-vqtn2\" (UID: \"402779b2-26bc-41cb-a41e-6ad8b986f920\") " pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323933 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa79b396-59d6-442a-b571-acd5c4aae7cf-host\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-system-cni-dir\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.323988 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-daemon-config\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80339ccf-b5ba-4802-b7ed-85683cd123c6-system-cni-dir\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324107 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovn-node-metrics-cert\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-cni-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5g7l\" (UniqueName: \"kubernetes.io/projected/d9eeb65e-7db1-449f-b52a-f17296528b06-kube-api-access-r5g7l\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-run-ovn-kubernetes\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-cni-dir\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-run\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-registration-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324249 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-etc-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.325634 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-systemd\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-tuned\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-device-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-registration-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324439 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-device-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-k8s-cni-cncf-io\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324494 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-run-k8s-cni-cncf-io\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324529 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw4hm\" (UniqueName: \"kubernetes.io/projected/d5e6d1c3-c826-4e46-958f-0ba71390bd70-kube-api-access-bw4hm\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-kubelet\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-slash\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.324622 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwq8\" (UniqueName: \"kubernetes.io/projected/b38cea36-902c-40b8-8daa-93ae96b371ec-kube-api-access-gjwq8\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-socket-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.326505 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.324669 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:14:34.824656869 +0000 UTC m=+3.054282903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-modprobe-d\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-socket-dir\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-lib-modules\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324805 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-run-netns\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-cni-bin\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-systemd\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-log-socket\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-sys\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-host-var-lib-cni-bin\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.324969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9eeb65e-7db1-449f-b52a-f17296528b06-cni-binary-copy\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-socket-dir-parent\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-hostroot\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.327267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.328101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-multus-socket-dir-parent\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.328101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9eeb65e-7db1-449f-b52a-f17296528b06-hostroot\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.328101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.328101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325463 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9eeb65e-7db1-449f-b52a-f17296528b06-cni-binary-copy\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.328101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.325561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80339ccf-b5ba-4802-b7ed-85683cd123c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.328784 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.328764 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/402779b2-26bc-41cb-a41e-6ad8b986f920-agent-certs\") pod \"konnectivity-agent-vqtn2\" (UID: \"402779b2-26bc-41cb-a41e-6ad8b986f920\") " pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.331318 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.331284 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:14:34.331318 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.331309 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:14:34.331514 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.331325 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:34.331514 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.331394 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:34.831375327 +0000 UTC m=+3.061001362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:34.333695 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.333665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsjl\" (UniqueName: \"kubernetes.io/projected/f023a1d8-4fc7-4ee2-abc9-b42abf613ab2-kube-api-access-bdsjl\") pod \"iptables-alerter-z6gvf\" (UID: \"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2\") " pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.333820 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.333769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5g7l\" (UniqueName: \"kubernetes.io/projected/d9eeb65e-7db1-449f-b52a-f17296528b06-kube-api-access-r5g7l\") pod \"multus-wph8f\" (UID: \"d9eeb65e-7db1-449f-b52a-f17296528b06\") " pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.334083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.334052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrmn9\" (UniqueName: \"kubernetes.io/projected/80339ccf-b5ba-4802-b7ed-85683cd123c6-kube-api-access-rrmn9\") pod \"multus-additional-cni-plugins-dwvm5\" (UID: \"80339ccf-b5ba-4802-b7ed-85683cd123c6\") " pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.334083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.334073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbsx8\" (UniqueName: \"kubernetes.io/projected/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-kube-api-access-pbsx8\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.334256 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.334196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzpj\" (UniqueName: \"kubernetes.io/projected/4f225c86-aa3d-4ca1-8d3d-ca411b76935f-kube-api-access-dtzpj\") pod \"aws-ebs-csi-driver-node-jg9j4\" (UID: \"4f225c86-aa3d-4ca1-8d3d-ca411b76935f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.334305 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.334257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ntcz\" (UniqueName: \"kubernetes.io/projected/fa79b396-59d6-442a-b571-acd5c4aae7cf-kube-api-access-2ntcz\") pod \"node-ca-2v4jt\" (UID: \"fa79b396-59d6-442a-b571-acd5c4aae7cf\") " pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.334349 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.334306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw4hm\" (UniqueName: \"kubernetes.io/projected/d5e6d1c3-c826-4e46-958f-0ba71390bd70-kube-api-access-bw4hm\") pod \"node-resolver-psmhp\" (UID: \"d5e6d1c3-c826-4e46-958f-0ba71390bd70\") " pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.364788 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.364727 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" event={"ID":"1ecdd7f5cd600edbcf6d8937cb7364b4","Type":"ContainerStarted","Data":"cba539ad791e2597d645a85a1883c85e6bc8df3818d53ebd339f868abfc607ff"} Jul 02 20:14:34.365862 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.365836 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"b999edc2fdf380ea06e0ce75b2a467b3","Type":"ContainerStarted","Data":"ccee7f24d8bb2f42d61eb18fcb40b42a1d53c9189dde4406d016c05b00d33e0d"} Jul 02 20:14:34.425551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysctl-d\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.425551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysctl-conf\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.425551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-systemd-units\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-systemd-units\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-node-log\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-cni-bin\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysctl-d\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysctl-conf\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-node-log\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425699 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-cni-bin\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovnkube-script-lib\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysconfig\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-kubernetes\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.425797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-sysconfig\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovn-node-metrics-cert\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-kubernetes\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-run-ovn-kubernetes\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-run-ovn-kubernetes\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-run\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-etc-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-systemd\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-tuned\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.425986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-systemd\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-kubelet\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-slash\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426042 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-run\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwq8\" (UniqueName: \"kubernetes.io/projected/b38cea36-902c-40b8-8daa-93ae96b371ec-kube-api-access-gjwq8\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426074 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-kubelet\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-slash\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.426264 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426085 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-etc-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-modprobe-d\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-lib-modules\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-run-netns\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-systemd\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-log-socket\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-modprobe-d\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-systemd\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-sys\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-log-socket\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-sys\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426302 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovnkube-script-lib\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-lib-modules\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-run-netns\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovnkube-config\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.427218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-env-overrides\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-cni-netd\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-ovn\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-run-ovn\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqjb\" (UniqueName: \"kubernetes.io/projected/92574db6-84a0-45a0-bf40-27ca1a70ff46-kube-api-access-dvqjb\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-host-cni-netd\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b38cea36-902c-40b8-8daa-93ae96b371ec-tmp\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-var-lib-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-var-lib-kubelet\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426726 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-host\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426818 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-host\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92574db6-84a0-45a0-bf40-27ca1a70ff46-var-lib-openvswitch\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b38cea36-902c-40b8-8daa-93ae96b371ec-var-lib-kubelet\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426902 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-env-overrides\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.426921 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovnkube-config\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428733 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.428289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92574db6-84a0-45a0-bf40-27ca1a70ff46-ovn-node-metrics-cert\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.428733 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.428615 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b38cea36-902c-40b8-8daa-93ae96b371ec-tmp\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.428733 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.428658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b38cea36-902c-40b8-8daa-93ae96b371ec-etc-tuned\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.437082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.437050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqjb\" (UniqueName: \"kubernetes.io/projected/92574db6-84a0-45a0-bf40-27ca1a70ff46-kube-api-access-dvqjb\") pod \"ovnkube-node-nnr94\" (UID: \"92574db6-84a0-45a0-bf40-27ca1a70ff46\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.437082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.437068 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwq8\" (UniqueName: \"kubernetes.io/projected/b38cea36-902c-40b8-8daa-93ae96b371ec-kube-api-access-gjwq8\") pod \"tuned-sqs2m\" (UID: \"b38cea36-902c-40b8-8daa-93ae96b371ec\") " pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.497113 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.497076 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" Jul 02 20:14:34.503498 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.503460 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" Jul 02 20:14:34.507869 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.507836 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f225c86_aa3d_4ca1_8d3d_ca411b76935f.slice/crio-a7e18e6590609154c8472d5e1324b44b64f494448d3822e662b18fe5d8a3f490 WatchSource:0}: Error finding container a7e18e6590609154c8472d5e1324b44b64f494448d3822e662b18fe5d8a3f490: Status 404 returned error can't find the container with id a7e18e6590609154c8472d5e1324b44b64f494448d3822e662b18fe5d8a3f490 Jul 02 20:14:34.510613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.510586 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psmhp" Jul 02 20:14:34.514200 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.514170 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80339ccf_b5ba_4802_b7ed_85683cd123c6.slice/crio-26f92eda3d0d734a1e5ffe173d9fcbf3dbccb6e166ef1874a300728816b5f02c WatchSource:0}: Error finding container 26f92eda3d0d734a1e5ffe173d9fcbf3dbccb6e166ef1874a300728816b5f02c: Status 404 returned error can't find the container with id 26f92eda3d0d734a1e5ffe173d9fcbf3dbccb6e166ef1874a300728816b5f02c Jul 02 20:14:34.515377 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.515356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wph8f" Jul 02 20:14:34.521894 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.521855 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e6d1c3_c826_4e46_958f_0ba71390bd70.slice/crio-f01c76d6d95eb47c67433afd1d03fb67e4d7ad2dfa77f330996378684894e4bb WatchSource:0}: Error finding container f01c76d6d95eb47c67433afd1d03fb67e4d7ad2dfa77f330996378684894e4bb: Status 404 returned error can't find the container with id f01c76d6d95eb47c67433afd1d03fb67e4d7ad2dfa77f330996378684894e4bb Jul 02 20:14:34.523265 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.522922 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z6gvf" Jul 02 20:14:34.528266 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.528242 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9eeb65e_7db1_449f_b52a_f17296528b06.slice/crio-6b3215f944b1084973292a94ee2f50256a72586b8ae6063a3c6297de759b4048 WatchSource:0}: Error finding container 6b3215f944b1084973292a94ee2f50256a72586b8ae6063a3c6297de759b4048: Status 404 returned error can't find the container with id 6b3215f944b1084973292a94ee2f50256a72586b8ae6063a3c6297de759b4048 Jul 02 20:14:34.528999 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.528932 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2v4jt" Jul 02 20:14:34.535355 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.535332 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:34.536888 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.536860 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf023a1d8_4fc7_4ee2_abc9_b42abf613ab2.slice/crio-ed369a5467a1c75196716dda573d66e1a07308a09f55cffe117685390cc29c03 WatchSource:0}: Error finding container ed369a5467a1c75196716dda573d66e1a07308a09f55cffe117685390cc29c03: Status 404 returned error can't find the container with id ed369a5467a1c75196716dda573d66e1a07308a09f55cffe117685390cc29c03 Jul 02 20:14:34.540434 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.540414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:14:34.540569 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.540535 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa79b396_59d6_442a_b571_acd5c4aae7cf.slice/crio-0afb4dcd50914a6984a94610358b906e3b83544d6f9ecf70fa7e511297006a0f WatchSource:0}: Error finding container 0afb4dcd50914a6984a94610358b906e3b83544d6f9ecf70fa7e511297006a0f: Status 404 returned error can't find the container with id 0afb4dcd50914a6984a94610358b906e3b83544d6f9ecf70fa7e511297006a0f Jul 02 20:14:34.546378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.546022 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" Jul 02 20:14:34.547034 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.547008 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402779b2_26bc_41cb_a41e_6ad8b986f920.slice/crio-0fae3f1cef92c26c77eaf016a3b0f866f8a3b2302bfaca5170c1f95c8c0150dd WatchSource:0}: Error finding container 0fae3f1cef92c26c77eaf016a3b0f866f8a3b2302bfaca5170c1f95c8c0150dd: Status 404 returned error can't find the container with id 0fae3f1cef92c26c77eaf016a3b0f866f8a3b2302bfaca5170c1f95c8c0150dd Jul 02 20:14:34.556966 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.556938 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92574db6_84a0_45a0_bf40_27ca1a70ff46.slice/crio-fa13fac1f1fda3740da8cf3f693ec99fa1a5526acc049e952b0ea96762212c19 WatchSource:0}: Error finding container fa13fac1f1fda3740da8cf3f693ec99fa1a5526acc049e952b0ea96762212c19: Status 404 returned error can't find the container with id fa13fac1f1fda3740da8cf3f693ec99fa1a5526acc049e952b0ea96762212c19 Jul 02 20:14:34.563267 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:14:34.563242 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38cea36_902c_40b8_8daa_93ae96b371ec.slice/crio-877b5b70569574d4c0856886a68fac7f9418c68893bba8b5616d0412eef1522f WatchSource:0}: Error finding container 877b5b70569574d4c0856886a68fac7f9418c68893bba8b5616d0412eef1522f: Status 404 returned error can't find the container with id 877b5b70569574d4c0856886a68fac7f9418c68893bba8b5616d0412eef1522f Jul 02 20:14:34.645342 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.645272 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:14:34.830140 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.830105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:34.830320 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.830192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:34.830320 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.830242 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:34.830320 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.830321 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:14:35.830301684 +0000 UTC m=+4.059927723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:34.830627 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.830331 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:34.830627 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.830384 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:35.830367083 +0000 UTC m=+4.059993118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:34.930798 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:34.930762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:34.930999 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.930951 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:14:34.930999 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.930971 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:14:34.930999 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.930981 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:34.931124 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:34.931042 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:35.931022535 +0000 UTC m=+4.160648600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:35.253661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.253523 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:09:34 +0000 UTC" deadline="2028-02-16 00:49:07.389820849 +0000 UTC" Jul 02 20:14:35.253661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.253594 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14236h34m32.136231607s" Jul 02 20:14:35.377333 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.377293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"fa13fac1f1fda3740da8cf3f693ec99fa1a5526acc049e952b0ea96762212c19"} Jul 02 20:14:35.384589 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.384473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2v4jt" event={"ID":"fa79b396-59d6-442a-b571-acd5c4aae7cf","Type":"ContainerStarted","Data":"0afb4dcd50914a6984a94610358b906e3b83544d6f9ecf70fa7e511297006a0f"} Jul 02 20:14:35.387999 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.387922 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6gvf" event={"ID":"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2","Type":"ContainerStarted","Data":"ed369a5467a1c75196716dda573d66e1a07308a09f55cffe117685390cc29c03"} Jul 02 20:14:35.390610 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.390540 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wph8f" event={"ID":"d9eeb65e-7db1-449f-b52a-f17296528b06","Type":"ContainerStarted","Data":"6b3215f944b1084973292a94ee2f50256a72586b8ae6063a3c6297de759b4048"} Jul 02 20:14:35.394644 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.394614 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psmhp" event={"ID":"d5e6d1c3-c826-4e46-958f-0ba71390bd70","Type":"ContainerStarted","Data":"f01c76d6d95eb47c67433afd1d03fb67e4d7ad2dfa77f330996378684894e4bb"} Jul 02 20:14:35.400321 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.400255 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" event={"ID":"b38cea36-902c-40b8-8daa-93ae96b371ec","Type":"ContainerStarted","Data":"877b5b70569574d4c0856886a68fac7f9418c68893bba8b5616d0412eef1522f"} Jul 02 20:14:35.409710 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.409617 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqtn2" event={"ID":"402779b2-26bc-41cb-a41e-6ad8b986f920","Type":"ContainerStarted","Data":"0fae3f1cef92c26c77eaf016a3b0f866f8a3b2302bfaca5170c1f95c8c0150dd"} Jul 02 20:14:35.416403 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.416370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerStarted","Data":"26f92eda3d0d734a1e5ffe173d9fcbf3dbccb6e166ef1874a300728816b5f02c"} Jul 02 20:14:35.419757 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.419697 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" event={"ID":"4f225c86-aa3d-4ca1-8d3d-ca411b76935f","Type":"ContainerStarted","Data":"a7e18e6590609154c8472d5e1324b44b64f494448d3822e662b18fe5d8a3f490"} Jul 02 20:14:35.839258 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.839220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:35.839450 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.839307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:35.839564 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.839482 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:35.839564 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.839543 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:37.839524037 +0000 UTC m=+6.069150074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:35.839971 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.839946 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:35.840030 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.840019 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:14:37.840000461 +0000 UTC m=+6.069626515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:35.940122 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:35.940080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:35.940334 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.940295 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:14:35.940334 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.940321 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:14:35.940334 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.940337 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:35.940629 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:35.940403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:37.940381311 +0000 UTC m=+6.170007370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:36.254013 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:36.253946 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:09:34 +0000 UTC" deadline="2028-03-06 08:59:29.921218636 +0000 UTC" Jul 02 20:14:36.254013 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:36.253981 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14700h44m53.667242009s" Jul 02 20:14:36.362308 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:36.361600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:36.362308 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:36.361734 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:36.362308 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:36.362144 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:36.362308 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:36.362237 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:36.362965 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:36.362798 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:36.362965 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:36.362913 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:37.858051 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:37.857605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:37.858051 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.857782 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:37.858051 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:37.857984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:37.858051 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.858037 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:14:41.858018322 +0000 UTC m=+10.087644369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:37.858771 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.858138 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:37.858771 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.858201 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:41.858183041 +0000 UTC m=+10.087809090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:37.958593 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:37.958531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:37.958778 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.958739 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:14:37.958778 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.958764 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:14:37.958778 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.958780 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:37.958962 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:37.958867 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:41.958846872 +0000 UTC m=+10.188472933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:38.362531 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:38.361577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:38.362531 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:38.361734 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:38.362531 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:38.362110 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:38.362531 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:38.362239 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:38.362531 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:38.362440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:38.362980 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:38.362554 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:40.360918 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:40.360817 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:40.361393 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:40.360931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:40.361393 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:40.360945 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:40.361393 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:40.360943 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:40.361393 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:40.361025 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:40.361393 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:40.361121 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:41.893467 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:41.893429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:41.893928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:41.893545 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:41.893928 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.893677 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:41.893928 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.893749 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:41.893928 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.893754 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:49.89373256 +0000 UTC m=+18.123358597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:41.893928 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.893818 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:14:49.893800248 +0000 UTC m=+18.123426293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:41.994624 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:41.994583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:41.994823 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.994761 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:14:41.994823 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.994790 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:14:41.994823 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.994805 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:41.994983 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:41.994873 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:14:49.994856272 +0000 UTC m=+18.224482307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:42.362007 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:42.361970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:42.362198 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:42.362086 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:42.362319 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:42.362294 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:42.362438 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:42.362356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:42.362506 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:42.362471 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:42.362609 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:42.362583 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:44.360976 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:44.360941 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:44.361433 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:44.361074 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:44.361433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:44.360941 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:44.361433 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:44.361195 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:44.361433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:44.361219 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:44.361433 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:44.361281 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:46.366489 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:46.366455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:46.366489 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:46.366481 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:46.367073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:46.366455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:46.367073 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:46.366577 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:46.367073 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:46.366711 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:46.367073 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:46.366804 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:46.450832 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:46.450799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" event={"ID":"1ecdd7f5cd600edbcf6d8937cb7364b4","Type":"ContainerStarted","Data":"2f1a8697e4c827903d94067ac97ac0d3ca5649728b342ade1d1caafeeb935b6c"} Jul 02 20:14:46.464640 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:46.464589 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" podStartSLOduration=12.464573944 podStartE2EDuration="12.464573944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:46.464255229 +0000 UTC m=+14.693881283" watchObservedRunningTime="2026-07-02 20:14:46.464573944 +0000 UTC m=+14.694199991" Jul 02 20:14:47.455069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:47.454972 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psmhp" event={"ID":"d5e6d1c3-c826-4e46-958f-0ba71390bd70","Type":"ContainerStarted","Data":"20d7c9bbd77fbf8030c722cd40994b15bffe47b46639df1849669d24b97e6b8e"} Jul 02 20:14:47.456630 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:47.456593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"b999edc2fdf380ea06e0ce75b2a467b3","Type":"ContainerStarted","Data":"ef898e553988d65c8e0e4ab332955bffe9499c6f0d2d2d421168e20405f9599e"} Jul 02 20:14:47.458287 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:47.458259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" event={"ID":"4f225c86-aa3d-4ca1-8d3d-ca411b76935f","Type":"ContainerStarted","Data":"89f97b0aea7d553ea00769158a3be81225c797b11fd56621eeddb55b89f1686c"} Jul 02 20:14:47.473499 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:47.473424 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-psmhp" podStartSLOduration=3.221823052 podStartE2EDuration="14.473386897s" totalImagesPullingTime="11.251563845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:47.47308862 +0000 UTC m=+15.702714676" watchObservedRunningTime="2026-07-02 20:14:47.473386897 +0000 UTC m=+15.703012952" Jul 02 20:14:48.361044 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:48.361008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:48.361210 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:48.361009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:48.361210 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:48.361139 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:48.361210 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:48.361009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:48.361388 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:48.361221 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:48.361388 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:48.361312 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:49.954562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:49.954522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:49.955089 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:49.954599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:49.955089 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:49.954711 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:49.955089 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:49.954781 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:05.954762544 +0000 UTC m=+34.184388599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:14:49.955089 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:49.954720 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:49.955089 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:49.954850 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:15:05.954833986 +0000 UTC m=+34.184460037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:14:50.055156 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:50.055115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:50.055340 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.055255 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:14:50.055340 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.055278 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:14:50.055340 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.055290 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:50.055522 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.055354 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:06.055337485 +0000 UTC m=+34.284963538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:14:50.360584 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:50.360550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:50.360584 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:50.360572 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:50.360792 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:50.360550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:50.360792 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.360676 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:50.360792 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.360730 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:50.360933 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:50.360810 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:50.465691 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:50.465648 2573 generic.go:356] "Generic (PLEG): container finished" podID="b999edc2fdf380ea06e0ce75b2a467b3" containerID="ef898e553988d65c8e0e4ab332955bffe9499c6f0d2d2d421168e20405f9599e" exitCode=0 Jul 02 20:14:50.465880 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:50.465725 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"b999edc2fdf380ea06e0ce75b2a467b3","Type":"ContainerDied","Data":"ef898e553988d65c8e0e4ab332955bffe9499c6f0d2d2d421168e20405f9599e"} Jul 02 20:14:52.361780 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:52.361745 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:52.362241 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:52.361856 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:52.362241 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:52.361941 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:52.362241 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:52.362024 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:52.362241 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:52.362046 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:52.362241 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:52.362169 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:54.360470 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:54.360432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:54.360839 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:54.360480 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:54.360839 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:54.360432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:54.360839 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:54.360540 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:54.360839 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:54.360637 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:54.360839 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:54.360716 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:55.396044 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.395775 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 20:14:55.440260 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.440183 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T20:14:55.396038573Z","UUID":"e755e0c8-faa0-4915-8a66-12eceeb24fce","Handler":null,"Name":"","Endpoint":""} Jul 02 20:14:55.441539 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.441515 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 20:14:55.441539 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.441541 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 20:14:55.487277 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.487246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqtn2" event={"ID":"402779b2-26bc-41cb-a41e-6ad8b986f920","Type":"ContainerStarted","Data":"2a45e69981ce8fa2b785f97137c01d86eb18d5fdc5b4f64737b37334823c6c20"} Jul 02 20:14:55.490794 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.489262 2573 generic.go:356] "Generic (PLEG): container finished" podID="80339ccf-b5ba-4802-b7ed-85683cd123c6" containerID="11ec3456645b104dbf8fff41fe5a2af52373c6e6548b00b8ea887126c9a9275e" exitCode=0 Jul 02 20:14:55.490794 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.489442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerDied","Data":"11ec3456645b104dbf8fff41fe5a2af52373c6e6548b00b8ea887126c9a9275e"} Jul 02 20:14:55.494282 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.494257 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" event={"ID":"4f225c86-aa3d-4ca1-8d3d-ca411b76935f","Type":"ContainerStarted","Data":"a88996507bf8214c37243982bcc7173f69291feb0ba60f559c708bc64c11155d"} Jul 02 20:14:55.498699 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.498672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"f8063f66867b4a4b9e375d033881ad3d3228d46d5bfb4e01e34f69c3db85aab1"} Jul 02 20:14:55.498800 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.498756 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"89e23f926e3cb79374a7620d343fc91f5863721b00d27e8e00d8f295b32f6ab1"} Jul 02 20:14:55.498846 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.498806 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"e3d81f2e7e82a0637ca6f0663fff9cfadd5e8fb7810ab49603e4a23ceb45392d"} Jul 02 20:14:55.498878 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.498853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"35b39bc7c3b718ec074a961d45bd06a5c4065ceffeff3b882f397ed6d3512b52"} Jul 02 20:14:55.498917 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.498899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"ef71cd29ed835140a978c6d4d4c13902f92659d3c490a104d5044783e93bb297"} Jul 02 20:14:55.499994 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.499950 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2v4jt" event={"ID":"fa79b396-59d6-442a-b571-acd5c4aae7cf","Type":"ContainerStarted","Data":"3122ca23e6bc4d883b58abe9bbf65aaa1ba3297e9e160979fbfd663e2cd2e6f8"} Jul 02 20:14:55.501137 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.501119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wph8f" event={"ID":"d9eeb65e-7db1-449f-b52a-f17296528b06","Type":"ContainerStarted","Data":"158d29f755d91beb3e774631c5908c74e1bcef11f7f7c607183056243c5a116b"} Jul 02 20:14:55.502668 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.502650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"b999edc2fdf380ea06e0ce75b2a467b3","Type":"ContainerStarted","Data":"fcc2df9b6ce650979681093cf457d75813f8214d4fa1f2e64de7f4766dc1b468"} Jul 02 20:14:55.503749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.503726 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" event={"ID":"b38cea36-902c-40b8-8daa-93ae96b371ec","Type":"ContainerStarted","Data":"16b9d1d2feadb77dc2f016627116830ab4d654d4378484cd4d27f095343b9d55"} Jul 02 20:14:55.507382 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.507344 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vqtn2" podStartSLOduration=11.231467347 podStartE2EDuration="22.507333846s" totalImagesPullingTime="11.275866499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:55.507029014 +0000 UTC m=+23.736655068" watchObservedRunningTime="2026-07-02 20:14:55.507333846 +0000 UTC m=+23.736959967" Jul 02 20:14:55.539706 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.539647 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wph8f" podStartSLOduration=2.667068708 podStartE2EDuration="22.539626348s" totalImagesPullingTime="19.87255764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:55.539113934 +0000 UTC m=+23.768739989" watchObservedRunningTime="2026-07-02 20:14:55.539626348 +0000 UTC m=+23.769252403" Jul 02 20:14:55.552472 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.552431 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2v4jt" podStartSLOduration=11.294996828 podStartE2EDuration="22.552413058s" totalImagesPullingTime="11.25741623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:55.551716878 +0000 UTC m=+23.781342932" watchObservedRunningTime="2026-07-02 20:14:55.552413058 +0000 UTC m=+23.782039112" Jul 02 20:14:55.570602 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.570565 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sqs2m" podStartSLOduration=11.297997324 podStartE2EDuration="22.570549752s" totalImagesPullingTime="11.272552428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:55.570274952 +0000 UTC m=+23.799901007" watchObservedRunningTime="2026-07-02 20:14:55.570549752 +0000 UTC m=+23.800175806" Jul 02 20:14:55.882233 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.882156 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:55.882762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.882745 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:55.896777 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:55.896718 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" podStartSLOduration=21.896699169 podStartE2EDuration="21.896699169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:55.585505295 +0000 UTC m=+23.815131349" watchObservedRunningTime="2026-07-02 20:14:55.896699169 +0000 UTC m=+24.126325220" Jul 02 20:14:56.361226 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.361181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:56.361512 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.361194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:56.361512 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:56.361307 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:56.361512 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.361328 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:56.361512 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:56.361465 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:56.361689 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:56.361554 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:56.508770 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.508735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"5f7d1fbc5ca7fe4558a41052b92c9b170f5ce8efb745eb7af4ec4fa448418cb0"} Jul 02 20:14:56.509996 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.509964 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z6gvf" event={"ID":"f023a1d8-4fc7-4ee2-abc9-b42abf613ab2","Type":"ContainerStarted","Data":"086ef2293ac2bb867d8d82a1997021219d79da2a5bc27b67ebf5f65aa20bdf26"} Jul 02 20:14:56.510436 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.510416 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:56.510651 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.510634 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vqtn2" Jul 02 20:14:56.535544 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:56.535497 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z6gvf" podStartSLOduration=12.251902385 podStartE2EDuration="23.535480014s" totalImagesPullingTime="11.283577629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:56.523307207 +0000 UTC m=+24.752933262" watchObservedRunningTime="2026-07-02 20:14:56.535480014 +0000 UTC m=+24.765106068" Jul 02 20:14:57.514621 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:57.514421 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" event={"ID":"4f225c86-aa3d-4ca1-8d3d-ca411b76935f","Type":"ContainerStarted","Data":"f9c014ce8fa029c9576d9c072d4456c06e78a4be4cfad14af2570c91f8731b59"} Jul 02 20:14:57.533377 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:57.533334 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg9j4" podStartSLOduration=4.054934488 podStartE2EDuration="24.533319233s" totalImagesPullingTime="20.478384745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:57.532952139 +0000 UTC m=+25.762578193" watchObservedRunningTime="2026-07-02 20:14:57.533319233 +0000 UTC m=+25.762945286" Jul 02 20:14:58.360829 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:58.360792 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:14:58.361017 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:58.360794 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:14:58.361017 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:58.360923 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:14:58.361017 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:58.360917 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:14:58.361181 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:58.361048 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:14:58.361181 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:14:58.361119 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:14:58.520594 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:14:58.520552 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"d04f24931d1e441106e389d0e1ab2f6bf4b96ef1142621bfe2c1e7757c33b453"} Jul 02 20:15:00.361596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.361320 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:00.362267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.361327 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:00.362267 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:00.361697 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:15:00.362267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.361327 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:00.362267 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:00.361803 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:15:00.362267 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:00.361855 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:15:00.529496 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.529463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" event={"ID":"92574db6-84a0-45a0-bf40-27ca1a70ff46","Type":"ContainerStarted","Data":"e4ad50c411a67e67434d85a44c09c3cf7cb4c19e7b5266dce5b23068dbb94061"} Jul 02 20:15:00.529751 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.529727 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:15:00.546527 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.546501 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:15:00.554161 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:00.554111 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" podStartSLOduration=7.591859225 podStartE2EDuration="27.554093513s" totalImagesPullingTime="19.962234288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:00.55285093 +0000 UTC m=+28.782476984" watchObservedRunningTime="2026-07-02 20:15:00.554093513 +0000 UTC m=+28.783719567" Jul 02 20:15:01.532260 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:01.532231 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:15:01.532778 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:01.532329 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:15:01.548933 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:01.548906 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:15:02.087796 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.087764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fc9mb"] Jul 02 20:15:02.087957 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.087902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:02.088000 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:02.087981 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:15:02.091159 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.091128 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l7ssm"] Jul 02 20:15:02.091306 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.091243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:02.091356 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:02.091326 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:15:02.091699 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.091619 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lq2dw"] Jul 02 20:15:02.091795 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.091734 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:02.091865 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:02.091839 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:15:02.535616 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.535583 2573 generic.go:356] "Generic (PLEG): container finished" podID="80339ccf-b5ba-4802-b7ed-85683cd123c6" containerID="ef9112754bb566bc851f556ac67da5586576eadaf9a4a3960c5da4cf9e3455ff" exitCode=0 Jul 02 20:15:02.535987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:02.535665 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerDied","Data":"ef9112754bb566bc851f556ac67da5586576eadaf9a4a3960c5da4cf9e3455ff"} Jul 02 20:15:03.360757 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:03.360544 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:03.360930 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:03.360575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:03.360930 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:03.360869 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:15:03.360930 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:03.360905 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:15:03.540384 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:03.540356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerStarted","Data":"7fedf806acd246ea1fafcbc1400e2f8e0021d52d624184c2a02e7aacd80b8d7d"} Jul 02 20:15:04.360705 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:04.360670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:04.360866 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:04.360789 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:15:04.544372 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:04.544328 2573 generic.go:356] "Generic (PLEG): container finished" podID="80339ccf-b5ba-4802-b7ed-85683cd123c6" containerID="7fedf806acd246ea1fafcbc1400e2f8e0021d52d624184c2a02e7aacd80b8d7d" exitCode=0 Jul 02 20:15:04.544869 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:04.544415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerDied","Data":"7fedf806acd246ea1fafcbc1400e2f8e0021d52d624184c2a02e7aacd80b8d7d"} Jul 02 20:15:05.360477 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:05.360446 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:05.360624 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:05.360453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:05.360624 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:05.360558 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc9mb" podUID="1f158ad7-3cb9-4535-b637-45ca7f8aebd6" Jul 02 20:15:05.360720 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:05.360642 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l7ssm" podUID="827ad922-ad46-4c22-a872-f0441bfdd1b3" Jul 02 20:15:05.549552 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:05.549518 2573 generic.go:356] "Generic (PLEG): container finished" podID="80339ccf-b5ba-4802-b7ed-85683cd123c6" containerID="91b061e4b0b608b9c488fec5caeb9b678be16da284d2a04fd8b0b1e5fd0b0189" exitCode=0 Jul 02 20:15:05.550129 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:05.549559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerDied","Data":"91b061e4b0b608b9c488fec5caeb9b678be16da284d2a04fd8b0b1e5fd0b0189"} Jul 02 20:15:05.978867 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:05.978785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:05.978867 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:05.978841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:05.979038 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:05.978924 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:15:05.979038 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:05.978925 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:15:05.979038 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:05.978975 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret podName:1f158ad7-3cb9-4535-b637-45ca7f8aebd6 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:37.978961957 +0000 UTC m=+66.208587990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret") pod "global-pull-secret-syncer-fc9mb" (UID: "1f158ad7-3cb9-4535-b637-45ca7f8aebd6") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:15:05.979038 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:05.978987 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:15:37.97898169 +0000 UTC m=+66.208607723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:15:06.080161 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:06.080127 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:06.080324 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:06.080292 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:15:06.080324 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:06.080310 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:15:06.080324 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:06.080320 2573 projected.go:196] Error preparing data for projected volume kube-api-access-cqhbx for pod openshift-network-diagnostics/network-check-target-l7ssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:15:06.080459 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:06.080380 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx podName:827ad922-ad46-4c22-a872-f0441bfdd1b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:38.080365289 +0000 UTC m=+66.309991325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqhbx" (UniqueName: "kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx") pod "network-check-target-l7ssm" (UID: "827ad922-ad46-4c22-a872-f0441bfdd1b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:15:06.361144 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:06.361062 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:06.361295 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:06.361203 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:15:07.013815 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.013788 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeReady" Jul 02 20:15:07.014426 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.013938 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 20:15:07.079622 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.079585 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-l28dq"] Jul 02 20:15:07.082510 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.082481 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.086202 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.086168 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d6489d8c6-9z6lz"] Jul 02 20:15:07.088943 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.088920 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.091716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.091449 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7jgs\"" Jul 02 20:15:07.091716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.091473 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 20:15:07.091716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.091513 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 20:15:07.091716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.091450 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 20:15:07.091716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.091648 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 20:15:07.091981 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.091828 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-grp4t\"" Jul 02 20:15:07.096958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.096932 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 20:15:07.097207 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.096948 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 20:15:07.127674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.127579 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-l28dq"] Jul 02 20:15:07.128882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.128855 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6489d8c6-9z6lz"] Jul 02 20:15:07.146416 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.146368 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n7p4j"] Jul 02 20:15:07.150082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.150065 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k779v"] Jul 02 20:15:07.150197 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.150180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.152643 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.152627 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.157248 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.157233 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 20:15:07.157381 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.157365 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 20:15:07.157785 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.157758 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 20:15:07.157879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.157790 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7swmr\"" Jul 02 20:15:07.157879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.157800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 20:15:07.157879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.157845 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 20:15:07.158457 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.158442 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fzb4r\"" Jul 02 20:15:07.175082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.175051 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k779v"] Jul 02 20:15:07.175753 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.175735 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n7p4j"] Jul 02 20:15:07.188568 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b467fdc-d292-4d06-a401-16258182fd4b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.188709 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-image-registry-private-configuration\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188709 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmqp\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-kube-api-access-pkmqp\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188709 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.188864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-trusted-ca\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188743 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-bound-sa-token\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-installation-pull-secrets\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf61caa0-452b-42dd-910d-055ebbfd1c55-ca-trust-extracted\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.188864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.188846 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-certificates\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.289840 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-certificates\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b467fdc-d292-4d06-a401-16258182fd4b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289887 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-image-registry-private-configuration\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmqp\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-kube-api-access-pkmqp\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ddd6efa-48ec-425c-840f-9b983bfa1775-config-volume\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289942 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx8gj\" (UniqueName: \"kubernetes.io/projected/1ddd6efa-48ec-425c-840f-9b983bfa1775-kube-api-access-wx8gj\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289968 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98fb307c-b913-4ee9-9ed0-1f76cc8d104f-cert\") pod \"ingress-canary-k779v\" (UID: \"98fb307c-b913-4ee9-9ed0-1f76cc8d104f\") " pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.290000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.289989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzh9\" (UniqueName: \"kubernetes.io/projected/98fb307c-b913-4ee9-9ed0-1f76cc8d104f-kube-api-access-vnzh9\") pod \"ingress-canary-k779v\" (UID: \"98fb307c-b913-4ee9-9ed0-1f76cc8d104f\") " pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-trusted-ca\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-bound-sa-token\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-installation-pull-secrets\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf61caa0-452b-42dd-910d-055ebbfd1c55-ca-trust-extracted\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ddd6efa-48ec-425c-840f-9b983bfa1775-tmp-dir\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.290249 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.290310 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.290547 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-certificates\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.290623 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:07.790604295 +0000 UTC m=+36.020230342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290648 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf61caa0-452b-42dd-910d-055ebbfd1c55-ca-trust-extracted\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.290660 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:15:07.790642484 +0000 UTC m=+36.020268515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:07.290803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.290743 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b467fdc-d292-4d06-a401-16258182fd4b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.291057 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.291035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-trusted-ca\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.293874 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.293851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-installation-pull-secrets\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.293979 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.293919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-image-registry-private-configuration\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.300706 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.300572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-bound-sa-token\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.300786 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.300660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmqp\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-kube-api-access-pkmqp\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.360998 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.360965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:07.360998 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.361003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:07.363395 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.363370 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 20:15:07.363543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.363444 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8kznm\"" Jul 02 20:15:07.363543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.363467 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 20:15:07.363543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.363444 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 20:15:07.390982 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.390905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ddd6efa-48ec-425c-840f-9b983bfa1775-config-volume\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.390982 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.390947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx8gj\" (UniqueName: \"kubernetes.io/projected/1ddd6efa-48ec-425c-840f-9b983bfa1775-kube-api-access-wx8gj\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.391148 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.390997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98fb307c-b913-4ee9-9ed0-1f76cc8d104f-cert\") pod \"ingress-canary-k779v\" (UID: \"98fb307c-b913-4ee9-9ed0-1f76cc8d104f\") " pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.391148 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.391023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzh9\" (UniqueName: \"kubernetes.io/projected/98fb307c-b913-4ee9-9ed0-1f76cc8d104f-kube-api-access-vnzh9\") pod \"ingress-canary-k779v\" (UID: \"98fb307c-b913-4ee9-9ed0-1f76cc8d104f\") " pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.391148 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.391051 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.391148 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.391125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ddd6efa-48ec-425c-840f-9b983bfa1775-tmp-dir\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.391430 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.391390 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:07.391500 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.391472 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:07.891454632 +0000 UTC m=+36.121080665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:07.391559 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.391488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ddd6efa-48ec-425c-840f-9b983bfa1775-config-volume\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.391559 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.391514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ddd6efa-48ec-425c-840f-9b983bfa1775-tmp-dir\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.393882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.393860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98fb307c-b913-4ee9-9ed0-1f76cc8d104f-cert\") pod \"ingress-canary-k779v\" (UID: \"98fb307c-b913-4ee9-9ed0-1f76cc8d104f\") " pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.399387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.399364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx8gj\" (UniqueName: \"kubernetes.io/projected/1ddd6efa-48ec-425c-840f-9b983bfa1775-kube-api-access-wx8gj\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.399573 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.399556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzh9\" (UniqueName: \"kubernetes.io/projected/98fb307c-b913-4ee9-9ed0-1f76cc8d104f-kube-api-access-vnzh9\") pod \"ingress-canary-k779v\" (UID: \"98fb307c-b913-4ee9-9ed0-1f76cc8d104f\") " pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.464522 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.464490 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k779v" Jul 02 20:15:07.605912 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.605874 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k779v"] Jul 02 20:15:07.610261 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:15:07.610235 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98fb307c_b913_4ee9_9ed0_1f76cc8d104f.slice/crio-1bd175c60d673d45c3f5c23a06718f865c3d08723cdef10a053bca2c23d6147a WatchSource:0}: Error finding container 1bd175c60d673d45c3f5c23a06718f865c3d08723cdef10a053bca2c23d6147a: Status 404 returned error can't find the container with id 1bd175c60d673d45c3f5c23a06718f865c3d08723cdef10a053bca2c23d6147a Jul 02 20:15:07.794172 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.794136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:07.794172 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.794178 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:07.794496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.794274 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:07.794496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.794286 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:07.794496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.794283 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:07.794496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.794334 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:08.79432093 +0000 UTC m=+37.023946963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:07.794496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.794379 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:15:08.794373761 +0000 UTC m=+37.023999792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:07.895056 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:07.895016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:07.895245 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.895203 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:07.895293 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:07.895283 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:08.895262834 +0000 UTC m=+37.124888872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:08.360650 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.360612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:08.363221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.363050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 20:15:08.363221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.363083 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpl6\"" Jul 02 20:15:08.559434 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.559383 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k779v" event={"ID":"98fb307c-b913-4ee9-9ed0-1f76cc8d104f","Type":"ContainerStarted","Data":"1bd175c60d673d45c3f5c23a06718f865c3d08723cdef10a053bca2c23d6147a"} Jul 02 20:15:08.800761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.800729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:08.800761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.800765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:08.800966 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.800870 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:08.800966 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.800887 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:08.800966 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.800934 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:10.800920201 +0000 UTC m=+39.030546233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:08.800966 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.800868 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:08.801113 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.800993 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:15:10.800980284 +0000 UTC m=+39.030606322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:08.901210 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:08.901171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:08.901437 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.901353 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:08.901510 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:08.901449 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:10.901426485 +0000 UTC m=+39.131052532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:10.817171 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:10.817124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:10.817171 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:10.817176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:10.817704 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.817295 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:10.817704 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.817300 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:10.817704 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.817368 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:15:14.817353456 +0000 UTC m=+43.046979488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:10.817704 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.817309 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:10.817704 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.817458 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:14.817445267 +0000 UTC m=+43.047071313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:10.918560 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:10.918520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:10.918751 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.918682 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:10.918813 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:10.918760 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:14.918743166 +0000 UTC m=+43.148369211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:12.619050 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:12.619015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vqtn2_402779b2-26bc-41cb-a41e-6ad8b986f920/konnectivity-agent/0.log" limit=1024 Jul 02 20:15:12.702880 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:12.702795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vqtn2_402779b2-26bc-41cb-a41e-6ad8b986f920/konnectivity-agent/0.log" limit=1024 Jul 02 20:15:13.575241 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:13.575196 2573 generic.go:356] "Generic (PLEG): container finished" podID="80339ccf-b5ba-4802-b7ed-85683cd123c6" containerID="2bdb903cc5d15ac91b1e5c271ac88047b105abc509b81505b549bd108b88f4b7" exitCode=0 Jul 02 20:15:13.575445 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:13.575278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerDied","Data":"2bdb903cc5d15ac91b1e5c271ac88047b105abc509b81505b549bd108b88f4b7"} Jul 02 20:15:13.576675 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:13.576655 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k779v" event={"ID":"98fb307c-b913-4ee9-9ed0-1f76cc8d104f","Type":"ContainerStarted","Data":"c53d619e0499b324f903ab963ec57126bafa630d95540e4ef681aae757a9e415"} Jul 02 20:15:13.609039 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:13.608977 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k779v" podStartSLOduration=1.722785704 podStartE2EDuration="6.60893098s" totalImagesPullingTime="4.886145276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:13.608248152 +0000 UTC m=+41.837874202" watchObservedRunningTime="2026-07-02 20:15:13.60893098 +0000 UTC m=+41.838557039" Jul 02 20:15:14.581564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:14.581532 2573 generic.go:356] "Generic (PLEG): container finished" podID="80339ccf-b5ba-4802-b7ed-85683cd123c6" containerID="50a7c079ca24b0c387739d26abd23ee4d8b5c1b3045318a4cc7a8eb00ffa5388" exitCode=0 Jul 02 20:15:14.582019 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:14.581614 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerDied","Data":"50a7c079ca24b0c387739d26abd23ee4d8b5c1b3045318a4cc7a8eb00ffa5388"} Jul 02 20:15:14.853451 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:14.853333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:14.853451 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:14.853379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:14.853642 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.853495 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:14.853642 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.853549 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:14.853642 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.853567 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:14.853642 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.853557 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:15:22.853541262 +0000 UTC m=+51.083167295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:14.853642 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.853617 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:22.853605119 +0000 UTC m=+51.083231152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:14.954247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:14.954210 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:14.954444 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.954361 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:14.954444 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:14.954441 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:22.954425776 +0000 UTC m=+51.184051813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:15.586580 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:15.586550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" event={"ID":"80339ccf-b5ba-4802-b7ed-85683cd123c6","Type":"ContainerStarted","Data":"9beb74b50e394920f5a76938c62e3a7626db876ee836d1e525639c0794d6262f"} Jul 02 20:15:15.609018 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:15.608957 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dwvm5" podStartSLOduration=16.172917767 podStartE2EDuration="42.608940955s" totalImagesPullingTime="26.436023188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:15.607662596 +0000 UTC m=+43.837288651" watchObservedRunningTime="2026-07-02 20:15:15.608940955 +0000 UTC m=+43.838567008" Jul 02 20:15:22.912513 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:22.912465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:22.912513 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:22.912517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:22.913034 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:22.912619 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:22.913034 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:22.912637 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:22.913034 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:22.912652 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:22.913034 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:22.912688 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:15:38.912673133 +0000 UTC m=+67.142299165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:22.913034 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:22.912703 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:38.912696647 +0000 UTC m=+67.142322678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:23.013441 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:23.013383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:23.013617 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:23.013523 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:23.013617 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:23.013584 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:15:39.01357005 +0000 UTC m=+67.243196083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:33.551291 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:33.551254 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnr94" Jul 02 20:15:38.028202 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.028140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:15:38.028693 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.028308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:38.030885 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.030862 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 20:15:38.030981 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.030878 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 20:15:38.038807 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.038782 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 20:15:38.038869 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.038857 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:16:42.038838806 +0000 UTC m=+130.268464842 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : secret "metrics-daemon-secret" not found Jul 02 20:15:38.042098 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.042078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f158ad7-3cb9-4535-b637-45ca7f8aebd6-original-pull-secret\") pod \"global-pull-secret-syncer-fc9mb\" (UID: \"1f158ad7-3cb9-4535-b637-45ca7f8aebd6\") " pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:38.129003 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.128952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:38.131643 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.131620 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 20:15:38.141393 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.141363 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 20:15:38.153037 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.153009 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqhbx\" (UniqueName: \"kubernetes.io/projected/827ad922-ad46-4c22-a872-f0441bfdd1b3-kube-api-access-cqhbx\") pod \"network-check-target-l7ssm\" (UID: \"827ad922-ad46-4c22-a872-f0441bfdd1b3\") " pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:38.274032 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.273995 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc9mb" Jul 02 20:15:38.281970 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.281911 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8kznm\"" Jul 02 20:15:38.290007 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.289977 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:38.427111 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.427061 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fc9mb"] Jul 02 20:15:38.431204 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:15:38.431178 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f158ad7_3cb9_4535_b637_45ca7f8aebd6.slice/crio-e5a8a1abbd0c1b05f28b8aad6bc309a4123bd01f0b1fa3b785acc32eaffac8c7 WatchSource:0}: Error finding container e5a8a1abbd0c1b05f28b8aad6bc309a4123bd01f0b1fa3b785acc32eaffac8c7: Status 404 returned error can't find the container with id e5a8a1abbd0c1b05f28b8aad6bc309a4123bd01f0b1fa3b785acc32eaffac8c7 Jul 02 20:15:38.444954 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.444927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l7ssm"] Jul 02 20:15:38.448559 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:15:38.448532 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827ad922_ad46_4c22_a872_f0441bfdd1b3.slice/crio-1acbfb794917f7940f9f0911e333937ce1d6f32f77ebbb735503bfa18b428c77 WatchSource:0}: Error finding container 1acbfb794917f7940f9f0911e333937ce1d6f32f77ebbb735503bfa18b428c77: Status 404 returned error can't find the container with id 1acbfb794917f7940f9f0911e333937ce1d6f32f77ebbb735503bfa18b428c77 Jul 02 20:15:38.641948 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.641854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l7ssm" event={"ID":"827ad922-ad46-4c22-a872-f0441bfdd1b3","Type":"ContainerStarted","Data":"1acbfb794917f7940f9f0911e333937ce1d6f32f77ebbb735503bfa18b428c77"} Jul 02 20:15:38.642908 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.642883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fc9mb" event={"ID":"1f158ad7-3cb9-4535-b637-45ca7f8aebd6","Type":"ContainerStarted","Data":"e5a8a1abbd0c1b05f28b8aad6bc309a4123bd01f0b1fa3b785acc32eaffac8c7"} Jul 02 20:15:38.933261 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.933168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:15:38.933261 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:38.933212 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:15:38.933496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.933345 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:15:38.933496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.933427 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:16:10.933395693 +0000 UTC m=+99.163021728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:15:38.933496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.933348 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:15:38.933496 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.933454 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:15:38.933708 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:38.933547 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:16:10.933531002 +0000 UTC m=+99.163157048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:15:39.033931 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:39.033893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:15:39.034340 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:39.034045 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:15:39.034340 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:15:39.034107 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:16:11.034090135 +0000 UTC m=+99.263716167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:15:41.651979 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:41.651941 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l7ssm" event={"ID":"827ad922-ad46-4c22-a872-f0441bfdd1b3","Type":"ContainerStarted","Data":"3e31f69e955088864a5065e23c144dbd13f2d98a1bfa1ca8e7920ae67dee31bb"} Jul 02 20:15:41.652429 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:41.652090 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:15:41.666733 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:41.666658 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l7ssm" podStartSLOduration=65.596450902 podStartE2EDuration="1m8.666636086s" totalImagesPullingTime="3.070185184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:41.666632385 +0000 UTC m=+69.896258441" watchObservedRunningTime="2026-07-02 20:15:41.666636086 +0000 UTC m=+69.896262211" Jul 02 20:15:44.661528 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:44.661490 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fc9mb" event={"ID":"1f158ad7-3cb9-4535-b637-45ca7f8aebd6","Type":"ContainerStarted","Data":"bbe4f0b05786da05a67eacafcfa1954858d59b9b358ad8fcee7b073f4514643a"} Jul 02 20:15:44.676578 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:15:44.676526 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fc9mb" podStartSLOduration=66.229861974 podStartE2EDuration="1m11.676510088s" totalImagesPullingTime="5.446648114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:44.675390676 +0000 UTC m=+72.905016731" watchObservedRunningTime="2026-07-02 20:15:44.676510088 +0000 UTC m=+72.906136142" Jul 02 20:16:07.264058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.263938 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh"] Jul 02 20:16:07.268214 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.268195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.270873 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.270854 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 20:16:07.271905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.271879 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dcbgg\"" Jul 02 20:16:07.271994 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.271879 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 20:16:07.271994 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.271886 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 20:16:07.271994 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.271923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 20:16:07.276686 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.276665 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh"] Jul 02 20:16:07.348066 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.348027 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e684a924-ec13-41e1-80a3-cc915cc220e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c99dcdfb4-s6skh\" (UID: \"e684a924-ec13-41e1-80a3-cc915cc220e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.348249 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.348089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv4nc\" (UniqueName: \"kubernetes.io/projected/e684a924-ec13-41e1-80a3-cc915cc220e0-kube-api-access-gv4nc\") pod \"managed-serviceaccount-addon-agent-c99dcdfb4-s6skh\" (UID: \"e684a924-ec13-41e1-80a3-cc915cc220e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.449385 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.449346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e684a924-ec13-41e1-80a3-cc915cc220e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c99dcdfb4-s6skh\" (UID: \"e684a924-ec13-41e1-80a3-cc915cc220e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.449574 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.449428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv4nc\" (UniqueName: \"kubernetes.io/projected/e684a924-ec13-41e1-80a3-cc915cc220e0-kube-api-access-gv4nc\") pod \"managed-serviceaccount-addon-agent-c99dcdfb4-s6skh\" (UID: \"e684a924-ec13-41e1-80a3-cc915cc220e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.451792 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.451768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e684a924-ec13-41e1-80a3-cc915cc220e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c99dcdfb4-s6skh\" (UID: \"e684a924-ec13-41e1-80a3-cc915cc220e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.458135 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.458099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv4nc\" (UniqueName: \"kubernetes.io/projected/e684a924-ec13-41e1-80a3-cc915cc220e0-kube-api-access-gv4nc\") pod \"managed-serviceaccount-addon-agent-c99dcdfb4-s6skh\" (UID: \"e684a924-ec13-41e1-80a3-cc915cc220e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.586607 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.586506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" Jul 02 20:16:07.712866 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:07.712832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh"] Jul 02 20:16:07.716015 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:16:07.715988 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode684a924_ec13_41e1_80a3_cc915cc220e0.slice/crio-bf75c2761a56ccec72df5d8f9e16b84ebe0df36fcf70b55f3fe0a27b23287df9 WatchSource:0}: Error finding container bf75c2761a56ccec72df5d8f9e16b84ebe0df36fcf70b55f3fe0a27b23287df9: Status 404 returned error can't find the container with id bf75c2761a56ccec72df5d8f9e16b84ebe0df36fcf70b55f3fe0a27b23287df9 Jul 02 20:16:08.721276 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:08.721182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" event={"ID":"e684a924-ec13-41e1-80a3-cc915cc220e0","Type":"ContainerStarted","Data":"bf75c2761a56ccec72df5d8f9e16b84ebe0df36fcf70b55f3fe0a27b23287df9"} Jul 02 20:16:10.727717 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:10.727681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" event={"ID":"e684a924-ec13-41e1-80a3-cc915cc220e0","Type":"ContainerStarted","Data":"ddfef5f90f669ce38380068fffeda64f0bff89c1a494c8b6f2bcb545f8fd65e0"} Jul 02 20:16:10.741637 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:10.741584 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" podStartSLOduration=1.29029922 podStartE2EDuration="3.74156696s" totalImagesPullingTime="2.45126774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:16:10.74128877 +0000 UTC m=+98.970914822" watchObservedRunningTime="2026-07-02 20:16:10.74156696 +0000 UTC m=+98.971193007" Jul 02 20:16:10.978747 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:10.978654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:16:10.978747 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:10.978699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:16:10.978921 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:10.978805 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:16:10.978921 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:10.978870 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:17:14.978855403 +0000 UTC m=+163.208481435 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:16:10.978921 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:10.978808 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:16:10.978921 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:10.978892 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:16:10.978921 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:10.978917 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:17:14.978909072 +0000 UTC m=+163.208535105 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:16:11.080010 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:11.079973 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:16:11.080181 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:11.080081 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:16:11.080181 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:11.080128 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:17:15.080115555 +0000 UTC m=+163.309741586 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:16:12.657860 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:12.657830 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l7ssm" Jul 02 20:16:42.106281 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:16:42.106223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:16:42.106824 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:42.106369 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 20:16:42.106824 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:16:42.106488 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:18:44.106470189 +0000 UTC m=+252.336096225 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : secret "metrics-daemon-secret" not found Jul 02 20:17:10.095218 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:10.095169 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" podUID="9b467fdc-d292-4d06-a401-16258182fd4b" Jul 02 20:17:10.101343 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:10.101311 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" Jul 02 20:17:10.160805 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:10.160754 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n7p4j" podUID="1ddd6efa-48ec-425c-840f-9b983bfa1775" Jul 02 20:17:10.875816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:10.875781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:17:10.875990 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:10.875781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n7p4j" Jul 02 20:17:10.875990 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:10.875781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:17:11.371390 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:11.371349 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:17:15.041602 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:15.041546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:17:15.041602 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:15.041601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:17:15.042083 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.041709 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 20:17:15.042083 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.041722 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6489d8c6-9z6lz: secret "image-registry-tls" not found Jul 02 20:17:15.042083 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.041779 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls podName:bf61caa0-452b-42dd-910d-055ebbfd1c55 nodeName:}" failed. No retries permitted until 2026-07-02 20:19:17.041763555 +0000 UTC m=+285.271389600 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls") pod "image-registry-5d6489d8c6-9z6lz" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55") : secret "image-registry-tls" not found Jul 02 20:17:15.042083 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.041707 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 20:17:15.042083 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.041834 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert podName:9b467fdc-d292-4d06-a401-16258182fd4b nodeName:}" failed. No retries permitted until 2026-07-02 20:19:17.041821596 +0000 UTC m=+285.271447629 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-l28dq" (UID: "9b467fdc-d292-4d06-a401-16258182fd4b") : secret "networking-console-plugin-cert" not found Jul 02 20:17:15.142250 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:15.142213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:17:15.142502 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.142360 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:17:15.142502 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:17:15.142451 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls podName:1ddd6efa-48ec-425c-840f-9b983bfa1775 nodeName:}" failed. No retries permitted until 2026-07-02 20:19:17.142435079 +0000 UTC m=+285.372061111 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls") pod "dns-default-n7p4j" (UID: "1ddd6efa-48ec-425c-840f-9b983bfa1775") : secret "dns-default-metrics-tls" not found Jul 02 20:17:26.361094 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:17:26.361009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:18:11.017159 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:11.017130 2573 generic.go:356] "Generic (PLEG): container finished" podID="e684a924-ec13-41e1-80a3-cc915cc220e0" containerID="ddfef5f90f669ce38380068fffeda64f0bff89c1a494c8b6f2bcb545f8fd65e0" exitCode=255 Jul 02 20:18:11.017579 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:11.017189 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" event={"ID":"e684a924-ec13-41e1-80a3-cc915cc220e0","Type":"ContainerDied","Data":"ddfef5f90f669ce38380068fffeda64f0bff89c1a494c8b6f2bcb545f8fd65e0"} Jul 02 20:18:11.022987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:11.022971 2573 scope.go:117] "RemoveContainer" containerID="ddfef5f90f669ce38380068fffeda64f0bff89c1a494c8b6f2bcb545f8fd65e0" Jul 02 20:18:12.021390 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:12.021360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c99dcdfb4-s6skh" event={"ID":"e684a924-ec13-41e1-80a3-cc915cc220e0","Type":"ContainerStarted","Data":"ea949a2bb071c323801158c99db77d16f0c7bbe868c6a2242c6d5a4b52ba18b2"} Jul 02 20:18:44.169117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:44.169075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:18:44.169608 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:44.169223 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 20:18:44.169608 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:44.169293 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs podName:63d46d5e-6860-45eb-a6f9-47be88e1fc0c nodeName:}" failed. No retries permitted until 2026-07-02 20:20:46.169278425 +0000 UTC m=+374.398904456 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs") pod "network-metrics-daemon-lq2dw" (UID: "63d46d5e-6860-45eb-a6f9-47be88e1fc0c") : secret "metrics-daemon-secret" not found Jul 02 20:18:48.840177 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.840142 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s"] Jul 02 20:18:48.843092 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.843067 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" Jul 02 20:18:48.843701 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.843680 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49"] Jul 02 20:18:48.845700 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.845678 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:18:48.845803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.845703 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gldln\"" Jul 02 20:18:48.845803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.845728 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 20:18:48.846154 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.846140 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl"] Jul 02 20:18:48.846268 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.846254 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:48.848293 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848274 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 20:18:48.848553 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848528 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 20:18:48.848654 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:18:48.848729 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848695 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c4c9dbcfc-phdxg"] Jul 02 20:18:48.848729 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848706 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4xhd5\"" Jul 02 20:18:48.848831 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848754 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 20:18:48.848831 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.848822 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:48.850642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.850625 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 20:18:48.850875 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.850858 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 20:18:48.850943 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.850927 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:18:48.851130 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.851115 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 20:18:48.851206 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.851185 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gv5ft\"" Jul 02 20:18:48.851300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.851282 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:48.853815 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.853777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fjg27\"" Jul 02 20:18:48.854281 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.854242 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 20:18:48.854369 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.854345 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 20:18:48.854673 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.854651 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 20:18:48.855073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.855049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 20:18:48.855539 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.855518 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 20:18:48.855816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.855786 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 20:18:48.856386 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.856364 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s"] Jul 02 20:18:48.861132 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.861110 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl"] Jul 02 20:18:48.862687 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.862667 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49"] Jul 02 20:18:48.875684 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.875663 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c4c9dbcfc-phdxg"] Jul 02 20:18:48.906805 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.906778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-stats-auth\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:48.906939 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.906814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcwml\" (UniqueName: \"kubernetes.io/projected/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-kube-api-access-hcwml\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:48.906939 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.906834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbf8p\" (UniqueName: \"kubernetes.io/projected/46643ebe-1c16-4256-b5ca-b414516a1cee-kube-api-access-xbf8p\") pod \"volume-data-source-validator-5d456fdbcd-t7n6s\" (UID: \"46643ebe-1c16-4256-b5ca-b414516a1cee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" Jul 02 20:18:48.906939 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.906855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8efdf623-86a7-4dce-9fa6-88d8c14ab130-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:48.907117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.906931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:48.907117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.906992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-config\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:48.907117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.907029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:48.907117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.907057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c26h6\" (UniqueName: \"kubernetes.io/projected/a87a736a-f2e4-4c38-8fbe-d4887256c30b-kube-api-access-c26h6\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:48.907117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.907087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8efdf623-86a7-4dce-9fa6-88d8c14ab130-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:48.907117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.907111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-default-certificate\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:48.907300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.907161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:48.907300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:48.907191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxm5\" (UniqueName: \"kubernetes.io/projected/8efdf623-86a7-4dce-9fa6-88d8c14ab130-kube-api-access-wdxm5\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.007598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-config\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.007598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.007852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26h6\" (UniqueName: \"kubernetes.io/projected/a87a736a-f2e4-4c38-8fbe-d4887256c30b-kube-api-access-c26h6\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.007852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8efdf623-86a7-4dce-9fa6-88d8c14ab130-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.007852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-default-certificate\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.007852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.007852 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:49.007826 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:18:49.007852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxm5\" (UniqueName: \"kubernetes.io/projected/8efdf623-86a7-4dce-9fa6-88d8c14ab130-kube-api-access-wdxm5\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:49.007887 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:49.507869075 +0000 UTC m=+257.737495112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : secret "router-metrics-certs-default" not found Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-stats-auth\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.007978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcwml\" (UniqueName: \"kubernetes.io/projected/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-kube-api-access-hcwml\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:49.008004 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:49.507985275 +0000 UTC m=+257.737611313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : configmap references non-existent config key: service-ca.crt Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.008045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbf8p\" (UniqueName: \"kubernetes.io/projected/46643ebe-1c16-4256-b5ca-b414516a1cee-kube-api-access-xbf8p\") pod \"volume-data-source-validator-5d456fdbcd-t7n6s\" (UID: \"46643ebe-1c16-4256-b5ca-b414516a1cee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.008090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8efdf623-86a7-4dce-9fa6-88d8c14ab130-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.008151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.008129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.008523 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.008248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-config\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.008742 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.008717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8efdf623-86a7-4dce-9fa6-88d8c14ab130-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.010378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.010352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.010545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.010458 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8efdf623-86a7-4dce-9fa6-88d8c14ab130-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.010545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.010496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-stats-auth\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.010545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.010507 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-default-certificate\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.016030 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.015999 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcwml\" (UniqueName: \"kubernetes.io/projected/451ed327-1ccb-4d5f-8517-b4c34cd68ca7-kube-api-access-hcwml\") pod \"service-ca-operator-5d46d9ffd4-cbphl\" (UID: \"451ed327-1ccb-4d5f-8517-b4c34cd68ca7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.016163 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.016145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxm5\" (UniqueName: \"kubernetes.io/projected/8efdf623-86a7-4dce-9fa6-88d8c14ab130-kube-api-access-wdxm5\") pod \"kube-storage-version-migrator-operator-846bf668f7-m8b49\" (UID: \"8efdf623-86a7-4dce-9fa6-88d8c14ab130\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.016209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.016169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbf8p\" (UniqueName: \"kubernetes.io/projected/46643ebe-1c16-4256-b5ca-b414516a1cee-kube-api-access-xbf8p\") pod \"volume-data-source-validator-5d456fdbcd-t7n6s\" (UID: \"46643ebe-1c16-4256-b5ca-b414516a1cee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" Jul 02 20:18:49.016897 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.016875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c26h6\" (UniqueName: \"kubernetes.io/projected/a87a736a-f2e4-4c38-8fbe-d4887256c30b-kube-api-access-c26h6\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.154179 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.154091 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" Jul 02 20:18:49.164478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.164455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" Jul 02 20:18:49.170431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.170367 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" Jul 02 20:18:49.298596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.298561 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s"] Jul 02 20:18:49.303016 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:18:49.302975 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46643ebe_1c16_4256_b5ca_b414516a1cee.slice/crio-f94b498dbd17658b0bd5e2e7b9673545ede7d637e4a085fab0a9d7c2beb5605c WatchSource:0}: Error finding container f94b498dbd17658b0bd5e2e7b9673545ede7d637e4a085fab0a9d7c2beb5605c: Status 404 returned error can't find the container with id f94b498dbd17658b0bd5e2e7b9673545ede7d637e4a085fab0a9d7c2beb5605c Jul 02 20:18:49.315566 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.315539 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49"] Jul 02 20:18:49.318468 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:18:49.318440 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efdf623_86a7_4dce_9fa6_88d8c14ab130.slice/crio-9c8f6ca14be97409b91ce21cec30cad84d7c76f2c966ea1ee7b5b6e50db38a70 WatchSource:0}: Error finding container 9c8f6ca14be97409b91ce21cec30cad84d7c76f2c966ea1ee7b5b6e50db38a70: Status 404 returned error can't find the container with id 9c8f6ca14be97409b91ce21cec30cad84d7c76f2c966ea1ee7b5b6e50db38a70 Jul 02 20:18:49.332989 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.332960 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl"] Jul 02 20:18:49.335912 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:18:49.335889 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451ed327_1ccb_4d5f_8517_b4c34cd68ca7.slice/crio-83ace21fdd0b221563a210aaf6a550d83c01b487babcb40afa1ce8af86ef0ef2 WatchSource:0}: Error finding container 83ace21fdd0b221563a210aaf6a550d83c01b487babcb40afa1ce8af86ef0ef2: Status 404 returned error can't find the container with id 83ace21fdd0b221563a210aaf6a550d83c01b487babcb40afa1ce8af86ef0ef2 Jul 02 20:18:49.511653 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.511614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.511653 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:49.511661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:49.511973 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:49.511787 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:18:49.511973 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:49.511803 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:50.511790499 +0000 UTC m=+258.741416532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : configmap references non-existent config key: service-ca.crt Jul 02 20:18:49.511973 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:49.511853 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:50.511833699 +0000 UTC m=+258.741459734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : secret "router-metrics-certs-default" not found Jul 02 20:18:50.113949 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:50.113904 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" event={"ID":"46643ebe-1c16-4256-b5ca-b414516a1cee","Type":"ContainerStarted","Data":"f94b498dbd17658b0bd5e2e7b9673545ede7d637e4a085fab0a9d7c2beb5605c"} Jul 02 20:18:50.115491 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:50.115436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" event={"ID":"451ed327-1ccb-4d5f-8517-b4c34cd68ca7","Type":"ContainerStarted","Data":"83ace21fdd0b221563a210aaf6a550d83c01b487babcb40afa1ce8af86ef0ef2"} Jul 02 20:18:50.116657 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:50.116628 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" event={"ID":"8efdf623-86a7-4dce-9fa6-88d8c14ab130","Type":"ContainerStarted","Data":"9c8f6ca14be97409b91ce21cec30cad84d7c76f2c966ea1ee7b5b6e50db38a70"} Jul 02 20:18:50.519343 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:50.519233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:50.519343 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:50.519302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:50.519601 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:50.519434 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:18:50.519601 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:50.519459 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:52.519432462 +0000 UTC m=+260.749058517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : configmap references non-existent config key: service-ca.crt Jul 02 20:18:50.519601 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:50.519498 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:52.519481493 +0000 UTC m=+260.749107543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : secret "router-metrics-certs-default" not found Jul 02 20:18:51.121224 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:51.121132 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" event={"ID":"46643ebe-1c16-4256-b5ca-b414516a1cee","Type":"ContainerStarted","Data":"6f47785ae1cfe68eb6037b7569e9f241ca74cbf08228cabd3cc0faec08c87a19"} Jul 02 20:18:52.536919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:52.536807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:52.536919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:52.536873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:52.537336 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:52.536993 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:18:52.537336 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:52.537045 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:56.537027324 +0000 UTC m=+264.766653355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : configmap references non-existent config key: service-ca.crt Jul 02 20:18:52.537336 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:52.537073 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:18:56.53705623 +0000 UTC m=+264.766682281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : secret "router-metrics-certs-default" not found Jul 02 20:18:53.132687 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.132651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" event={"ID":"451ed327-1ccb-4d5f-8517-b4c34cd68ca7","Type":"ContainerStarted","Data":"4caa091f24a2126821521655a28e61cb3cc475f905f8091106e766a9bf7d1992"} Jul 02 20:18:53.134231 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.134200 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" event={"ID":"8efdf623-86a7-4dce-9fa6-88d8c14ab130","Type":"ContainerStarted","Data":"268c1e8f32effde512807e20bd448d28f640549a1db72e13967ad8ae04e2bbae"} Jul 02 20:18:53.147183 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.147107 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" podStartSLOduration=2.226726922 podStartE2EDuration="5.147088052s" totalImagesPullingTime="2.92036113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:53.146111588 +0000 UTC m=+261.375737643" watchObservedRunningTime="2026-07-02 20:18:53.147088052 +0000 UTC m=+261.376714107" Jul 02 20:18:53.147656 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.147629 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t7n6s" podStartSLOduration=3.671184762 podStartE2EDuration="5.147618684s" totalImagesPullingTime="1.476433922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:51.137788879 +0000 UTC m=+259.367414935" watchObservedRunningTime="2026-07-02 20:18:53.147618684 +0000 UTC m=+261.377244737" Jul 02 20:18:53.160707 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.160644 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" podStartSLOduration=2.22034773 podStartE2EDuration="5.160620438s" totalImagesPullingTime="2.940272708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:53.159046485 +0000 UTC m=+261.388672539" watchObservedRunningTime="2026-07-02 20:18:53.160620438 +0000 UTC m=+261.390246493" Jul 02 20:18:53.675994 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.675958 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cs7hl"] Jul 02 20:18:53.679333 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.679315 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.683033 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.683002 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 20:18:53.683033 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.683003 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 20:18:53.683706 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.683686 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 20:18:53.683785 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.683709 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g7mm9\"" Jul 02 20:18:53.684432 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.684415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 20:18:53.693543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.693522 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cs7hl"] Jul 02 20:18:53.747062 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.747033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.747210 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.747074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865a2c34-7554-48d9-b20c-85e62bacf2af-crio-socket\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.747210 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.747130 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7h9d\" (UniqueName: \"kubernetes.io/projected/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-api-access-g7h9d\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.747210 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.747151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.747328 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.747236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865a2c34-7554-48d9-b20c-85e62bacf2af-data-volume\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.847935 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.847868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865a2c34-7554-48d9-b20c-85e62bacf2af-data-volume\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848136 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.847985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848136 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.848028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865a2c34-7554-48d9-b20c-85e62bacf2af-crio-socket\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848136 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.848085 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7h9d\" (UniqueName: \"kubernetes.io/projected/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-api-access-g7h9d\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848136 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.848130 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848307 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:53.848132 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:18:53.848307 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.848194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865a2c34-7554-48d9-b20c-85e62bacf2af-crio-socket\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848307 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:53.848206 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:18:53.848307 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:53.848239 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:18:54.348220864 +0000 UTC m=+262.577846910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : secret "insights-runtime-extractor-tls" not found Jul 02 20:18:53.848307 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.848243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865a2c34-7554-48d9-b20c-85e62bacf2af-data-volume\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:53.848307 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:53.848281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:18:54.348265071 +0000 UTC m=+262.577891105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : configmap "kube-rbac-proxy" not found Jul 02 20:18:53.855819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:53.855786 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7h9d\" (UniqueName: \"kubernetes.io/projected/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-api-access-g7h9d\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:54.219381 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.219338 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc"] Jul 02 20:18:54.222448 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.222385 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" Jul 02 20:18:54.225807 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.225777 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 20:18:54.225944 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.225848 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 20:18:54.226146 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.226128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sbjbd\"" Jul 02 20:18:54.233860 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.233838 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc"] Jul 02 20:18:54.353056 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.352965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8762k\" (UniqueName: \"kubernetes.io/projected/2a784cf8-5c30-4767-b976-c7d69265f72f-kube-api-access-8762k\") pod \"migrator-d57d58cc9-wbffc\" (UID: \"2a784cf8-5c30-4767-b976-c7d69265f72f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" Jul 02 20:18:54.353056 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.353031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:54.353250 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:54.353134 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:18:54.353250 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.353143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:54.353250 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:54.353195 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:18:55.353175487 +0000 UTC m=+263.582801520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : secret "insights-runtime-extractor-tls" not found Jul 02 20:18:54.353250 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:54.353216 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:18:54.353388 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:54.353271 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:18:55.353252832 +0000 UTC m=+263.582878867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : configmap "kube-rbac-proxy" not found Jul 02 20:18:54.454496 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.454460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8762k\" (UniqueName: \"kubernetes.io/projected/2a784cf8-5c30-4767-b976-c7d69265f72f-kube-api-access-8762k\") pod \"migrator-d57d58cc9-wbffc\" (UID: \"2a784cf8-5c30-4767-b976-c7d69265f72f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" Jul 02 20:18:54.463312 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.463281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8762k\" (UniqueName: \"kubernetes.io/projected/2a784cf8-5c30-4767-b976-c7d69265f72f-kube-api-access-8762k\") pod \"migrator-d57d58cc9-wbffc\" (UID: \"2a784cf8-5c30-4767-b976-c7d69265f72f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" Jul 02 20:18:54.532836 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.532751 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" Jul 02 20:18:54.665122 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:54.665090 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc"] Jul 02 20:18:54.668176 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:18:54.668148 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a784cf8_5c30_4767_b976_c7d69265f72f.slice/crio-adf5a01d519d671b378cd354452b4310bf2e564f64d1c9b6d1cb0f4e56bba3b6 WatchSource:0}: Error finding container adf5a01d519d671b378cd354452b4310bf2e564f64d1c9b6d1cb0f4e56bba3b6: Status 404 returned error can't find the container with id adf5a01d519d671b378cd354452b4310bf2e564f64d1c9b6d1cb0f4e56bba3b6 Jul 02 20:18:55.141729 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:55.141688 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" event={"ID":"2a784cf8-5c30-4767-b976-c7d69265f72f","Type":"ContainerStarted","Data":"adf5a01d519d671b378cd354452b4310bf2e564f64d1c9b6d1cb0f4e56bba3b6"} Jul 02 20:18:55.363979 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:55.363947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:55.364160 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:55.364070 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:18:55.364160 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:55.364102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:55.364160 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:55.364131 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:18:57.364116063 +0000 UTC m=+265.593742095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : configmap "kube-rbac-proxy" not found Jul 02 20:18:55.364325 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:55.364184 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:18:55.364325 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:55.364226 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:18:57.364215138 +0000 UTC m=+265.593841170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : secret "insights-runtime-extractor-tls" not found Jul 02 20:18:55.958251 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:55.958226 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psmhp_d5e6d1c3-c826-4e46-958f-0ba71390bd70/dns-node-resolver/0.log" Jul 02 20:18:56.559130 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:56.559054 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2v4jt_fa79b396-59d6-442a-b571-acd5c4aae7cf/node-ca/0.log" Jul 02 20:18:56.574470 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:56.574438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:56.574568 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:56.574486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:18:56.574611 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:56.574595 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:18:56.574666 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:56.574656 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:19:04.574641268 +0000 UTC m=+272.804267300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : secret "router-metrics-certs-default" not found Jul 02 20:18:56.574709 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:56.574675 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:19:04.57466789 +0000 UTC m=+272.804293923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : configmap references non-existent config key: service-ca.crt Jul 02 20:18:57.150218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:57.150184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" event={"ID":"2a784cf8-5c30-4767-b976-c7d69265f72f","Type":"ContainerStarted","Data":"4e43f50d28ee1121e6996e7dfae4add25e24597305f597bd88a34aebb4d016e3"} Jul 02 20:18:57.150384 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:57.150239 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" event={"ID":"2a784cf8-5c30-4767-b976-c7d69265f72f","Type":"ContainerStarted","Data":"0cf3183a44b7dc1a5e4d0384b7df478048de5368b76e3ce876db2b9da942ed22"} Jul 02 20:18:57.173620 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:57.173567 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wbffc" podStartSLOduration=1.611866586 podStartE2EDuration="3.173551912s" totalImagesPullingTime="1.561685326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:18:57.172188332 +0000 UTC m=+265.401814386" watchObservedRunningTime="2026-07-02 20:18:57.173551912 +0000 UTC m=+265.403177966" Jul 02 20:18:57.380752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:57.380702 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:57.380940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:57.380790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:18:57.380940 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:57.380851 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:18:57.380940 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:57.380901 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:18:57.380940 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:57.380916 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:19:01.380902625 +0000 UTC m=+269.610528660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : secret "insights-runtime-extractor-tls" not found Jul 02 20:18:57.381071 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:18:57.380944 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:19:01.380933641 +0000 UTC m=+269.610559678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : configmap "kube-rbac-proxy" not found Jul 02 20:18:57.559534 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:18:57.559509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k779v_98fb307c-b913-4ee9-9ed0-1f76cc8d104f/serve-healthcheck-canary/0.log" Jul 02 20:19:01.412062 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:01.412020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:01.412564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:01.412109 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:01.412564 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:01.412160 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:19:01.412564 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:01.412203 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:19:01.412564 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:01.412230 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:19:09.412210829 +0000 UTC m=+277.641836861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : secret "insights-runtime-extractor-tls" not found Jul 02 20:19:01.412564 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:01.412251 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:19:09.412238517 +0000 UTC m=+277.641864549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : configmap "kube-rbac-proxy" not found Jul 02 20:19:04.642159 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:04.642114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:04.642660 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:04.642294 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:19:20.642273013 +0000 UTC m=+288.871899057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : configmap references non-existent config key: service-ca.crt Jul 02 20:19:04.642660 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:04.642458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:04.642660 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:04.642592 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:19:04.642660 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:04.642646 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs podName:a87a736a-f2e4-4c38-8fbe-d4887256c30b nodeName:}" failed. No retries permitted until 2026-07-02 20:19:20.642628502 +0000 UTC m=+288.872254535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs") pod "router-default-5c4c9dbcfc-phdxg" (UID: "a87a736a-f2e4-4c38-8fbe-d4887256c30b") : secret "router-metrics-certs-default" not found Jul 02 20:19:09.482669 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:09.482623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:09.483061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:09.482700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:09.483061 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:09.482795 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:19:09.483061 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:09.482870 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls podName:865a2c34-7554-48d9-b20c-85e62bacf2af nodeName:}" failed. No retries permitted until 2026-07-02 20:19:25.482854826 +0000 UTC m=+293.712480858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cs7hl" (UID: "865a2c34-7554-48d9-b20c-85e62bacf2af") : secret "insights-runtime-extractor-tls" not found Jul 02 20:19:09.483170 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:09.483158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865a2c34-7554-48d9-b20c-85e62bacf2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:13.876582 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:13.876538 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" Jul 02 20:19:13.876582 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:13.876568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" podUID="9b467fdc-d292-4d06-a401-16258182fd4b" Jul 02 20:19:13.876987 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:13.876568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n7p4j" podUID="1ddd6efa-48ec-425c-840f-9b983bfa1775" Jul 02 20:19:14.202326 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:14.202242 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:19:14.202326 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:14.202271 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:19:14.202546 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:14.202384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n7p4j" Jul 02 20:19:17.046966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.046924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:19:17.046966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.046968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:19:17.049596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.049564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b467fdc-d292-4d06-a401-16258182fd4b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-l28dq\" (UID: \"9b467fdc-d292-4d06-a401-16258182fd4b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:19:17.049596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.049586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"image-registry-5d6489d8c6-9z6lz\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:19:17.147879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.147839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:19:17.150175 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.150154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ddd6efa-48ec-425c-840f-9b983bfa1775-metrics-tls\") pod \"dns-default-n7p4j\" (UID: \"1ddd6efa-48ec-425c-840f-9b983bfa1775\") " pod="openshift-dns/dns-default-n7p4j" Jul 02 20:19:17.204913 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.204882 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7jgs\"" Jul 02 20:19:17.205658 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.205632 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fzb4r\"" Jul 02 20:19:17.205747 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.205733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-grp4t\"" Jul 02 20:19:17.213479 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.213449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:19:17.213479 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.213463 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n7p4j" Jul 02 20:19:17.213479 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.213477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" Jul 02 20:19:17.373423 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.373373 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6489d8c6-9z6lz"] Jul 02 20:19:17.376383 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:17.376339 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf61caa0_452b_42dd_910d_055ebbfd1c55.slice/crio-e179a1eb8a4310772f43c91550f9de414815fba44b94b687a231f22b4011c8ab WatchSource:0}: Error finding container e179a1eb8a4310772f43c91550f9de414815fba44b94b687a231f22b4011c8ab: Status 404 returned error can't find the container with id e179a1eb8a4310772f43c91550f9de414815fba44b94b687a231f22b4011c8ab Jul 02 20:19:17.582791 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.582714 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-l28dq"] Jul 02 20:19:17.586945 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:17.586899 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n7p4j"] Jul 02 20:19:17.587462 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:17.587437 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b467fdc_d292_4d06_a401_16258182fd4b.slice/crio-b910751276f0ee8bdab2b11a8a8248f068c147c1288312b9e46685975ced79b5 WatchSource:0}: Error finding container b910751276f0ee8bdab2b11a8a8248f068c147c1288312b9e46685975ced79b5: Status 404 returned error can't find the container with id b910751276f0ee8bdab2b11a8a8248f068c147c1288312b9e46685975ced79b5 Jul 02 20:19:17.590663 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:17.590641 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ddd6efa_48ec_425c_840f_9b983bfa1775.slice/crio-4f2ac044417ea0d51cd957c35c99a595ecfec2214bacf6ba3bee8ddf71deb5ec WatchSource:0}: Error finding container 4f2ac044417ea0d51cd957c35c99a595ecfec2214bacf6ba3bee8ddf71deb5ec: Status 404 returned error can't find the container with id 4f2ac044417ea0d51cd957c35c99a595ecfec2214bacf6ba3bee8ddf71deb5ec Jul 02 20:19:18.215660 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:18.215622 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" event={"ID":"9b467fdc-d292-4d06-a401-16258182fd4b","Type":"ContainerStarted","Data":"b910751276f0ee8bdab2b11a8a8248f068c147c1288312b9e46685975ced79b5"} Jul 02 20:19:18.217025 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:18.216987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" event={"ID":"bf61caa0-452b-42dd-910d-055ebbfd1c55","Type":"ContainerStarted","Data":"ee4112bb9d49218483bb061c52ac437728aa0213c3f1dffc2862b89e68e92a0f"} Jul 02 20:19:18.217156 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:18.217111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:19:18.217234 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:18.217157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" event={"ID":"bf61caa0-452b-42dd-910d-055ebbfd1c55","Type":"ContainerStarted","Data":"e179a1eb8a4310772f43c91550f9de414815fba44b94b687a231f22b4011c8ab"} Jul 02 20:19:18.217973 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:18.217952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n7p4j" event={"ID":"1ddd6efa-48ec-425c-840f-9b983bfa1775","Type":"ContainerStarted","Data":"4f2ac044417ea0d51cd957c35c99a595ecfec2214bacf6ba3bee8ddf71deb5ec"} Jul 02 20:19:18.238551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:18.238505 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" podStartSLOduration=263.238490207 podStartE2EDuration="4m23.238490207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:18.237252099 +0000 UTC m=+286.466878166" watchObservedRunningTime="2026-07-02 20:19:18.238490207 +0000 UTC m=+286.468116261" Jul 02 20:19:19.223613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:19.223558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" event={"ID":"9b467fdc-d292-4d06-a401-16258182fd4b","Type":"ContainerStarted","Data":"00d6ab0079404918281d887e1d5cba53c11e33aa7b7d620b38429a9cdd98f88b"} Jul 02 20:19:19.239044 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:19.238912 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-l28dq" podStartSLOduration=269.945361358 podStartE2EDuration="4m31.238893894s" totalImagesPullingTime="1.293532536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:19.238632638 +0000 UTC m=+287.468258694" watchObservedRunningTime="2026-07-02 20:19:19.238893894 +0000 UTC m=+287.468519948" Jul 02 20:19:20.227963 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.227923 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n7p4j" event={"ID":"1ddd6efa-48ec-425c-840f-9b983bfa1775","Type":"ContainerStarted","Data":"a31b90abff1a6f07dd9f64214770199f3fa33504480ac9950e2fd6ff13f29982"} Jul 02 20:19:20.228474 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.227991 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n7p4j" event={"ID":"1ddd6efa-48ec-425c-840f-9b983bfa1775","Type":"ContainerStarted","Data":"2f0ee8c6c273d98774f3b3708696d9746a56a76afa785b09e2007c9443669c76"} Jul 02 20:19:20.246104 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.246054 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n7p4j" podStartSLOduration=250.989560026 podStartE2EDuration="4m13.246037001s" totalImagesPullingTime="2.256476975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:20.244293807 +0000 UTC m=+288.473919864" watchObservedRunningTime="2026-07-02 20:19:20.246037001 +0000 UTC m=+288.475663055" Jul 02 20:19:20.680836 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.680730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:20.680836 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.680792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:20.681458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.681430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a87a736a-f2e4-4c38-8fbe-d4887256c30b-service-ca-bundle\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:20.683165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.683146 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a87a736a-f2e4-4c38-8fbe-d4887256c30b-metrics-certs\") pod \"router-default-5c4c9dbcfc-phdxg\" (UID: \"a87a736a-f2e4-4c38-8fbe-d4887256c30b\") " pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:20.975147 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:20.975103 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:21.104798 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.104764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c4c9dbcfc-phdxg"] Jul 02 20:19:21.108625 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:21.108584 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87a736a_f2e4_4c38_8fbe_d4887256c30b.slice/crio-7a7b748b5a622bcdaface9938a7483ee0d84077086e32f1879b62ef5a315bda3 WatchSource:0}: Error finding container 7a7b748b5a622bcdaface9938a7483ee0d84077086e32f1879b62ef5a315bda3: Status 404 returned error can't find the container with id 7a7b748b5a622bcdaface9938a7483ee0d84077086e32f1879b62ef5a315bda3 Jul 02 20:19:21.232750 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.232646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" event={"ID":"a87a736a-f2e4-4c38-8fbe-d4887256c30b","Type":"ContainerStarted","Data":"659cab11afe9cebb03eb1c3c4bf67f218c76becfbb6be93ba01524df150a124c"} Jul 02 20:19:21.233133 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.232929 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n7p4j" Jul 02 20:19:21.233133 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.232976 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" event={"ID":"a87a736a-f2e4-4c38-8fbe-d4887256c30b","Type":"ContainerStarted","Data":"7a7b748b5a622bcdaface9938a7483ee0d84077086e32f1879b62ef5a315bda3"} Jul 02 20:19:21.255562 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.255501 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" podStartSLOduration=33.255480321 podStartE2EDuration="33.255480321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:21.255291515 +0000 UTC m=+289.484917570" watchObservedRunningTime="2026-07-02 20:19:21.255480321 +0000 UTC m=+289.485106376" Jul 02 20:19:21.975670 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.975626 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:21.978188 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:21.978162 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:22.235853 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:22.235759 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:22.237076 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:22.237052 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c4c9dbcfc-phdxg" Jul 02 20:19:23.740151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.740115 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb"] Jul 02 20:19:23.744959 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.744942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:23.746962 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.746940 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 20:19:23.747054 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.747031 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sc56d\"" Jul 02 20:19:23.750043 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.750022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb"] Jul 02 20:19:23.800778 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.800746 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b9e6547-4306-4253-8bbf-a1f8d8809661-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r78sb\" (UID: \"9b9e6547-4306-4253-8bbf-a1f8d8809661\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:23.901145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:23.901105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b9e6547-4306-4253-8bbf-a1f8d8809661-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r78sb\" (UID: \"9b9e6547-4306-4253-8bbf-a1f8d8809661\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:23.901304 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:23.901254 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 20:19:23.901348 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:23.901325 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9e6547-4306-4253-8bbf-a1f8d8809661-tls-certificates podName:9b9e6547-4306-4253-8bbf-a1f8d8809661 nodeName:}" failed. No retries permitted until 2026-07-02 20:19:24.401306132 +0000 UTC m=+292.630932182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9b9e6547-4306-4253-8bbf-a1f8d8809661-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-r78sb" (UID: "9b9e6547-4306-4253-8bbf-a1f8d8809661") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 20:19:24.406394 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:24.406359 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b9e6547-4306-4253-8bbf-a1f8d8809661-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r78sb\" (UID: \"9b9e6547-4306-4253-8bbf-a1f8d8809661\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:24.408797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:24.408770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b9e6547-4306-4253-8bbf-a1f8d8809661-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r78sb\" (UID: \"9b9e6547-4306-4253-8bbf-a1f8d8809661\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:24.653650 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:24.653596 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:24.783152 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:24.783118 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb"] Jul 02 20:19:24.786779 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:24.786749 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9e6547_4306_4253_8bbf_a1f8d8809661.slice/crio-f1e10d2c62885c92dd0a8b2e22e6e6954dcae22a82d381b89c3c13c5ae5da366 WatchSource:0}: Error finding container f1e10d2c62885c92dd0a8b2e22e6e6954dcae22a82d381b89c3c13c5ae5da366: Status 404 returned error can't find the container with id f1e10d2c62885c92dd0a8b2e22e6e6954dcae22a82d381b89c3c13c5ae5da366 Jul 02 20:19:25.244842 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:25.244810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" event={"ID":"9b9e6547-4306-4253-8bbf-a1f8d8809661","Type":"ContainerStarted","Data":"f1e10d2c62885c92dd0a8b2e22e6e6954dcae22a82d381b89c3c13c5ae5da366"} Jul 02 20:19:25.515813 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:25.515715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:25.518521 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:25.518491 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865a2c34-7554-48d9-b20c-85e62bacf2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cs7hl\" (UID: \"865a2c34-7554-48d9-b20c-85e62bacf2af\") " pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:25.788970 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:25.788883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cs7hl" Jul 02 20:19:25.991803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:25.991768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cs7hl"] Jul 02 20:19:26.249457 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:26.249427 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cs7hl" event={"ID":"865a2c34-7554-48d9-b20c-85e62bacf2af","Type":"ContainerStarted","Data":"5b14dcdff327e9f88d16cd2abab1d90f14928fd0ff981403de6d228af256411e"} Jul 02 20:19:27.255181 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:27.255140 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" event={"ID":"9b9e6547-4306-4253-8bbf-a1f8d8809661","Type":"ContainerStarted","Data":"f97de13ec6d6b1861a0cab330388a1b1afeebe9640251780f81e8002ea61949b"} Jul 02 20:19:27.255721 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:27.255306 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:27.261602 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:27.261575 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" Jul 02 20:19:27.268661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:27.268596 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r78sb" podStartSLOduration=2.840688261 podStartE2EDuration="4.268575964s" totalImagesPullingTime="1.427887703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:27.268545034 +0000 UTC m=+295.498171089" watchObservedRunningTime="2026-07-02 20:19:27.268575964 +0000 UTC m=+295.498202022" Jul 02 20:19:29.362449 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:29.362383 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lq2dw" podUID="63d46d5e-6860-45eb-a6f9-47be88e1fc0c" Jul 02 20:19:30.267394 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:30.267312 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cs7hl" event={"ID":"865a2c34-7554-48d9-b20c-85e62bacf2af","Type":"ContainerStarted","Data":"e041418641ffd5b3122d9fb2af285aed61a82bc87dd9cb30db5ba273e0698867"} Jul 02 20:19:31.238729 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:31.238698 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n7p4j" Jul 02 20:19:31.273515 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:31.273478 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cs7hl" event={"ID":"865a2c34-7554-48d9-b20c-85e62bacf2af","Type":"ContainerStarted","Data":"a3d6be95d484f3f34b506fe1bf19c85b512be77fabe5de28c31d1abb86568a73"} Jul 02 20:19:33.054600 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.054571 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 20:19:33.181322 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.181290 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xxnq2"] Jul 02 20:19:33.184632 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.184616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.187001 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.186974 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 20:19:33.187001 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.186994 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m47xv\"" Jul 02 20:19:33.187175 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.186974 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 20:19:33.187175 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.187028 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 20:19:33.187687 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.187668 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 20:19:33.187768 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.187713 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 20:19:33.188085 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.188069 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 20:19:33.279684 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-metrics-client-ca\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.279885 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.279885 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-wtmp\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.279885 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-tls\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.279885 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjt97\" (UniqueName: \"kubernetes.io/projected/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-kube-api-access-gjt97\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.280099 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-textfile\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.280099 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279941 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.280099 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.279991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-root\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.280099 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.280015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-sys\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.282984 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.282959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cs7hl" event={"ID":"865a2c34-7554-48d9-b20c-85e62bacf2af","Type":"ContainerStarted","Data":"2057a9008fe7883016b3f999838aa44d16fc579671325a6ce7d8ed09775668a6"} Jul 02 20:19:33.298476 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.298431 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cs7hl" podStartSLOduration=33.353343397 podStartE2EDuration="40.298389072s" totalImagesPullingTime="6.945045675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:18:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:33.297778239 +0000 UTC m=+301.527404293" watchObservedRunningTime="2026-07-02 20:19:33.298389072 +0000 UTC m=+301.528015126" Jul 02 20:19:33.381138 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381138 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-wtmp\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-tls\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjt97\" (UniqueName: \"kubernetes.io/projected/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-kube-api-access-gjt97\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-textfile\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-root\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-sys\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-metrics-client-ca\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381899 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-root\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381899 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-sys\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.381999 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.381905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-textfile\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.382045 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.382006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-metrics-client-ca\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.382178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.382131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-wtmp\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.382326 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:33.382306 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 20:19:33.382389 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:33.382369 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-tls podName:88e254a4-9e65-4e09-9a0a-7f5ebaaac03a nodeName:}" failed. No retries permitted until 2026-07-02 20:19:33.882350988 +0000 UTC m=+302.111977023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-tls") pod "node-exporter-xxnq2" (UID: "88e254a4-9e65-4e09-9a0a-7f5ebaaac03a") : secret "node-exporter-tls" not found Jul 02 20:19:33.382564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.382543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.384131 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.384106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.392315 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.392285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjt97\" (UniqueName: \"kubernetes.io/projected/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-kube-api-access-gjt97\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.884700 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.884664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-tls\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:33.887414 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:33.887371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88e254a4-9e65-4e09-9a0a-7f5ebaaac03a-node-exporter-tls\") pod \"node-exporter-xxnq2\" (UID: \"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a\") " pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:34.094358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:34.094311 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxnq2" Jul 02 20:19:34.106671 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:34.106606 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e254a4_9e65_4e09_9a0a_7f5ebaaac03a.slice/crio-4e4a6f05a085aafddd6a82cf14ffbe5c73676c8326e495bba06e47bba83775ab WatchSource:0}: Error finding container 4e4a6f05a085aafddd6a82cf14ffbe5c73676c8326e495bba06e47bba83775ab: Status 404 returned error can't find the container with id 4e4a6f05a085aafddd6a82cf14ffbe5c73676c8326e495bba06e47bba83775ab Jul 02 20:19:34.108829 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:34.108807 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:19:34.287865 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:34.287822 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxnq2" event={"ID":"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a","Type":"ContainerStarted","Data":"4e4a6f05a085aafddd6a82cf14ffbe5c73676c8326e495bba06e47bba83775ab"} Jul 02 20:19:35.292624 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:35.292589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxnq2" event={"ID":"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a","Type":"ContainerStarted","Data":"3fee4abd7e87b2444ef315221914784650d05c7d9be07c701b2dcb82b117f7eb"} Jul 02 20:19:36.136259 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.136218 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69dcc5db59-qnhsj"] Jul 02 20:19:36.139948 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.139921 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.142160 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142131 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 20:19:36.142160 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142155 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3h9k9arehqrt3\"" Jul 02 20:19:36.142388 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142171 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 20:19:36.142388 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142180 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 20:19:36.142388 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142186 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 20:19:36.142640 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142628 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 20:19:36.142878 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.142860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-68s8h\"" Jul 02 20:19:36.150254 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.150231 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69dcc5db59-qnhsj"] Jul 02 20:19:36.203080 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203080 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2d66\" (UniqueName: \"kubernetes.io/projected/82713245-d63d-47a5-9100-7b4b2928d65b-kube-api-access-w2d66\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-tls\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-grpc-tls\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203479 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.203479 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.203370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82713245-d63d-47a5-9100-7b4b2928d65b-metrics-client-ca\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.302263 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.302226 2573 generic.go:356] "Generic (PLEG): container finished" podID="88e254a4-9e65-4e09-9a0a-7f5ebaaac03a" containerID="3fee4abd7e87b2444ef315221914784650d05c7d9be07c701b2dcb82b117f7eb" exitCode=0 Jul 02 20:19:36.302750 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.302285 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxnq2" event={"ID":"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a","Type":"ContainerDied","Data":"3fee4abd7e87b2444ef315221914784650d05c7d9be07c701b2dcb82b117f7eb"} Jul 02 20:19:36.304371 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-grpc-tls\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304445 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304558 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304529 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82713245-d63d-47a5-9100-7b4b2928d65b-metrics-client-ca\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304691 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304691 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304622 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304691 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2d66\" (UniqueName: \"kubernetes.io/projected/82713245-d63d-47a5-9100-7b4b2928d65b-kube-api-access-w2d66\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304691 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.304896 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.304709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-tls\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.305539 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.305507 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82713245-d63d-47a5-9100-7b4b2928d65b-metrics-client-ca\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.307374 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.307352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.307523 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.307501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-grpc-tls\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.307571 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.307508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.307777 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.307747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.308123 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.308103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-tls\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.308195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.308106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82713245-d63d-47a5-9100-7b4b2928d65b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.311749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.311729 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2d66\" (UniqueName: \"kubernetes.io/projected/82713245-d63d-47a5-9100-7b4b2928d65b-kube-api-access-w2d66\") pod \"thanos-querier-69dcc5db59-qnhsj\" (UID: \"82713245-d63d-47a5-9100-7b4b2928d65b\") " pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.449943 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.449911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:36.591847 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:36.591750 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69dcc5db59-qnhsj"] Jul 02 20:19:36.594283 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:36.594253 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82713245_d63d_47a5_9100_7b4b2928d65b.slice/crio-423f50b2789235af734b16453df1fb4271f6dda74d577903f5717e4278d4bce1 WatchSource:0}: Error finding container 423f50b2789235af734b16453df1fb4271f6dda74d577903f5717e4278d4bce1: Status 404 returned error can't find the container with id 423f50b2789235af734b16453df1fb4271f6dda74d577903f5717e4278d4bce1 Jul 02 20:19:37.219695 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.219654 2573 patch_prober.go:28] interesting pod/image-registry-5d6489d8c6-9z6lz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 20:19:37.219856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.219713 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 20:19:37.307165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.307128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"423f50b2789235af734b16453df1fb4271f6dda74d577903f5717e4278d4bce1"} Jul 02 20:19:37.309389 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.309360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxnq2" event={"ID":"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a","Type":"ContainerStarted","Data":"9f85ffbaa0017b641645e53d53a1ca7200ca4d9354a88873adb14958ef900994"} Jul 02 20:19:37.309546 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.309422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxnq2" event={"ID":"88e254a4-9e65-4e09-9a0a-7f5ebaaac03a","Type":"ContainerStarted","Data":"049ff8febf43225aa88193c78b309a5928d7e8d53ae310292599db029b7f8bad"} Jul 02 20:19:37.327462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.327396 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xxnq2" podStartSLOduration=3.185462412 podStartE2EDuration="4.327382207s" totalImagesPullingTime="1.07669417s" totalInitContainerRuntime="65.225625ms" isStatefulPod=true podCreationTimestamp="2026-07-02 20:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:37.325713516 +0000 UTC m=+305.555339568" watchObservedRunningTime="2026-07-02 20:19:37.327382207 +0000 UTC m=+305.557008261" Jul 02 20:19:37.452913 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.452878 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-574d6d9f5b-n9zcv"] Jul 02 20:19:37.456174 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.456146 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.458679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.458643 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 20:19:37.458679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.458655 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d4pmh\"" Jul 02 20:19:37.458920 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.458683 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 20:19:37.458920 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.458758 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 20:19:37.459060 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.458970 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 20:19:37.459117 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.459060 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-727ut4v4l4u26\"" Jul 02 20:19:37.468358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.468327 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-574d6d9f5b-n9zcv"] Jul 02 20:19:37.515651 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0ec122d-0100-404c-bc42-d18b0a628fcf-audit-log\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.515816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec122d-0100-404c-bc42-d18b0a628fcf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.515816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-secret-metrics-server-client-certs\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.515816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8fv9\" (UniqueName: \"kubernetes.io/projected/d0ec122d-0100-404c-bc42-d18b0a628fcf-kube-api-access-j8fv9\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.515816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-secret-metrics-server-tls\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.515816 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0ec122d-0100-404c-bc42-d18b0a628fcf-metrics-server-audit-profiles\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.516083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.515819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-client-ca-bundle\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.616858 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec122d-0100-404c-bc42-d18b0a628fcf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.616858 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-secret-metrics-server-client-certs\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8fv9\" (UniqueName: \"kubernetes.io/projected/d0ec122d-0100-404c-bc42-d18b0a628fcf-kube-api-access-j8fv9\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-secret-metrics-server-tls\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0ec122d-0100-404c-bc42-d18b0a628fcf-metrics-server-audit-profiles\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-client-ca-bundle\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.616996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0ec122d-0100-404c-bc42-d18b0a628fcf-audit-log\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617659 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.617629 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0ec122d-0100-404c-bc42-d18b0a628fcf-audit-log\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.617786 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.617717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec122d-0100-404c-bc42-d18b0a628fcf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.618227 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.618200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0ec122d-0100-404c-bc42-d18b0a628fcf-metrics-server-audit-profiles\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.619474 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.619447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-secret-metrics-server-client-certs\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.619558 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.619520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-secret-metrics-server-tls\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.619558 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.619549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0ec122d-0100-404c-bc42-d18b0a628fcf-client-ca-bundle\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.624192 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.624169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8fv9\" (UniqueName: \"kubernetes.io/projected/d0ec122d-0100-404c-bc42-d18b0a628fcf-kube-api-access-j8fv9\") pod \"metrics-server-574d6d9f5b-n9zcv\" (UID: \"d0ec122d-0100-404c-bc42-d18b0a628fcf\") " pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.768028 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.767928 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:37.918354 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.918316 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-574d6d9f5b-n9zcv"] Jul 02 20:19:37.921903 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:37.921875 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ec122d_0100_404c_bc42_d18b0a628fcf.slice/crio-0ad1103304fb0056cc4b325a22ab7d3ce15ccc067182b9fa930c69ef529e3de2 WatchSource:0}: Error finding container 0ad1103304fb0056cc4b325a22ab7d3ce15ccc067182b9fa930c69ef529e3de2: Status 404 returned error can't find the container with id 0ad1103304fb0056cc4b325a22ab7d3ce15ccc067182b9fa930c69ef529e3de2 Jul 02 20:19:37.923991 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.923966 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m"] Jul 02 20:19:37.928861 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.928841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:37.931138 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.931112 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-slg74\"" Jul 02 20:19:37.931240 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.931145 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 20:19:37.935631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:37.935604 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m"] Jul 02 20:19:38.021247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.021154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv2sc\" (UniqueName: \"kubernetes.io/projected/25948159-f68b-4776-be63-ef37343324a2-kube-api-access-wv2sc\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.021247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.021232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25948159-f68b-4776-be63-ef37343324a2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.122041 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.121996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25948159-f68b-4776-be63-ef37343324a2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.122240 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.122133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv2sc\" (UniqueName: \"kubernetes.io/projected/25948159-f68b-4776-be63-ef37343324a2-kube-api-access-wv2sc\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.122240 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:38.122159 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 20:19:38.122355 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:19:38.122284 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25948159-f68b-4776-be63-ef37343324a2-monitoring-plugin-cert podName:25948159-f68b-4776-be63-ef37343324a2 nodeName:}" failed. No retries permitted until 2026-07-02 20:19:38.622261401 +0000 UTC m=+306.851887455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/25948159-f68b-4776-be63-ef37343324a2-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-xsl8m" (UID: "25948159-f68b-4776-be63-ef37343324a2") : secret "monitoring-plugin-cert" not found Jul 02 20:19:38.132048 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.132018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv2sc\" (UniqueName: \"kubernetes.io/projected/25948159-f68b-4776-be63-ef37343324a2-kube-api-access-wv2sc\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.314754 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.314630 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" event={"ID":"d0ec122d-0100-404c-bc42-d18b0a628fcf","Type":"ContainerStarted","Data":"0ad1103304fb0056cc4b325a22ab7d3ce15ccc067182b9fa930c69ef529e3de2"} Jul 02 20:19:38.626205 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.626111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25948159-f68b-4776-be63-ef37343324a2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.628924 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.628896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25948159-f68b-4776-be63-ef37343324a2-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xsl8m\" (UID: \"25948159-f68b-4776-be63-ef37343324a2\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:38.841092 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:38.841060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:39.210820 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.210784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m"] Jul 02 20:19:39.219602 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:19:39.219567 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25948159_f68b_4776_be63_ef37343324a2.slice/crio-325892fc4d5c0644c33ba8716151cb8ea7518649c3cc07ffce2e2a8e4733c51b WatchSource:0}: Error finding container 325892fc4d5c0644c33ba8716151cb8ea7518649c3cc07ffce2e2a8e4733c51b: Status 404 returned error can't find the container with id 325892fc4d5c0644c33ba8716151cb8ea7518649c3cc07ffce2e2a8e4733c51b Jul 02 20:19:39.229032 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.228985 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:19:39.231521 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.231500 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d6489d8c6-9z6lz"] Jul 02 20:19:39.320524 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.320482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"2d132230efb28f2250077169a90115259ae4964ee8bab8de5f0a8a368805357c"} Jul 02 20:19:39.320929 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.320614 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"8f3447c83eb239c8a0da8ae0b668585182802c436efb7f922c206cf1300c5cd5"} Jul 02 20:19:39.320929 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.320663 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"0ae28c5486d0a4b7e73c52b30400150567f5603b640a18daad71fb220a68fd6f"} Jul 02 20:19:39.321845 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:39.321815 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" event={"ID":"25948159-f68b-4776-be63-ef37343324a2","Type":"ContainerStarted","Data":"325892fc4d5c0644c33ba8716151cb8ea7518649c3cc07ffce2e2a8e4733c51b"} Jul 02 20:19:41.332341 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.332310 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" event={"ID":"d0ec122d-0100-404c-bc42-d18b0a628fcf","Type":"ContainerStarted","Data":"5fb6614dcd0cdf49c4d527f9ad41226a7aca74bd31cd6d57dcf2448e4c0d7d57"} Jul 02 20:19:41.335377 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.335346 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"5dd1e32f88a37c797f100615c260694ca716f1c4760fb0bf212a52d8662c1c83"} Jul 02 20:19:41.335527 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.335429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"987417a31b99a8aab0300e7a0fea0f63b173402d28b07e9245c1069f9e9352b1"} Jul 02 20:19:41.335527 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.335469 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" event={"ID":"82713245-d63d-47a5-9100-7b4b2928d65b","Type":"ContainerStarted","Data":"dfa028baa5b4ad6672f2ac1f9aad714453980d1549f84b7f0d0af75b7b3e3ba2"} Jul 02 20:19:41.335642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.335569 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:41.350164 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.350114 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" podStartSLOduration=1.8502307569999998 podStartE2EDuration="4.350095978s" totalImagesPullingTime="2.499865221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:41.348963655 +0000 UTC m=+309.578589706" watchObservedRunningTime="2026-07-02 20:19:41.350095978 +0000 UTC m=+309.579722031" Jul 02 20:19:41.371003 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:41.370947 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" podStartSLOduration=1.723182264 podStartE2EDuration="5.370927767s" totalImagesPullingTime="3.647745503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:41.36982 +0000 UTC m=+309.599446067" watchObservedRunningTime="2026-07-02 20:19:41.370927767 +0000 UTC m=+309.600553821" Jul 02 20:19:42.345867 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:42.345826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" event={"ID":"25948159-f68b-4776-be63-ef37343324a2","Type":"ContainerStarted","Data":"818e1d491a079f0f24f86e0ee5735c940b8cdf04b44db87e0aa8b4c796cef429"} Jul 02 20:19:42.360277 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:42.360248 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:19:42.361830 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:42.361783 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" podStartSLOduration=3.293143539 podStartE2EDuration="5.361767781s" totalImagesPullingTime="2.068624242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:42.360883012 +0000 UTC m=+310.590509067" watchObservedRunningTime="2026-07-02 20:19:42.361767781 +0000 UTC m=+310.591393856" Jul 02 20:19:43.349925 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:43.349886 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:43.354892 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:43.354868 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xsl8m" Jul 02 20:19:47.352543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:47.352513 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69dcc5db59-qnhsj" Jul 02 20:19:57.768642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:57.768605 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:19:57.769038 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:19:57.768670 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:20:02.490395 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.490355 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5875499d-qh8ll"] Jul 02 20:20:02.497267 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.497238 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.499644 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.499616 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 20:20:02.499775 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.499616 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 20:20:02.500714 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.500691 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 20:20:02.500859 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.500717 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bl9th\"" Jul 02 20:20:02.500859 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.500831 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 20:20:02.500984 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.500872 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 20:20:02.501317 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.501213 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 20:20:02.501779 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.501556 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 20:20:02.503717 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.503695 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5875499d-qh8ll"] Jul 02 20:20:02.505621 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.505601 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 20:20:02.627858 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.627818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-console-config\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.627858 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.627862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skrh\" (UniqueName: \"kubernetes.io/projected/023066f8-f7e4-477e-b9b7-7c2037150e62-kube-api-access-8skrh\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.628073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.627884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-service-ca\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.628073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.627936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-oauth-config\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.628073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.627967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-serving-cert\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.628073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.628006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-oauth-serving-cert\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.628073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.628026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-trusted-ca-bundle\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729278 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-console-config\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skrh\" (UniqueName: \"kubernetes.io/projected/023066f8-f7e4-477e-b9b7-7c2037150e62-kube-api-access-8skrh\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-service-ca\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-oauth-config\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-serving-cert\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-oauth-serving-cert\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.729719 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.729465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-trusted-ca-bundle\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.730087 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.730061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-console-config\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.730198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.730154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-service-ca\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.730263 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.730221 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-oauth-serving-cert\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.730263 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.730257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-trusted-ca-bundle\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.731778 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.731748 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-oauth-config\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.731909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.731885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-serving-cert\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.737074 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.737051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skrh\" (UniqueName: \"kubernetes.io/projected/023066f8-f7e4-477e-b9b7-7c2037150e62-kube-api-access-8skrh\") pod \"console-7f5875499d-qh8ll\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.809225 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.809124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:02.942009 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:02.941975 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5875499d-qh8ll"] Jul 02 20:20:02.945539 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:20:02.945511 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023066f8_f7e4_477e_b9b7_7c2037150e62.slice/crio-e4eb5916aad4605ed4ee70fd272ff87e8d908c4743a1ca5a6935dbbe20f4f59f WatchSource:0}: Error finding container e4eb5916aad4605ed4ee70fd272ff87e8d908c4743a1ca5a6935dbbe20f4f59f: Status 404 returned error can't find the container with id e4eb5916aad4605ed4ee70fd272ff87e8d908c4743a1ca5a6935dbbe20f4f59f Jul 02 20:20:03.424025 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:03.423990 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5875499d-qh8ll" event={"ID":"023066f8-f7e4-477e-b9b7-7c2037150e62","Type":"ContainerStarted","Data":"e4eb5916aad4605ed4ee70fd272ff87e8d908c4743a1ca5a6935dbbe20f4f59f"} Jul 02 20:20:04.346011 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:04.345956 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" containerName="registry" containerID="cri-o://ee4112bb9d49218483bb061c52ac437728aa0213c3f1dffc2862b89e68e92a0f" gracePeriod=30 Jul 02 20:20:05.435070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:05.434977 2573 generic.go:356] "Generic (PLEG): container finished" podID="bf61caa0-452b-42dd-910d-055ebbfd1c55" containerID="ee4112bb9d49218483bb061c52ac437728aa0213c3f1dffc2862b89e68e92a0f" exitCode=0 Jul 02 20:20:05.435533 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:05.435063 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" event={"ID":"bf61caa0-452b-42dd-910d-055ebbfd1c55","Type":"ContainerDied","Data":"ee4112bb9d49218483bb061c52ac437728aa0213c3f1dffc2862b89e68e92a0f"} Jul 02 20:20:06.258661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.258626 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:20:06.359818 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.359786 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-certificates\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.359970 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.359848 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-installation-pull-secrets\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.359970 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.359878 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-bound-sa-token\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.359970 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.359921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.359970 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.359945 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkmqp\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-kube-api-access-pkmqp\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.360185 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.360049 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-image-registry-private-configuration\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.360185 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.360091 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf61caa0-452b-42dd-910d-055ebbfd1c55-ca-trust-extracted\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.360185 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.360176 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-trusted-ca\") pod \"bf61caa0-452b-42dd-910d-055ebbfd1c55\" (UID: \"bf61caa0-452b-42dd-910d-055ebbfd1c55\") " Jul 02 20:20:06.362122 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.360546 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:20:06.362122 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.360804 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:20:06.362642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.362612 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-kube-api-access-pkmqp" (OuterVolumeSpecName: "kube-api-access-pkmqp") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "kube-api-access-pkmqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:20:06.362773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.362645 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:20:06.362773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.362657 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:20:06.362773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.362754 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:20:06.362933 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.362894 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:20:06.370942 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.370914 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf61caa0-452b-42dd-910d-055ebbfd1c55-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bf61caa0-452b-42dd-910d-055ebbfd1c55" (UID: "bf61caa0-452b-42dd-910d-055ebbfd1c55"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:20:06.440541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.440518 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" Jul 02 20:20:06.440859 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.440516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6489d8c6-9z6lz" event={"ID":"bf61caa0-452b-42dd-910d-055ebbfd1c55","Type":"ContainerDied","Data":"e179a1eb8a4310772f43c91550f9de414815fba44b94b687a231f22b4011c8ab"} Jul 02 20:20:06.440859 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.440651 2573 scope.go:117] "RemoveContainer" containerID="ee4112bb9d49218483bb061c52ac437728aa0213c3f1dffc2862b89e68e92a0f" Jul 02 20:20:06.461247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461216 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-tls\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461240 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkmqp\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-kube-api-access-pkmqp\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461250 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-image-registry-private-configuration\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461439 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461261 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf61caa0-452b-42dd-910d-055ebbfd1c55-ca-trust-extracted\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461439 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461269 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-trusted-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461439 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461278 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf61caa0-452b-42dd-910d-055ebbfd1c55-registry-certificates\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461439 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461285 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf61caa0-452b-42dd-910d-055ebbfd1c55-installation-pull-secrets\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.461439 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.461294 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf61caa0-452b-42dd-910d-055ebbfd1c55-bound-sa-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:20:06.470762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.470742 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d6489d8c6-9z6lz"] Jul 02 20:20:06.473213 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:06.473188 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d6489d8c6-9z6lz"] Jul 02 20:20:07.448650 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:07.448616 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5875499d-qh8ll" event={"ID":"023066f8-f7e4-477e-b9b7-7c2037150e62","Type":"ContainerStarted","Data":"1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73"} Jul 02 20:20:07.467284 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:07.467231 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5875499d-qh8ll" podStartSLOduration=1.9902861 podStartE2EDuration="5.467215801s" totalImagesPullingTime="3.476929701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:20:07.465834187 +0000 UTC m=+335.695460242" watchObservedRunningTime="2026-07-02 20:20:07.467215801 +0000 UTC m=+335.696841854" Jul 02 20:20:08.365740 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:08.365710 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" path="/var/lib/kubelet/pods/bf61caa0-452b-42dd-910d-055ebbfd1c55/volumes" Jul 02 20:20:12.809482 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:12.809435 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:12.809866 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:12.809495 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:12.814257 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:12.814231 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:13.477051 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:13.477015 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:20:17.774709 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:17.774674 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:20:17.779138 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:17.779104 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-574d6d9f5b-n9zcv" Jul 02 20:20:18.492225 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:18.492191 2573 generic.go:356] "Generic (PLEG): container finished" podID="8efdf623-86a7-4dce-9fa6-88d8c14ab130" containerID="268c1e8f32effde512807e20bd448d28f640549a1db72e13967ad8ae04e2bbae" exitCode=0 Jul 02 20:20:18.492418 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:18.492260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" event={"ID":"8efdf623-86a7-4dce-9fa6-88d8c14ab130","Type":"ContainerDied","Data":"268c1e8f32effde512807e20bd448d28f640549a1db72e13967ad8ae04e2bbae"} Jul 02 20:20:18.492658 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:18.492644 2573 scope.go:117] "RemoveContainer" containerID="268c1e8f32effde512807e20bd448d28f640549a1db72e13967ad8ae04e2bbae" Jul 02 20:20:19.498278 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:19.498243 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-m8b49" event={"ID":"8efdf623-86a7-4dce-9fa6-88d8c14ab130","Type":"ContainerStarted","Data":"fa16c62104e9e055a6419ae32d76c30678f2fb30c6a43f8d3b19140bacff6f84"} Jul 02 20:20:28.531650 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:28.531613 2573 generic.go:356] "Generic (PLEG): container finished" podID="451ed327-1ccb-4d5f-8517-b4c34cd68ca7" containerID="4caa091f24a2126821521655a28e61cb3cc475f905f8091106e766a9bf7d1992" exitCode=0 Jul 02 20:20:28.532113 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:28.531661 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" event={"ID":"451ed327-1ccb-4d5f-8517-b4c34cd68ca7","Type":"ContainerDied","Data":"4caa091f24a2126821521655a28e61cb3cc475f905f8091106e766a9bf7d1992"} Jul 02 20:20:28.532113 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:28.532059 2573 scope.go:117] "RemoveContainer" containerID="4caa091f24a2126821521655a28e61cb3cc475f905f8091106e766a9bf7d1992" Jul 02 20:20:29.538165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:29.538132 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cbphl" event={"ID":"451ed327-1ccb-4d5f-8517-b4c34cd68ca7","Type":"ContainerStarted","Data":"0435f98e86a0922480ce00e841b317ce03892cd6d2afc4224197fea270f64d1f"} Jul 02 20:20:46.194048 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:46.194004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:20:46.196483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:46.196446 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63d46d5e-6860-45eb-a6f9-47be88e1fc0c-metrics-certs\") pod \"network-metrics-daemon-lq2dw\" (UID: \"63d46d5e-6860-45eb-a6f9-47be88e1fc0c\") " pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:20:46.263746 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:46.263709 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpl6\"" Jul 02 20:20:46.271084 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:46.271050 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lq2dw" Jul 02 20:20:46.406750 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:46.406719 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lq2dw"] Jul 02 20:20:46.409836 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:20:46.409806 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d46d5e_6860_45eb_a6f9_47be88e1fc0c.slice/crio-79a22e01656a19a9ce47c0364e52a1b9ff5db97cee6382dbe56b634f67d109b0 WatchSource:0}: Error finding container 79a22e01656a19a9ce47c0364e52a1b9ff5db97cee6382dbe56b634f67d109b0: Status 404 returned error can't find the container with id 79a22e01656a19a9ce47c0364e52a1b9ff5db97cee6382dbe56b634f67d109b0 Jul 02 20:20:46.609140 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:46.609103 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lq2dw" event={"ID":"63d46d5e-6860-45eb-a6f9-47be88e1fc0c","Type":"ContainerStarted","Data":"79a22e01656a19a9ce47c0364e52a1b9ff5db97cee6382dbe56b634f67d109b0"} Jul 02 20:20:48.619041 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:48.619002 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lq2dw" event={"ID":"63d46d5e-6860-45eb-a6f9-47be88e1fc0c","Type":"ContainerStarted","Data":"5100ecc607f4e3fef661261aa29b79acd58867ff4aa49eaff599fa86cd6b5569"} Jul 02 20:20:48.619556 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:48.619056 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lq2dw" event={"ID":"63d46d5e-6860-45eb-a6f9-47be88e1fc0c","Type":"ContainerStarted","Data":"3e041abe4c91102a84a59522f7324a3ff8e392a3d504bd28600e82ad946584e0"} Jul 02 20:20:48.634654 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:20:48.634598 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lq2dw" podStartSLOduration=374.447829451 podStartE2EDuration="6m15.634581279s" totalImagesPullingTime="1.186751828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:20:48.633447201 +0000 UTC m=+376.863073255" watchObservedRunningTime="2026-07-02 20:20:48.634581279 +0000 UTC m=+376.864207333" Jul 02 20:21:14.006314 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:14.006266 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5875499d-qh8ll"] Jul 02 20:21:39.027859 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.027810 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f5875499d-qh8ll" podUID="023066f8-f7e4-477e-b9b7-7c2037150e62" containerName="console" containerID="cri-o://1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73" gracePeriod=15 Jul 02 20:21:39.272814 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.272786 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:21:39.326202 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326097 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-trusted-ca-bundle\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326202 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326153 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-serving-cert\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326202 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326196 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-console-config\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326295 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-oauth-config\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326331 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-service-ca\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326364 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8skrh\" (UniqueName: \"kubernetes.io/projected/023066f8-f7e4-477e-b9b7-7c2037150e62-kube-api-access-8skrh\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326449 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-oauth-serving-cert\") pod \"023066f8-f7e4-477e-b9b7-7c2037150e62\" (UID: \"023066f8-f7e4-477e-b9b7-7c2037150e62\") " Jul 02 20:21:39.326735 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326705 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-console-config" (OuterVolumeSpecName: "console-config") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:21:39.326735 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326718 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:21:39.326821 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326763 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:21:39.326821 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.326782 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-service-ca" (OuterVolumeSpecName: "service-ca") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:21:39.328772 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.328745 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:21:39.328772 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.328742 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023066f8-f7e4-477e-b9b7-7c2037150e62-kube-api-access-8skrh" (OuterVolumeSpecName: "kube-api-access-8skrh") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "kube-api-access-8skrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:21:39.328922 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.328765 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "023066f8-f7e4-477e-b9b7-7c2037150e62" (UID: "023066f8-f7e4-477e-b9b7-7c2037150e62"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:21:39.427483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427430 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-console-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.427483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427476 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-oauth-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.427483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427488 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-service-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.427483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427499 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8skrh\" (UniqueName: \"kubernetes.io/projected/023066f8-f7e4-477e-b9b7-7c2037150e62-kube-api-access-8skrh\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.427761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427507 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-oauth-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.427761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427517 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/023066f8-f7e4-477e-b9b7-7c2037150e62-trusted-ca-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.427761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.427526 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/023066f8-f7e4-477e-b9b7-7c2037150e62-console-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:21:39.808266 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.808230 2573 generic.go:356] "Generic (PLEG): container finished" podID="023066f8-f7e4-477e-b9b7-7c2037150e62" containerID="1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73" exitCode=0 Jul 02 20:21:39.808462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.808275 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5875499d-qh8ll" event={"ID":"023066f8-f7e4-477e-b9b7-7c2037150e62","Type":"ContainerDied","Data":"1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73"} Jul 02 20:21:39.808462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.808311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5875499d-qh8ll" event={"ID":"023066f8-f7e4-477e-b9b7-7c2037150e62","Type":"ContainerDied","Data":"e4eb5916aad4605ed4ee70fd272ff87e8d908c4743a1ca5a6935dbbe20f4f59f"} Jul 02 20:21:39.808462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.808330 2573 scope.go:117] "RemoveContainer" containerID="1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73" Jul 02 20:21:39.808462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.808277 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5875499d-qh8ll" Jul 02 20:21:39.817023 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.817006 2573 scope.go:117] "RemoveContainer" containerID="1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73" Jul 02 20:21:39.817309 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:21:39.817285 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73\": container with ID starting with 1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73 not found: ID does not exist" containerID="1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73" Jul 02 20:21:39.817358 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.817317 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73"} err="failed to get container status \"1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73\": rpc error: code = NotFound desc = could not find container \"1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73\": container with ID starting with 1af385573cbff84bf321ecc272e0701a9e90a8afa24c2e129c287641a9be5d73 not found: ID does not exist" Jul 02 20:21:39.828214 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.828185 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5875499d-qh8ll"] Jul 02 20:21:39.833587 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:39.833557 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5875499d-qh8ll"] Jul 02 20:21:40.370238 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:21:40.370202 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023066f8-f7e4-477e-b9b7-7c2037150e62" path="/var/lib/kubelet/pods/023066f8-f7e4-477e-b9b7-7c2037150e62/volumes" Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.482683 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w"] Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.483279 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" containerName="registry" Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.483298 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" containerName="registry" Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.483342 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023066f8-f7e4-477e-b9b7-7c2037150e62" containerName="console" Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.483351 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="023066f8-f7e4-477e-b9b7-7c2037150e62" containerName="console" Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.483510 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf61caa0-452b-42dd-910d-055ebbfd1c55" containerName="registry" Jul 02 20:23:21.484888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.483525 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="023066f8-f7e4-477e-b9b7-7c2037150e62" containerName="console" Jul 02 20:23:21.487937 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.487913 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.490243 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.490222 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 20:23:21.491028 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.491012 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 20:23:21.491028 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.491022 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-775r4\"" Jul 02 20:23:21.496200 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.496174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w"] Jul 02 20:23:21.610596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.610551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.610764 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.610618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7fcr\" (UniqueName: \"kubernetes.io/projected/d9a4094b-454a-4120-8dc0-915ab6a7438d-kube-api-access-c7fcr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.610764 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.610654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.711720 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.711683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.711891 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.711743 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7fcr\" (UniqueName: \"kubernetes.io/projected/d9a4094b-454a-4120-8dc0-915ab6a7438d-kube-api-access-c7fcr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.711891 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.711784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.712113 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.712091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.712150 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.712135 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.722378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.722343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7fcr\" (UniqueName: \"kubernetes.io/projected/d9a4094b-454a-4120-8dc0-915ab6a7438d-kube-api-access-c7fcr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.798053 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.797949 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:21.926490 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:21.926304 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w"] Jul 02 20:23:21.929184 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:23:21.929153 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a4094b_454a_4120_8dc0_915ab6a7438d.slice/crio-86ec2cdc8917b82c202ff6f3f98344cec27bce088b8b08bc57586678ccc950ee WatchSource:0}: Error finding container 86ec2cdc8917b82c202ff6f3f98344cec27bce088b8b08bc57586678ccc950ee: Status 404 returned error can't find the container with id 86ec2cdc8917b82c202ff6f3f98344cec27bce088b8b08bc57586678ccc950ee Jul 02 20:23:22.180737 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:22.180648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" event={"ID":"d9a4094b-454a-4120-8dc0-915ab6a7438d","Type":"ContainerStarted","Data":"86ec2cdc8917b82c202ff6f3f98344cec27bce088b8b08bc57586678ccc950ee"} Jul 02 20:23:30.215325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:30.215290 2573 generic.go:356] "Generic (PLEG): container finished" podID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerID="f414106d512efeb85ea1f4bf45b4bc81536c1202035279d87cdf23e670f2671d" exitCode=0 Jul 02 20:23:30.215325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:30.215327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" event={"ID":"d9a4094b-454a-4120-8dc0-915ab6a7438d","Type":"ContainerDied","Data":"f414106d512efeb85ea1f4bf45b4bc81536c1202035279d87cdf23e670f2671d"} Jul 02 20:23:33.229582 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:33.229546 2573 generic.go:356] "Generic (PLEG): container finished" podID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerID="a8378bc89f2f267e0f7af583a298405eb865238b7f3ca6852b336c7ea6b1c577" exitCode=0 Jul 02 20:23:33.229951 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:33.229600 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" event={"ID":"d9a4094b-454a-4120-8dc0-915ab6a7438d","Type":"ContainerDied","Data":"a8378bc89f2f267e0f7af583a298405eb865238b7f3ca6852b336c7ea6b1c577"} Jul 02 20:23:42.265067 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:42.265031 2573 generic.go:356] "Generic (PLEG): container finished" podID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerID="ae0239bd75ee1c36bf64dde80222a0fe52acb55f1b093a35ad8c7007526100ad" exitCode=0 Jul 02 20:23:42.265067 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:42.265073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" event={"ID":"d9a4094b-454a-4120-8dc0-915ab6a7438d","Type":"ContainerDied","Data":"ae0239bd75ee1c36bf64dde80222a0fe52acb55f1b093a35ad8c7007526100ad"} Jul 02 20:23:43.422620 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.422579 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:43.491870 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.491831 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-bundle\") pod \"d9a4094b-454a-4120-8dc0-915ab6a7438d\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " Jul 02 20:23:43.491870 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.491875 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7fcr\" (UniqueName: \"kubernetes.io/projected/d9a4094b-454a-4120-8dc0-915ab6a7438d-kube-api-access-c7fcr\") pod \"d9a4094b-454a-4120-8dc0-915ab6a7438d\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " Jul 02 20:23:43.492071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.491937 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-util\") pod \"d9a4094b-454a-4120-8dc0-915ab6a7438d\" (UID: \"d9a4094b-454a-4120-8dc0-915ab6a7438d\") " Jul 02 20:23:43.492670 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.492644 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-bundle" (OuterVolumeSpecName: "bundle") pod "d9a4094b-454a-4120-8dc0-915ab6a7438d" (UID: "d9a4094b-454a-4120-8dc0-915ab6a7438d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:23:43.494637 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.494613 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a4094b-454a-4120-8dc0-915ab6a7438d-kube-api-access-c7fcr" (OuterVolumeSpecName: "kube-api-access-c7fcr") pod "d9a4094b-454a-4120-8dc0-915ab6a7438d" (UID: "d9a4094b-454a-4120-8dc0-915ab6a7438d"). InnerVolumeSpecName "kube-api-access-c7fcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:23:43.497344 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.497322 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-util" (OuterVolumeSpecName: "util") pod "d9a4094b-454a-4120-8dc0-915ab6a7438d" (UID: "d9a4094b-454a-4120-8dc0-915ab6a7438d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:23:43.593162 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.593071 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:23:43.593162 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.593103 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7fcr\" (UniqueName: \"kubernetes.io/projected/d9a4094b-454a-4120-8dc0-915ab6a7438d-kube-api-access-c7fcr\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:23:43.593162 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:43.593114 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9a4094b-454a-4120-8dc0-915ab6a7438d-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:23:44.274504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:44.274467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" event={"ID":"d9a4094b-454a-4120-8dc0-915ab6a7438d","Type":"ContainerDied","Data":"86ec2cdc8917b82c202ff6f3f98344cec27bce088b8b08bc57586678ccc950ee"} Jul 02 20:23:44.274664 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:44.274515 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jh86w" Jul 02 20:23:44.274664 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:44.274522 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86ec2cdc8917b82c202ff6f3f98344cec27bce088b8b08bc57586678ccc950ee" Jul 02 20:23:49.241338 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241307 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj"] Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241586 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="extract" Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241597 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="extract" Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241609 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="pull" Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241614 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="pull" Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241622 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="util" Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241627 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="util" Jul 02 20:23:49.241804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.241680 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a4094b-454a-4120-8dc0-915ab6a7438d" containerName="extract" Jul 02 20:23:49.243961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.243943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.246137 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.246115 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 20:23:49.246259 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.246137 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nwpmq\"" Jul 02 20:23:49.246324 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.246252 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:23:49.267663 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.267637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj"] Jul 02 20:23:49.343233 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.343194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef7efe08-abfe-496b-953c-c54ff9a916d6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrffj\" (UID: \"ef7efe08-abfe-496b-953c-c54ff9a916d6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.343431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.343251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9j9q\" (UniqueName: \"kubernetes.io/projected/ef7efe08-abfe-496b-953c-c54ff9a916d6-kube-api-access-x9j9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrffj\" (UID: \"ef7efe08-abfe-496b-953c-c54ff9a916d6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.444388 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.444347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef7efe08-abfe-496b-953c-c54ff9a916d6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrffj\" (UID: \"ef7efe08-abfe-496b-953c-c54ff9a916d6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.444617 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.444436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9j9q\" (UniqueName: \"kubernetes.io/projected/ef7efe08-abfe-496b-953c-c54ff9a916d6-kube-api-access-x9j9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrffj\" (UID: \"ef7efe08-abfe-496b-953c-c54ff9a916d6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.444828 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.444804 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef7efe08-abfe-496b-953c-c54ff9a916d6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrffj\" (UID: \"ef7efe08-abfe-496b-953c-c54ff9a916d6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.455668 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.455638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9j9q\" (UniqueName: \"kubernetes.io/projected/ef7efe08-abfe-496b-953c-c54ff9a916d6-kube-api-access-x9j9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrffj\" (UID: \"ef7efe08-abfe-496b-953c-c54ff9a916d6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.553366 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.553282 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" Jul 02 20:23:49.691344 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:49.691310 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj"] Jul 02 20:23:49.695360 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:23:49.695329 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7efe08_abfe_496b_953c_c54ff9a916d6.slice/crio-2308c031be29312b589c093dd1dab48bef7c9bd33ec460d696403922498f7d01 WatchSource:0}: Error finding container 2308c031be29312b589c093dd1dab48bef7c9bd33ec460d696403922498f7d01: Status 404 returned error can't find the container with id 2308c031be29312b589c093dd1dab48bef7c9bd33ec460d696403922498f7d01 Jul 02 20:23:50.301028 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:50.300993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" event={"ID":"ef7efe08-abfe-496b-953c-c54ff9a916d6","Type":"ContainerStarted","Data":"2308c031be29312b589c093dd1dab48bef7c9bd33ec460d696403922498f7d01"} Jul 02 20:23:51.312418 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:51.312371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" event={"ID":"ef7efe08-abfe-496b-953c-c54ff9a916d6","Type":"ContainerStarted","Data":"73de99589042de4a2a417162ee9c7979bbf430e71575778e784246798cae2116"} Jul 02 20:23:51.333966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:51.333912 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrffj" podStartSLOduration=0.921727117 podStartE2EDuration="2.333893974s" totalImagesPullingTime="1.412166857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:23:51.332532928 +0000 UTC m=+559.562159007" watchObservedRunningTime="2026-07-02 20:23:51.333893974 +0000 UTC m=+559.563520027" Jul 02 20:23:52.556914 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.556870 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn"] Jul 02 20:23:52.560357 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.560338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.562717 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.562694 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-775r4\"" Jul 02 20:23:52.562815 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.562746 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 20:23:52.563460 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.563446 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 20:23:52.571316 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.571291 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn"] Jul 02 20:23:52.670611 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.670568 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv9c2\" (UniqueName: \"kubernetes.io/projected/767a7641-cf54-451b-8eb6-4ef7c1e17347-kube-api-access-vv9c2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.670611 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.670614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.670814 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.670664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.771118 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.771075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv9c2\" (UniqueName: \"kubernetes.io/projected/767a7641-cf54-451b-8eb6-4ef7c1e17347-kube-api-access-vv9c2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.771279 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.771125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.771279 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.771168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.771578 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.771557 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.771620 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.771591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.788163 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.788131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv9c2\" (UniqueName: \"kubernetes.io/projected/767a7641-cf54-451b-8eb6-4ef7c1e17347-kube-api-access-vv9c2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:52.869228 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:52.869142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:53.001648 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.001608 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v2c5v"] Jul 02 20:23:53.006078 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:23:53.006053 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767a7641_cf54_451b_8eb6_4ef7c1e17347.slice/crio-a3182151cb16b572e5129a16bdf05626668d75cca5168e1382e428c4dbb4d68d WatchSource:0}: Error finding container a3182151cb16b572e5129a16bdf05626668d75cca5168e1382e428c4dbb4d68d: Status 404 returned error can't find the container with id a3182151cb16b572e5129a16bdf05626668d75cca5168e1382e428c4dbb4d68d Jul 02 20:23:53.006204 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.006190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn"] Jul 02 20:23:53.006295 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.006284 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.008480 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.008456 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 20:23:53.008637 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.008589 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 20:23:53.008637 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.008591 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ckj2n\"" Jul 02 20:23:53.013604 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.013587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v2c5v"] Jul 02 20:23:53.174805 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.174711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mqsc\" (UniqueName: \"kubernetes.io/projected/0d5ba952-9914-444c-94c7-89ec239bb0c4-kube-api-access-6mqsc\") pod \"cert-manager-webhook-6486ffd997-v2c5v\" (UID: \"0d5ba952-9914-444c-94c7-89ec239bb0c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.174805 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.174770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d5ba952-9914-444c-94c7-89ec239bb0c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v2c5v\" (UID: \"0d5ba952-9914-444c-94c7-89ec239bb0c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.275512 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.275478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mqsc\" (UniqueName: \"kubernetes.io/projected/0d5ba952-9914-444c-94c7-89ec239bb0c4-kube-api-access-6mqsc\") pod \"cert-manager-webhook-6486ffd997-v2c5v\" (UID: \"0d5ba952-9914-444c-94c7-89ec239bb0c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.275670 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.275535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d5ba952-9914-444c-94c7-89ec239bb0c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v2c5v\" (UID: \"0d5ba952-9914-444c-94c7-89ec239bb0c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.282730 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.282704 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d5ba952-9914-444c-94c7-89ec239bb0c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v2c5v\" (UID: \"0d5ba952-9914-444c-94c7-89ec239bb0c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.282842 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.282765 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mqsc\" (UniqueName: \"kubernetes.io/projected/0d5ba952-9914-444c-94c7-89ec239bb0c4-kube-api-access-6mqsc\") pod \"cert-manager-webhook-6486ffd997-v2c5v\" (UID: \"0d5ba952-9914-444c-94c7-89ec239bb0c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.321256 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.321228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:53.322433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.322387 2573 generic.go:356] "Generic (PLEG): container finished" podID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerID="e4ba7e53256de872c915bc2df6cbef556e6c9b7383613931578bea7a2b1af441" exitCode=0 Jul 02 20:23:53.322547 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.322441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" event={"ID":"767a7641-cf54-451b-8eb6-4ef7c1e17347","Type":"ContainerDied","Data":"e4ba7e53256de872c915bc2df6cbef556e6c9b7383613931578bea7a2b1af441"} Jul 02 20:23:53.322547 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.322495 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" event={"ID":"767a7641-cf54-451b-8eb6-4ef7c1e17347","Type":"ContainerStarted","Data":"a3182151cb16b572e5129a16bdf05626668d75cca5168e1382e428c4dbb4d68d"} Jul 02 20:23:53.449017 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:53.448925 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v2c5v"] Jul 02 20:23:53.451674 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:23:53.451639 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d5ba952_9914_444c_94c7_89ec239bb0c4.slice/crio-702e0905f4bd18b55d2eea2ae50e907aabc17ef86875b329f131c1a256c4387f WatchSource:0}: Error finding container 702e0905f4bd18b55d2eea2ae50e907aabc17ef86875b329f131c1a256c4387f: Status 404 returned error can't find the container with id 702e0905f4bd18b55d2eea2ae50e907aabc17ef86875b329f131c1a256c4387f Jul 02 20:23:54.333072 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:54.333030 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" event={"ID":"0d5ba952-9914-444c-94c7-89ec239bb0c4","Type":"ContainerStarted","Data":"702e0905f4bd18b55d2eea2ae50e907aabc17ef86875b329f131c1a256c4387f"} Jul 02 20:23:55.339882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:55.339793 2573 generic.go:356] "Generic (PLEG): container finished" podID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerID="97915d7d57f165fc605f99e0d843c0c41755ddcff6a04f9f9abbf0e2fa46d7f2" exitCode=0 Jul 02 20:23:55.340275 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:55.339881 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" event={"ID":"767a7641-cf54-451b-8eb6-4ef7c1e17347","Type":"ContainerDied","Data":"97915d7d57f165fc605f99e0d843c0c41755ddcff6a04f9f9abbf0e2fa46d7f2"} Jul 02 20:23:56.349056 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:56.349019 2573 generic.go:356] "Generic (PLEG): container finished" podID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerID="73bbe042d74ab37c0ec4b2ac78b552f9f9a6b0b03607c0412e9b0ba5ca2b994d" exitCode=0 Jul 02 20:23:56.349482 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:56.349094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" event={"ID":"767a7641-cf54-451b-8eb6-4ef7c1e17347","Type":"ContainerDied","Data":"73bbe042d74ab37c0ec4b2ac78b552f9f9a6b0b03607c0412e9b0ba5ca2b994d"} Jul 02 20:23:57.354521 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.354423 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" event={"ID":"0d5ba952-9914-444c-94c7-89ec239bb0c4","Type":"ContainerStarted","Data":"fdcf798899858f34b5238ede6479a8fdda2897ce75906ad684c6323cbbefedc3"} Jul 02 20:23:57.354903 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.354642 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:23:57.370972 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.370916 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" podStartSLOduration=1.832383404 podStartE2EDuration="5.370899625s" totalImagesPullingTime="3.538516221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:23:57.369262832 +0000 UTC m=+565.598888888" watchObservedRunningTime="2026-07-02 20:23:57.370899625 +0000 UTC m=+565.600525679" Jul 02 20:23:57.484761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.484725 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:57.614667 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.614586 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-bundle\") pod \"767a7641-cf54-451b-8eb6-4ef7c1e17347\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " Jul 02 20:23:57.614667 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.614625 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-util\") pod \"767a7641-cf54-451b-8eb6-4ef7c1e17347\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " Jul 02 20:23:57.614871 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.614683 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv9c2\" (UniqueName: \"kubernetes.io/projected/767a7641-cf54-451b-8eb6-4ef7c1e17347-kube-api-access-vv9c2\") pod \"767a7641-cf54-451b-8eb6-4ef7c1e17347\" (UID: \"767a7641-cf54-451b-8eb6-4ef7c1e17347\") " Jul 02 20:23:57.615061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.615033 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-bundle" (OuterVolumeSpecName: "bundle") pod "767a7641-cf54-451b-8eb6-4ef7c1e17347" (UID: "767a7641-cf54-451b-8eb6-4ef7c1e17347"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:23:57.616860 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.616840 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767a7641-cf54-451b-8eb6-4ef7c1e17347-kube-api-access-vv9c2" (OuterVolumeSpecName: "kube-api-access-vv9c2") pod "767a7641-cf54-451b-8eb6-4ef7c1e17347" (UID: "767a7641-cf54-451b-8eb6-4ef7c1e17347"). InnerVolumeSpecName "kube-api-access-vv9c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:23:57.621540 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.621499 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-util" (OuterVolumeSpecName: "util") pod "767a7641-cf54-451b-8eb6-4ef7c1e17347" (UID: "767a7641-cf54-451b-8eb6-4ef7c1e17347"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:23:57.715605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.715564 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv9c2\" (UniqueName: \"kubernetes.io/projected/767a7641-cf54-451b-8eb6-4ef7c1e17347-kube-api-access-vv9c2\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:23:57.715605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.715600 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:23:57.715605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:57.715610 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/767a7641-cf54-451b-8eb6-4ef7c1e17347-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:23:58.359930 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:58.359897 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" event={"ID":"767a7641-cf54-451b-8eb6-4ef7c1e17347","Type":"ContainerDied","Data":"a3182151cb16b572e5129a16bdf05626668d75cca5168e1382e428c4dbb4d68d"} Jul 02 20:23:58.359930 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:58.359920 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8tkxn" Jul 02 20:23:58.359930 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:23:58.359946 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3182151cb16b572e5129a16bdf05626668d75cca5168e1382e428c4dbb4d68d" Jul 02 20:24:03.362156 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:03.362120 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v2c5v" Jul 02 20:24:05.058431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058380 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nw276"] Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058722 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="extract" Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058737 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="extract" Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058747 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="util" Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058754 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="util" Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058769 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="pull" Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058779 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="pull" Jul 02 20:24:05.058905 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.058852 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="767a7641-cf54-451b-8eb6-4ef7c1e17347" containerName="extract" Jul 02 20:24:05.061940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.061922 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.064079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.064060 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gtxqc\"" Jul 02 20:24:05.070647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.070613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a739aae7-3bd9-4fd3-b489-af2a2c54c44a-bound-sa-token\") pod \"cert-manager-55b4d954d5-nw276\" (UID: \"a739aae7-3bd9-4fd3-b489-af2a2c54c44a\") " pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.070762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.070684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh9wf\" (UniqueName: \"kubernetes.io/projected/a739aae7-3bd9-4fd3-b489-af2a2c54c44a-kube-api-access-sh9wf\") pod \"cert-manager-55b4d954d5-nw276\" (UID: \"a739aae7-3bd9-4fd3-b489-af2a2c54c44a\") " pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.070762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.070722 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nw276"] Jul 02 20:24:05.171896 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.171853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a739aae7-3bd9-4fd3-b489-af2a2c54c44a-bound-sa-token\") pod \"cert-manager-55b4d954d5-nw276\" (UID: \"a739aae7-3bd9-4fd3-b489-af2a2c54c44a\") " pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.172074 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.171905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh9wf\" (UniqueName: \"kubernetes.io/projected/a739aae7-3bd9-4fd3-b489-af2a2c54c44a-kube-api-access-sh9wf\") pod \"cert-manager-55b4d954d5-nw276\" (UID: \"a739aae7-3bd9-4fd3-b489-af2a2c54c44a\") " pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.179433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.179380 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a739aae7-3bd9-4fd3-b489-af2a2c54c44a-bound-sa-token\") pod \"cert-manager-55b4d954d5-nw276\" (UID: \"a739aae7-3bd9-4fd3-b489-af2a2c54c44a\") " pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.179540 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.179471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh9wf\" (UniqueName: \"kubernetes.io/projected/a739aae7-3bd9-4fd3-b489-af2a2c54c44a-kube-api-access-sh9wf\") pod \"cert-manager-55b4d954d5-nw276\" (UID: \"a739aae7-3bd9-4fd3-b489-af2a2c54c44a\") " pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.371459 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.371329 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nw276" Jul 02 20:24:05.504846 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:05.504810 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nw276"] Jul 02 20:24:05.508185 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:24:05.508153 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda739aae7_3bd9_4fd3_b489_af2a2c54c44a.slice/crio-7e5463e8cc1eddab5730354e8baaec546b1e3f1554b26cac9f02d8131ffbe237 WatchSource:0}: Error finding container 7e5463e8cc1eddab5730354e8baaec546b1e3f1554b26cac9f02d8131ffbe237: Status 404 returned error can't find the container with id 7e5463e8cc1eddab5730354e8baaec546b1e3f1554b26cac9f02d8131ffbe237 Jul 02 20:24:06.395633 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:06.395597 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nw276" event={"ID":"a739aae7-3bd9-4fd3-b489-af2a2c54c44a","Type":"ContainerStarted","Data":"c576118bf703d88782cf20ec70cbbeb1c5706b7c52ad95691153f9d76c1e397d"} Jul 02 20:24:06.396046 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:06.395646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nw276" event={"ID":"a739aae7-3bd9-4fd3-b489-af2a2c54c44a","Type":"ContainerStarted","Data":"7e5463e8cc1eddab5730354e8baaec546b1e3f1554b26cac9f02d8131ffbe237"} Jul 02 20:24:06.411882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:06.411822 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nw276" podStartSLOduration=1.41180525 podStartE2EDuration="1.41180525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:06.410810445 +0000 UTC m=+574.640436498" watchObservedRunningTime="2026-07-02 20:24:06.41180525 +0000 UTC m=+574.641431305" Jul 02 20:24:12.395770 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.395733 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79"] Jul 02 20:24:12.414286 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.414246 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79"] Jul 02 20:24:12.414462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.414366 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.417033 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.416972 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 20:24:12.417776 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.417739 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 20:24:12.417895 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.417788 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-775r4\"" Jul 02 20:24:12.427558 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.427533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.427660 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.427580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwz9\" (UniqueName: \"kubernetes.io/projected/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-kube-api-access-xmwz9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.427737 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.427710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.528451 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.528375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.528613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.528462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwz9\" (UniqueName: \"kubernetes.io/projected/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-kube-api-access-xmwz9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.528613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.528485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.528880 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.528863 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.528939 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.528863 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.541450 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.541396 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwz9\" (UniqueName: \"kubernetes.io/projected/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-kube-api-access-xmwz9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.725021 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.724975 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:12.874029 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:12.873997 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79"] Jul 02 20:24:12.877798 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:24:12.877772 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ce41e5_1d55_4fef_a173_57af75d1a8a1.slice/crio-3c2799b02ac8a4ba7b11dd52e4e5efe83ab8f6da441212e36331ddb08dc8215f WatchSource:0}: Error finding container 3c2799b02ac8a4ba7b11dd52e4e5efe83ab8f6da441212e36331ddb08dc8215f: Status 404 returned error can't find the container with id 3c2799b02ac8a4ba7b11dd52e4e5efe83ab8f6da441212e36331ddb08dc8215f Jul 02 20:24:13.427158 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:13.427064 2573 generic.go:356] "Generic (PLEG): container finished" podID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerID="fe7f05f84edb2b7465a8e38e83cf6d48b5406b294fc96555a7d315724e551d77" exitCode=0 Jul 02 20:24:13.427158 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:13.427135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" event={"ID":"f3ce41e5-1d55-4fef-a173-57af75d1a8a1","Type":"ContainerDied","Data":"fe7f05f84edb2b7465a8e38e83cf6d48b5406b294fc96555a7d315724e551d77"} Jul 02 20:24:13.427710 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:13.427184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" event={"ID":"f3ce41e5-1d55-4fef-a173-57af75d1a8a1","Type":"ContainerStarted","Data":"3c2799b02ac8a4ba7b11dd52e4e5efe83ab8f6da441212e36331ddb08dc8215f"} Jul 02 20:24:15.437732 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:15.437696 2573 generic.go:356] "Generic (PLEG): container finished" podID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerID="52521f808dc402f89230d8ed6bf50fef5d2d80fcb9c2a761f9b50cfdb61f4d4e" exitCode=0 Jul 02 20:24:15.438209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:15.437739 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" event={"ID":"f3ce41e5-1d55-4fef-a173-57af75d1a8a1","Type":"ContainerDied","Data":"52521f808dc402f89230d8ed6bf50fef5d2d80fcb9c2a761f9b50cfdb61f4d4e"} Jul 02 20:24:16.444099 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:16.444065 2573 generic.go:356] "Generic (PLEG): container finished" podID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerID="54a1e59106b5ac1ce5f95210b958d96f861e5e671ca94c5bf134e8b18034635c" exitCode=0 Jul 02 20:24:16.444503 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:16.444145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" event={"ID":"f3ce41e5-1d55-4fef-a173-57af75d1a8a1","Type":"ContainerDied","Data":"54a1e59106b5ac1ce5f95210b958d96f861e5e671ca94c5bf134e8b18034635c"} Jul 02 20:24:17.581415 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.581375 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:17.670526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.670480 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-util\") pod \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " Jul 02 20:24:17.670526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.670528 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-bundle\") pod \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " Jul 02 20:24:17.670749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.670573 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmwz9\" (UniqueName: \"kubernetes.io/projected/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-kube-api-access-xmwz9\") pod \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\" (UID: \"f3ce41e5-1d55-4fef-a173-57af75d1a8a1\") " Jul 02 20:24:17.671261 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.671234 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-bundle" (OuterVolumeSpecName: "bundle") pod "f3ce41e5-1d55-4fef-a173-57af75d1a8a1" (UID: "f3ce41e5-1d55-4fef-a173-57af75d1a8a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:24:17.672677 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.672647 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-kube-api-access-xmwz9" (OuterVolumeSpecName: "kube-api-access-xmwz9") pod "f3ce41e5-1d55-4fef-a173-57af75d1a8a1" (UID: "f3ce41e5-1d55-4fef-a173-57af75d1a8a1"). InnerVolumeSpecName "kube-api-access-xmwz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:24:17.675804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.675768 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-util" (OuterVolumeSpecName: "util") pod "f3ce41e5-1d55-4fef-a173-57af75d1a8a1" (UID: "f3ce41e5-1d55-4fef-a173-57af75d1a8a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:24:17.771928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.771890 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:24:17.771928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.771918 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:24:17.771928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:17.771929 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmwz9\" (UniqueName: \"kubernetes.io/projected/f3ce41e5-1d55-4fef-a173-57af75d1a8a1-kube-api-access-xmwz9\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:24:18.454840 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:18.454809 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" Jul 02 20:24:18.454999 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:18.454817 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afv9l79" event={"ID":"f3ce41e5-1d55-4fef-a173-57af75d1a8a1","Type":"ContainerDied","Data":"3c2799b02ac8a4ba7b11dd52e4e5efe83ab8f6da441212e36331ddb08dc8215f"} Jul 02 20:24:18.454999 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:18.454928 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c2799b02ac8a4ba7b11dd52e4e5efe83ab8f6da441212e36331ddb08dc8215f" Jul 02 20:24:24.366346 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366319 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm"] Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366624 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="util" Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366636 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="util" Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366650 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="pull" Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366656 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="pull" Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366665 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="extract" Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366671 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="extract" Jul 02 20:24:24.366736 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.366731 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ce41e5-1d55-4fef-a173-57af75d1a8a1" containerName="extract" Jul 02 20:24:24.370690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.370671 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.374006 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.373980 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xncpr\"" Jul 02 20:24:24.374006 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.373996 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 20:24:24.374833 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.374800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 20:24:24.374946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.374856 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 20:24:24.374946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.374889 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 20:24:24.385606 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.385583 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm"] Jul 02 20:24:24.425285 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.425248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/185f564e-f1ca-4ef3-8144-ea28b4a14359-manifests\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.425453 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.425300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185f564e-f1ca-4ef3-8144-ea28b4a14359-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.425516 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.425462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/185f564e-f1ca-4ef3-8144-ea28b4a14359-tmp\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.425516 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.425499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2nq\" (UniqueName: \"kubernetes.io/projected/185f564e-f1ca-4ef3-8144-ea28b4a14359-kube-api-access-tt2nq\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.425605 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.425567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/185f564e-f1ca-4ef3-8144-ea28b4a14359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.526004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.525966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185f564e-f1ca-4ef3-8144-ea28b4a14359-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.526197 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.526025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/185f564e-f1ca-4ef3-8144-ea28b4a14359-tmp\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.526197 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.526054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2nq\" (UniqueName: \"kubernetes.io/projected/185f564e-f1ca-4ef3-8144-ea28b4a14359-kube-api-access-tt2nq\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.526197 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.526084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/185f564e-f1ca-4ef3-8144-ea28b4a14359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.526197 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.526143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/185f564e-f1ca-4ef3-8144-ea28b4a14359-manifests\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.526613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.526591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/185f564e-f1ca-4ef3-8144-ea28b4a14359-manifests\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.528423 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.528376 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/185f564e-f1ca-4ef3-8144-ea28b4a14359-tmp\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.528545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.528530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/185f564e-f1ca-4ef3-8144-ea28b4a14359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.528667 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.528644 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185f564e-f1ca-4ef3-8144-ea28b4a14359-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.534206 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.534183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2nq\" (UniqueName: \"kubernetes.io/projected/185f564e-f1ca-4ef3-8144-ea28b4a14359-kube-api-access-tt2nq\") pod \"opendatahub-operator-controller-manager-78b478dcdf-f2sfm\" (UID: \"185f564e-f1ca-4ef3-8144-ea28b4a14359\") " pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.687595 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.687498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:24.837081 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:24.837056 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm"] Jul 02 20:24:24.839679 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:24:24.839650 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185f564e_f1ca_4ef3_8144_ea28b4a14359.slice/crio-66060f152347453c8d05d8d55d1830f2d827d79500cb6343ae63cf27f6956cf1 WatchSource:0}: Error finding container 66060f152347453c8d05d8d55d1830f2d827d79500cb6343ae63cf27f6956cf1: Status 404 returned error can't find the container with id 66060f152347453c8d05d8d55d1830f2d827d79500cb6343ae63cf27f6956cf1 Jul 02 20:24:25.489808 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:25.489767 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" event={"ID":"185f564e-f1ca-4ef3-8144-ea28b4a14359","Type":"ContainerStarted","Data":"66060f152347453c8d05d8d55d1830f2d827d79500cb6343ae63cf27f6956cf1"} Jul 02 20:24:28.507616 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:28.507577 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" event={"ID":"185f564e-f1ca-4ef3-8144-ea28b4a14359","Type":"ContainerStarted","Data":"bd5a98d8fa01edad9c9a8f79c8aedaea5d00743244143aea77c2e6746e2cca81"} Jul 02 20:24:29.513258 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:29.513225 2573 generic.go:356] "Generic (PLEG): container finished" podID="185f564e-f1ca-4ef3-8144-ea28b4a14359" containerID="bd5a98d8fa01edad9c9a8f79c8aedaea5d00743244143aea77c2e6746e2cca81" exitCode=0 Jul 02 20:24:29.513662 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:29.513270 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" event={"ID":"185f564e-f1ca-4ef3-8144-ea28b4a14359","Type":"ContainerDied","Data":"bd5a98d8fa01edad9c9a8f79c8aedaea5d00743244143aea77c2e6746e2cca81"} Jul 02 20:24:30.519931 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:30.519883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" event={"ID":"185f564e-f1ca-4ef3-8144-ea28b4a14359","Type":"ContainerStarted","Data":"8c5d33d2f436ab94535c39a021f96b9b9cc5e9dfe958282597550b0c9fd6438f"} Jul 02 20:24:30.520296 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:30.520062 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:30.541637 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:30.541576 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" podStartSLOduration=1.983189708 podStartE2EDuration="6.541560428s" totalImagesPullingTime="3.508658169s" totalInitContainerRuntime="1.049712551s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:30.540200697 +0000 UTC m=+598.769826754" watchObservedRunningTime="2026-07-02 20:24:30.541560428 +0000 UTC m=+598.771186482" Jul 02 20:24:41.526895 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:41.526857 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78b478dcdf-f2sfm" Jul 02 20:24:44.345184 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.345141 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c"] Jul 02 20:24:44.349483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.349450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.352714 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.352690 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 20:24:44.353305 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.353284 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 20:24:44.353431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.353330 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 20:24:44.353431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.353339 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:24:44.353431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.353376 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 20:24:44.353431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.353310 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xnq6n\"" Jul 02 20:24:44.366989 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.366959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c"] Jul 02 20:24:44.496530 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.496489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7pz\" (UniqueName: \"kubernetes.io/projected/6a8e805c-ff17-464e-a5e4-1043f3e79477-kube-api-access-dz7pz\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.496530 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.496533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a8e805c-ff17-464e-a5e4-1043f3e79477-manager-config\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.496792 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.496591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a8e805c-ff17-464e-a5e4-1043f3e79477-cert\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.496792 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.496649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a8e805c-ff17-464e-a5e4-1043f3e79477-metrics-cert\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.597463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.597349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7pz\" (UniqueName: \"kubernetes.io/projected/6a8e805c-ff17-464e-a5e4-1043f3e79477-kube-api-access-dz7pz\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.597463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.597420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a8e805c-ff17-464e-a5e4-1043f3e79477-manager-config\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.597463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.597442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a8e805c-ff17-464e-a5e4-1043f3e79477-cert\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.597463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.597466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a8e805c-ff17-464e-a5e4-1043f3e79477-metrics-cert\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.598122 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.598089 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a8e805c-ff17-464e-a5e4-1043f3e79477-manager-config\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.599992 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.599964 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a8e805c-ff17-464e-a5e4-1043f3e79477-metrics-cert\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.600086 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.599990 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a8e805c-ff17-464e-a5e4-1043f3e79477-cert\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.605379 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.605359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7pz\" (UniqueName: \"kubernetes.io/projected/6a8e805c-ff17-464e-a5e4-1043f3e79477-kube-api-access-dz7pz\") pod \"lws-controller-manager-5b47c96757-8kp2c\" (UID: \"6a8e805c-ff17-464e-a5e4-1043f3e79477\") " pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.658193 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.658161 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:44.797564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.797536 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c"] Jul 02 20:24:44.800385 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:24:44.800346 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8e805c_ff17_464e_a5e4_1043f3e79477.slice/crio-dff65f35668b18100ee18ccfd48355e3ed124780f5e92f0d9ec8019d6f2b4987 WatchSource:0}: Error finding container dff65f35668b18100ee18ccfd48355e3ed124780f5e92f0d9ec8019d6f2b4987: Status 404 returned error can't find the container with id dff65f35668b18100ee18ccfd48355e3ed124780f5e92f0d9ec8019d6f2b4987 Jul 02 20:24:44.802812 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:44.802794 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:24:45.586504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:45.586463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" event={"ID":"6a8e805c-ff17-464e-a5e4-1043f3e79477","Type":"ContainerStarted","Data":"dff65f35668b18100ee18ccfd48355e3ed124780f5e92f0d9ec8019d6f2b4987"} Jul 02 20:24:56.641606 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:56.641561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" event={"ID":"6a8e805c-ff17-464e-a5e4-1043f3e79477","Type":"ContainerStarted","Data":"d39b44dd3fb7f2bd9e9dd554e9f79f0a3f72eba302f4c527fb32fa0af172ae6b"} Jul 02 20:24:56.642001 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:56.641674 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:24:56.669046 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:56.668998 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" podStartSLOduration=1.012749585 podStartE2EDuration="12.668982563s" totalImagesPullingTime="11.656232978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:24:56.666346223 +0000 UTC m=+624.895972276" watchObservedRunningTime="2026-07-02 20:24:56.668982563 +0000 UTC m=+624.898608617" Jul 02 20:24:57.606588 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.606559 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g"] Jul 02 20:24:57.651173 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.651138 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g"] Jul 02 20:24:57.651540 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.651222 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.653338 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.653313 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 20:24:57.653483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.653446 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zxskj\"" Jul 02 20:24:57.810898 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.810862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811088 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.810916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811088 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.810939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811088 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.810965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811088 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.811043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.811127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.811148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.811204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.811300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.811237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbb7w\" (UniqueName: \"kubernetes.io/projected/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-kube-api-access-vbb7w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912296 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912296 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912296 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912341 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbb7w\" (UniqueName: \"kubernetes.io/projected/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-kube-api-access-vbb7w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912899 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.912899 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912760 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.913007 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.912939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.913179 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.913152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.913303 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.913264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.914819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.914795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.915069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.915052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.923021 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.922991 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.923566 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.923544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbb7w\" (UniqueName: \"kubernetes.io/projected/ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36-kube-api-access-vbb7w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cmw7g\" (UID: \"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:57.961523 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:57.961490 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:24:58.141654 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.141617 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g"] Jul 02 20:24:58.146046 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:24:58.146011 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5f23b3_fbb3_43ca_be93_bdb2e15e2c36.slice/crio-f199a1ec9f2e89fe0e7d5d09e479414efadbe72cb2f197b7b69e1f261d8fc604 WatchSource:0}: Error finding container f199a1ec9f2e89fe0e7d5d09e479414efadbe72cb2f197b7b69e1f261d8fc604: Status 404 returned error can't find the container with id f199a1ec9f2e89fe0e7d5d09e479414efadbe72cb2f197b7b69e1f261d8fc604 Jul 02 20:24:58.242341 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.242307 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd"] Jul 02 20:24:58.246075 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.246057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.248485 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.248463 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 20:24:58.248610 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.248547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 20:24:58.248610 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.248578 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wqgx8\"" Jul 02 20:24:58.248818 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.248803 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 20:24:58.269521 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.269488 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd"] Jul 02 20:24:58.316690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08817152-acd4-4c1d-b5e8-4e43c50ae52a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.316690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.316902 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316741 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksqft\" (UniqueName: \"kubernetes.io/projected/08817152-acd4-4c1d-b5e8-4e43c50ae52a-kube-api-access-ksqft\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.316902 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.316902 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.316902 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.316902 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.316866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.417774 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.417739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08817152-acd4-4c1d-b5e8-4e43c50ae52a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.417774 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.417780 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.417986 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.417890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksqft\" (UniqueName: \"kubernetes.io/projected/08817152-acd4-4c1d-b5e8-4e43c50ae52a-kube-api-access-ksqft\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.417986 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.417942 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.417986 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.417976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.418120 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.418027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.418120 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.418055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.418846 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.418819 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.420067 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.420038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08817152-acd4-4c1d-b5e8-4e43c50ae52a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.420239 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.420223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.420370 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.420332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.420431 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.420365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08817152-acd4-4c1d-b5e8-4e43c50ae52a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.426699 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.426676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksqft\" (UniqueName: \"kubernetes.io/projected/08817152-acd4-4c1d-b5e8-4e43c50ae52a-kube-api-access-ksqft\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.427151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.427133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08817152-acd4-4c1d-b5e8-4e43c50ae52a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2xlcd\" (UID: \"08817152-acd4-4c1d-b5e8-4e43c50ae52a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.555635 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.555545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:24:58.653145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.653111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" event={"ID":"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36","Type":"ContainerStarted","Data":"f199a1ec9f2e89fe0e7d5d09e479414efadbe72cb2f197b7b69e1f261d8fc604"} Jul 02 20:24:58.742113 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:24:58.742079 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08817152_acd4_4c1d_b5e8_4e43c50ae52a.slice/crio-4ba08d7d1776063349ef748005015bf4b57a1f7a95eb72aa7c3a470dddebcc24 WatchSource:0}: Error finding container 4ba08d7d1776063349ef748005015bf4b57a1f7a95eb72aa7c3a470dddebcc24: Status 404 returned error can't find the container with id 4ba08d7d1776063349ef748005015bf4b57a1f7a95eb72aa7c3a470dddebcc24 Jul 02 20:24:58.761276 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:58.761245 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd"] Jul 02 20:24:59.662672 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:24:59.662632 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" event={"ID":"08817152-acd4-4c1d-b5e8-4e43c50ae52a","Type":"ContainerStarted","Data":"4ba08d7d1776063349ef748005015bf4b57a1f7a95eb72aa7c3a470dddebcc24"} Jul 02 20:25:00.940231 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:00.940181 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:00.940632 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:00.940268 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:01.674679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:01.674649 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" event={"ID":"08817152-acd4-4c1d-b5e8-4e43c50ae52a","Type":"ContainerStarted","Data":"ce52578b7298b452cc0c4901ca65b42551c68b0ca65456c7e330dd6a25612164"} Jul 02 20:25:01.674963 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:01.674846 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:25:01.676512 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:01.676485 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-2xlcd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 20:25:01.676627 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:01.676540 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" podUID="08817152-acd4-4c1d-b5e8-4e43c50ae52a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 20:25:01.717055 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:01.716997 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" podStartSLOduration=1.5211639350000001 podStartE2EDuration="3.716980081s" totalImagesPullingTime="2.195816146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:01.713539252 +0000 UTC m=+629.943165306" watchObservedRunningTime="2026-07-02 20:25:01.716980081 +0000 UTC m=+629.946606134" Jul 02 20:25:02.679676 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:02.679644 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2xlcd" Jul 02 20:25:07.648946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:07.648915 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b47c96757-8kp2c" Jul 02 20:25:13.926846 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:13.926808 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:13.927083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:13.926885 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:13.927083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:13.926914 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:25:14.743108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:14.743066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" event={"ID":"ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36","Type":"ContainerStarted","Data":"cd2096fe8a86695b7469367d26278ab62a455556cf3566293858206bbc6f712f"} Jul 02 20:25:14.766855 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:14.766797 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" podStartSLOduration=1.9885278400000002 podStartE2EDuration="17.766781662s" totalImagesPullingTime="15.778253822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:14.764286992 +0000 UTC m=+642.993913047" watchObservedRunningTime="2026-07-02 20:25:14.766781662 +0000 UTC m=+642.996407715" Jul 02 20:25:14.962272 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:14.962233 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:25:14.966715 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:14.966689 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:25:15.747795 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:15.747759 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:25:15.748697 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:25:15.748676 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cmw7g" Jul 02 20:26:00.697829 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.697787 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf"] Jul 02 20:26:00.701014 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.700991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.703696 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.703671 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:26:00.703823 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.703696 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hzkvd\"" Jul 02 20:26:00.703823 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.703673 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:26:00.711173 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.711147 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf"] Jul 02 20:26:00.754883 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.754845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.754883 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.754890 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.755100 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.754909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckkw\" (UniqueName: \"kubernetes.io/projected/b46f8347-a7d1-480d-b31f-a4921c39b784-kube-api-access-8ckkw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.855504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.855461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.855715 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.855514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.855715 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.855544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckkw\" (UniqueName: \"kubernetes.io/projected/b46f8347-a7d1-480d-b31f-a4921c39b784-kube-api-access-8ckkw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.856037 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.856012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.856113 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.856011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:00.866054 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:00.866024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckkw\" (UniqueName: \"kubernetes.io/projected/b46f8347-a7d1-480d-b31f-a4921c39b784-kube-api-access-8ckkw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:01.011135 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.011095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:01.092222 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.092185 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w"] Jul 02 20:26:01.096282 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.095924 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.107458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.107393 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w"] Jul 02 20:26:01.157131 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.157100 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf"] Jul 02 20:26:01.158632 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.158600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.158743 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.158642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7brk\" (UniqueName: \"kubernetes.io/projected/50e31422-a7be-4a30-8a78-d239b7a564aa-kube-api-access-c7brk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.158743 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.158688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.159782 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:26:01.159751 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46f8347_a7d1_480d_b31f_a4921c39b784.slice/crio-d193d2bf9295b392177b212882d4c570d969386f2f5eed6278932ad0195c2bd2 WatchSource:0}: Error finding container d193d2bf9295b392177b212882d4c570d969386f2f5eed6278932ad0195c2bd2: Status 404 returned error can't find the container with id d193d2bf9295b392177b212882d4c570d969386f2f5eed6278932ad0195c2bd2 Jul 02 20:26:01.259971 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.259928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.260167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.259980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7brk\" (UniqueName: \"kubernetes.io/projected/50e31422-a7be-4a30-8a78-d239b7a564aa-kube-api-access-c7brk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.260167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.260028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.260547 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.260521 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.260614 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.260531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.275869 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.275838 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7brk\" (UniqueName: \"kubernetes.io/projected/50e31422-a7be-4a30-8a78-d239b7a564aa-kube-api-access-c7brk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.409544 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.409503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:01.501337 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.501303 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2"] Jul 02 20:26:01.505714 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.505689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.514298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.514269 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2"] Jul 02 20:26:01.551442 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.551335 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w"] Jul 02 20:26:01.553810 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:26:01.553769 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e31422_a7be_4a30_8a78_d239b7a564aa.slice/crio-f42f9fd520f2edea58bb8aa074f3a1cebb2530831fdb55e6c0a78977535c1ddf WatchSource:0}: Error finding container f42f9fd520f2edea58bb8aa074f3a1cebb2530831fdb55e6c0a78977535c1ddf: Status 404 returned error can't find the container with id f42f9fd520f2edea58bb8aa074f3a1cebb2530831fdb55e6c0a78977535c1ddf Jul 02 20:26:01.561987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.561963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm667\" (UniqueName: \"kubernetes.io/projected/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-kube-api-access-cm667\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.562051 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.562013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.562051 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.562030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.663133 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.663104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.663279 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.663143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.663279 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.663243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm667\" (UniqueName: \"kubernetes.io/projected/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-kube-api-access-cm667\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.663478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.663457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.663551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.663510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.672782 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.672759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm667\" (UniqueName: \"kubernetes.io/projected/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-kube-api-access-cm667\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.817846 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.817743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:01.893516 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.893486 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl"] Jul 02 20:26:01.897259 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.897237 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:01.907151 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.907122 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl"] Jul 02 20:26:01.965619 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.965497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:01.965698 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.965623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlbh8\" (UniqueName: \"kubernetes.io/projected/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-kube-api-access-hlbh8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:01.965798 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.965724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:01.970337 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.969172 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2"] Jul 02 20:26:01.976194 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.976158 2573 generic.go:356] "Generic (PLEG): container finished" podID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerID="c9f44a390def52646780ddc556f07e18dab6164333721db0bea268df59ea4f18" exitCode=0 Jul 02 20:26:01.976315 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.976250 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" event={"ID":"b46f8347-a7d1-480d-b31f-a4921c39b784","Type":"ContainerDied","Data":"c9f44a390def52646780ddc556f07e18dab6164333721db0bea268df59ea4f18"} Jul 02 20:26:01.976715 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.976316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" event={"ID":"b46f8347-a7d1-480d-b31f-a4921c39b784","Type":"ContainerStarted","Data":"d193d2bf9295b392177b212882d4c570d969386f2f5eed6278932ad0195c2bd2"} Jul 02 20:26:01.978254 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.978235 2573 generic.go:356] "Generic (PLEG): container finished" podID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerID="50c51cc6ad858568f378df831b29ff0ab7911f8d40566bbc79c2072298676f00" exitCode=0 Jul 02 20:26:01.978335 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.978268 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" event={"ID":"50e31422-a7be-4a30-8a78-d239b7a564aa","Type":"ContainerDied","Data":"50c51cc6ad858568f378df831b29ff0ab7911f8d40566bbc79c2072298676f00"} Jul 02 20:26:01.978335 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:01.978298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" event={"ID":"50e31422-a7be-4a30-8a78-d239b7a564aa","Type":"ContainerStarted","Data":"f42f9fd520f2edea58bb8aa074f3a1cebb2530831fdb55e6c0a78977535c1ddf"} Jul 02 20:26:02.067055 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.067016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlbh8\" (UniqueName: \"kubernetes.io/projected/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-kube-api-access-hlbh8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.067253 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.067099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.067253 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.067143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.067579 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.067558 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.067645 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.067574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.079068 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.079003 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlbh8\" (UniqueName: \"kubernetes.io/projected/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-kube-api-access-hlbh8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.210068 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.210023 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:02.349216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.349192 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl"] Jul 02 20:26:02.351615 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:26:02.351582 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76db5cb2_b239_4c7d_81fa_fd38152ef0c0.slice/crio-215f1de7c3de319209dee650b878fdeb47e1fed7d3c968f4fd20c1e41a34e2bc WatchSource:0}: Error finding container 215f1de7c3de319209dee650b878fdeb47e1fed7d3c968f4fd20c1e41a34e2bc: Status 404 returned error can't find the container with id 215f1de7c3de319209dee650b878fdeb47e1fed7d3c968f4fd20c1e41a34e2bc Jul 02 20:26:02.985867 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.985835 2573 generic.go:356] "Generic (PLEG): container finished" podID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerID="76661e203cc88f4c8b4f89109f36d8303cfb8bed379bf2e981ddef9c710c1aa9" exitCode=0 Jul 02 20:26:02.986284 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.985912 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" event={"ID":"76db5cb2-b239-4c7d-81fa-fd38152ef0c0","Type":"ContainerDied","Data":"76661e203cc88f4c8b4f89109f36d8303cfb8bed379bf2e981ddef9c710c1aa9"} Jul 02 20:26:02.986284 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.985980 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" event={"ID":"76db5cb2-b239-4c7d-81fa-fd38152ef0c0","Type":"ContainerStarted","Data":"215f1de7c3de319209dee650b878fdeb47e1fed7d3c968f4fd20c1e41a34e2bc"} Jul 02 20:26:02.987917 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.987812 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerID="9be5100b0f49646304efb15ad6b8b0de988a0e7b9be8abc9670ad7635d5a42e5" exitCode=0 Jul 02 20:26:02.988025 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.987916 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" event={"ID":"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f","Type":"ContainerDied","Data":"9be5100b0f49646304efb15ad6b8b0de988a0e7b9be8abc9670ad7635d5a42e5"} Jul 02 20:26:02.988025 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:02.987974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" event={"ID":"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f","Type":"ContainerStarted","Data":"295afd9a1d5ac26d9a2542c0f916dae9f92a5b883ed1c1ba862aa15ee0b74a41"} Jul 02 20:26:03.996429 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:03.996375 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" event={"ID":"76db5cb2-b239-4c7d-81fa-fd38152ef0c0","Type":"ContainerStarted","Data":"213515a15a65c3fb396f550f98c16669d662f25a70400e70f2054535c6a41e39"} Jul 02 20:26:03.998322 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:03.998297 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerID="55b44aadd34488506009fc044046accf11c171515cd0594a311965954c067fde" exitCode=0 Jul 02 20:26:03.998460 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:03.998380 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" event={"ID":"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f","Type":"ContainerDied","Data":"55b44aadd34488506009fc044046accf11c171515cd0594a311965954c067fde"} Jul 02 20:26:04.000483 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:04.000456 2573 generic.go:356] "Generic (PLEG): container finished" podID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerID="0975f16e433e403bf7d3be223fcda42b6797887e44715d983f3dc4fa98720453" exitCode=0 Jul 02 20:26:04.000640 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:04.000599 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" event={"ID":"50e31422-a7be-4a30-8a78-d239b7a564aa","Type":"ContainerDied","Data":"0975f16e433e403bf7d3be223fcda42b6797887e44715d983f3dc4fa98720453"} Jul 02 20:26:04.002558 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:04.002534 2573 generic.go:356] "Generic (PLEG): container finished" podID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerID="d95d825e689690fdd65f3d1bcefcb9f274443073bd14f69ce7ed983e9abc2d68" exitCode=0 Jul 02 20:26:04.002645 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:04.002588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" event={"ID":"b46f8347-a7d1-480d-b31f-a4921c39b784","Type":"ContainerDied","Data":"d95d825e689690fdd65f3d1bcefcb9f274443073bd14f69ce7ed983e9abc2d68"} Jul 02 20:26:05.009497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.009458 2573 generic.go:356] "Generic (PLEG): container finished" podID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerID="fa5e6b2c3c8ef2135a86123447c45fdc68ecbb5de56d9005be1460fc66a08bbd" exitCode=0 Jul 02 20:26:05.009891 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.009545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" event={"ID":"50e31422-a7be-4a30-8a78-d239b7a564aa","Type":"ContainerDied","Data":"fa5e6b2c3c8ef2135a86123447c45fdc68ecbb5de56d9005be1460fc66a08bbd"} Jul 02 20:26:05.011517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.011499 2573 generic.go:356] "Generic (PLEG): container finished" podID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerID="13c4dd04ee1d3f930f8913db21010133a203de3a2371f58d1ca52ef0ed5e2d0f" exitCode=0 Jul 02 20:26:05.011613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.011588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" event={"ID":"b46f8347-a7d1-480d-b31f-a4921c39b784","Type":"ContainerDied","Data":"13c4dd04ee1d3f930f8913db21010133a203de3a2371f58d1ca52ef0ed5e2d0f"} Jul 02 20:26:05.013250 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.013223 2573 generic.go:356] "Generic (PLEG): container finished" podID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerID="213515a15a65c3fb396f550f98c16669d662f25a70400e70f2054535c6a41e39" exitCode=0 Jul 02 20:26:05.013394 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.013305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" event={"ID":"76db5cb2-b239-4c7d-81fa-fd38152ef0c0","Type":"ContainerDied","Data":"213515a15a65c3fb396f550f98c16669d662f25a70400e70f2054535c6a41e39"} Jul 02 20:26:05.015411 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.015379 2573 generic.go:356] "Generic (PLEG): container finished" podID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerID="0c0c723ea2b128cd1ea9d0777a905320eb1670236a367f879457d265cd910caf" exitCode=0 Jul 02 20:26:05.015520 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:05.015437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" event={"ID":"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f","Type":"ContainerDied","Data":"0c0c723ea2b128cd1ea9d0777a905320eb1670236a367f879457d265cd910caf"} Jul 02 20:26:06.022919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.022885 2573 generic.go:356] "Generic (PLEG): container finished" podID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerID="9efe4a6e02d8451f5133ec0b817ecf15112f48d0eb57d67a49d7a754e823ec66" exitCode=0 Jul 02 20:26:06.023362 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.022963 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" event={"ID":"76db5cb2-b239-4c7d-81fa-fd38152ef0c0","Type":"ContainerDied","Data":"9efe4a6e02d8451f5133ec0b817ecf15112f48d0eb57d67a49d7a754e823ec66"} Jul 02 20:26:06.176440 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.176385 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:06.205370 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.205344 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-util\") pod \"b46f8347-a7d1-480d-b31f-a4921c39b784\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " Jul 02 20:26:06.205534 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.205460 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-bundle\") pod \"b46f8347-a7d1-480d-b31f-a4921c39b784\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " Jul 02 20:26:06.205534 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.205523 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckkw\" (UniqueName: \"kubernetes.io/projected/b46f8347-a7d1-480d-b31f-a4921c39b784-kube-api-access-8ckkw\") pod \"b46f8347-a7d1-480d-b31f-a4921c39b784\" (UID: \"b46f8347-a7d1-480d-b31f-a4921c39b784\") " Jul 02 20:26:06.206049 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.206014 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-bundle" (OuterVolumeSpecName: "bundle") pod "b46f8347-a7d1-480d-b31f-a4921c39b784" (UID: "b46f8347-a7d1-480d-b31f-a4921c39b784"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:06.207710 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.207685 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46f8347-a7d1-480d-b31f-a4921c39b784-kube-api-access-8ckkw" (OuterVolumeSpecName: "kube-api-access-8ckkw") pod "b46f8347-a7d1-480d-b31f-a4921c39b784" (UID: "b46f8347-a7d1-480d-b31f-a4921c39b784"). InnerVolumeSpecName "kube-api-access-8ckkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:06.211030 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.211004 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-util" (OuterVolumeSpecName: "util") pod "b46f8347-a7d1-480d-b31f-a4921c39b784" (UID: "b46f8347-a7d1-480d-b31f-a4921c39b784"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:06.227352 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.227315 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:06.230316 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.230294 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:06.306596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.306508 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-util\") pod \"50e31422-a7be-4a30-8a78-d239b7a564aa\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " Jul 02 20:26:06.306749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.306599 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7brk\" (UniqueName: \"kubernetes.io/projected/50e31422-a7be-4a30-8a78-d239b7a564aa-kube-api-access-c7brk\") pod \"50e31422-a7be-4a30-8a78-d239b7a564aa\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " Jul 02 20:26:06.306749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.306625 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-bundle\") pod \"50e31422-a7be-4a30-8a78-d239b7a564aa\" (UID: \"50e31422-a7be-4a30-8a78-d239b7a564aa\") " Jul 02 20:26:06.306749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.306683 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm667\" (UniqueName: \"kubernetes.io/projected/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-kube-api-access-cm667\") pod \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " Jul 02 20:26:06.306749 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.306741 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-bundle\") pod \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " Jul 02 20:26:06.306933 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.306765 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-util\") pod \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\" (UID: \"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f\") " Jul 02 20:26:06.307049 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.307030 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckkw\" (UniqueName: \"kubernetes.io/projected/b46f8347-a7d1-480d-b31f-a4921c39b784-kube-api-access-8ckkw\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.307108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.307055 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.307108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.307069 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b46f8347-a7d1-480d-b31f-a4921c39b784-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.307201 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.307168 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-bundle" (OuterVolumeSpecName: "bundle") pod "50e31422-a7be-4a30-8a78-d239b7a564aa" (UID: "50e31422-a7be-4a30-8a78-d239b7a564aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:06.307574 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.307540 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-bundle" (OuterVolumeSpecName: "bundle") pod "2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" (UID: "2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:06.308976 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.308943 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-kube-api-access-cm667" (OuterVolumeSpecName: "kube-api-access-cm667") pod "2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" (UID: "2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f"). InnerVolumeSpecName "kube-api-access-cm667". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:06.309074 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.308976 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e31422-a7be-4a30-8a78-d239b7a564aa-kube-api-access-c7brk" (OuterVolumeSpecName: "kube-api-access-c7brk") pod "50e31422-a7be-4a30-8a78-d239b7a564aa" (UID: "50e31422-a7be-4a30-8a78-d239b7a564aa"). InnerVolumeSpecName "kube-api-access-c7brk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:06.312110 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.312078 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-util" (OuterVolumeSpecName: "util") pod "50e31422-a7be-4a30-8a78-d239b7a564aa" (UID: "50e31422-a7be-4a30-8a78-d239b7a564aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:06.312568 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.312547 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-util" (OuterVolumeSpecName: "util") pod "2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" (UID: "2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:06.408649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.408608 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7brk\" (UniqueName: \"kubernetes.io/projected/50e31422-a7be-4a30-8a78-d239b7a564aa-kube-api-access-c7brk\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.408649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.408650 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.408852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.408667 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm667\" (UniqueName: \"kubernetes.io/projected/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-kube-api-access-cm667\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.408852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.408680 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.408852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.408701 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:06.408852 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:06.408713 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e31422-a7be-4a30-8a78-d239b7a564aa-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:07.033221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.033188 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" Jul 02 20:26:07.033696 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.033197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf" event={"ID":"b46f8347-a7d1-480d-b31f-a4921c39b784","Type":"ContainerDied","Data":"d193d2bf9295b392177b212882d4c570d969386f2f5eed6278932ad0195c2bd2"} Jul 02 20:26:07.033696 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.033323 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d193d2bf9295b392177b212882d4c570d969386f2f5eed6278932ad0195c2bd2" Jul 02 20:26:07.035612 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.035579 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" Jul 02 20:26:07.035612 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.035594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2" event={"ID":"2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f","Type":"ContainerDied","Data":"295afd9a1d5ac26d9a2542c0f916dae9f92a5b883ed1c1ba862aa15ee0b74a41"} Jul 02 20:26:07.035808 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.035641 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="295afd9a1d5ac26d9a2542c0f916dae9f92a5b883ed1c1ba862aa15ee0b74a41" Jul 02 20:26:07.037690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.037662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" event={"ID":"50e31422-a7be-4a30-8a78-d239b7a564aa","Type":"ContainerDied","Data":"f42f9fd520f2edea58bb8aa074f3a1cebb2530831fdb55e6c0a78977535c1ddf"} Jul 02 20:26:07.037878 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.037855 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f42f9fd520f2edea58bb8aa074f3a1cebb2530831fdb55e6c0a78977535c1ddf" Jul 02 20:26:07.037878 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.037682 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w" Jul 02 20:26:07.168543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.168514 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:07.217058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.217025 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-util\") pod \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " Jul 02 20:26:07.217058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.217064 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlbh8\" (UniqueName: \"kubernetes.io/projected/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-kube-api-access-hlbh8\") pod \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " Jul 02 20:26:07.217284 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.217155 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-bundle\") pod \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\" (UID: \"76db5cb2-b239-4c7d-81fa-fd38152ef0c0\") " Jul 02 20:26:07.217754 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.217727 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-bundle" (OuterVolumeSpecName: "bundle") pod "76db5cb2-b239-4c7d-81fa-fd38152ef0c0" (UID: "76db5cb2-b239-4c7d-81fa-fd38152ef0c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:07.219307 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.219285 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-kube-api-access-hlbh8" (OuterVolumeSpecName: "kube-api-access-hlbh8") pod "76db5cb2-b239-4c7d-81fa-fd38152ef0c0" (UID: "76db5cb2-b239-4c7d-81fa-fd38152ef0c0"). InnerVolumeSpecName "kube-api-access-hlbh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:07.222438 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.222387 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-util" (OuterVolumeSpecName: "util") pod "76db5cb2-b239-4c7d-81fa-fd38152ef0c0" (UID: "76db5cb2-b239-4c7d-81fa-fd38152ef0c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:07.318740 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.318636 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:07.318740 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.318671 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:07.318740 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:07.318684 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlbh8\" (UniqueName: \"kubernetes.io/projected/76db5cb2-b239-4c7d-81fa-fd38152ef0c0-kube-api-access-hlbh8\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:26:08.045091 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:08.045062 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" Jul 02 20:26:08.045521 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:08.045088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl" event={"ID":"76db5cb2-b239-4c7d-81fa-fd38152ef0c0","Type":"ContainerDied","Data":"215f1de7c3de319209dee650b878fdeb47e1fed7d3c968f4fd20c1e41a34e2bc"} Jul 02 20:26:08.045521 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:26:08.045142 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="215f1de7c3de319209dee650b878fdeb47e1fed7d3c968f4fd20c1e41a34e2bc" Jul 02 20:27:53.967957 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.967919 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-758b44f4f5-kwtp8"] Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968234 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968246 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968258 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968264 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968272 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968279 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968285 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968290 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968295 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968300 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968306 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968311 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968319 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968337 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968343 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968348 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="extract" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968356 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968361 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968367 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968372 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968379 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968383 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="util" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968389 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="pull" Jul 02 20:27:53.968435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968394 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="pull" Jul 02 20:27:53.969165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968461 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f" containerName="extract" Jul 02 20:27:53.969165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968470 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e31422-a7be-4a30-8a78-d239b7a564aa" containerName="extract" Jul 02 20:27:53.969165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968479 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46f8347-a7d1-480d-b31f-a4921c39b784" containerName="extract" Jul 02 20:27:53.969165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.968484 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="76db5cb2-b239-4c7d-81fa-fd38152ef0c0" containerName="extract" Jul 02 20:27:53.971233 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.971217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:53.981556 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.981531 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 20:27:53.981670 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.981569 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dv45p\"" Jul 02 20:27:53.982261 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.982248 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 20:27:53.999597 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:53.999565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-758b44f4f5-kwtp8"] Jul 02 20:27:54.021841 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.021804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec401059-ca35-42e5-811a-23acb014629a-webhook-cert\") pod \"maas-controller-758b44f4f5-kwtp8\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.022011 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.021929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4wnw\" (UniqueName: \"kubernetes.io/projected/ec401059-ca35-42e5-811a-23acb014629a-kube-api-access-l4wnw\") pod \"maas-controller-758b44f4f5-kwtp8\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.123249 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.123219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4wnw\" (UniqueName: \"kubernetes.io/projected/ec401059-ca35-42e5-811a-23acb014629a-kube-api-access-l4wnw\") pod \"maas-controller-758b44f4f5-kwtp8\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.123447 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.123281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec401059-ca35-42e5-811a-23acb014629a-webhook-cert\") pod \"maas-controller-758b44f4f5-kwtp8\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.125863 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.125835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec401059-ca35-42e5-811a-23acb014629a-webhook-cert\") pod \"maas-controller-758b44f4f5-kwtp8\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.134561 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.134529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4wnw\" (UniqueName: \"kubernetes.io/projected/ec401059-ca35-42e5-811a-23acb014629a-kube-api-access-l4wnw\") pod \"maas-controller-758b44f4f5-kwtp8\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.280631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.280541 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:54.432583 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.432555 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-758b44f4f5-kwtp8"] Jul 02 20:27:54.435245 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:27:54.435215 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec401059_ca35_42e5_811a_23acb014629a.slice/crio-0b2b89cd74c498f25cd66530d0d92a919c2160ad5ad40f231a4599ddcdd5fbde WatchSource:0}: Error finding container 0b2b89cd74c498f25cd66530d0d92a919c2160ad5ad40f231a4599ddcdd5fbde: Status 404 returned error can't find the container with id 0b2b89cd74c498f25cd66530d0d92a919c2160ad5ad40f231a4599ddcdd5fbde Jul 02 20:27:54.569807 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:54.569713 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" event={"ID":"ec401059-ca35-42e5-811a-23acb014629a","Type":"ContainerStarted","Data":"0b2b89cd74c498f25cd66530d0d92a919c2160ad5ad40f231a4599ddcdd5fbde"} Jul 02 20:27:56.583364 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:56.583267 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" event={"ID":"ec401059-ca35-42e5-811a-23acb014629a","Type":"ContainerStarted","Data":"25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569"} Jul 02 20:27:56.583731 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:56.583396 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:27:56.627446 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:27:56.627323 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" podStartSLOduration=1.747918101 podStartE2EDuration="3.627304751s" totalImagesPullingTime="1.87938665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:27:56.627286862 +0000 UTC m=+804.856912915" watchObservedRunningTime="2026-07-02 20:27:56.627304751 +0000 UTC m=+804.856930802" Jul 02 20:28:07.594420 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:07.594377 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:28:08.798379 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:08.798339 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-758b44f4f5-kwtp8"] Jul 02 20:28:08.798933 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:08.798610 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" podUID="ec401059-ca35-42e5-811a-23acb014629a" containerName="manager" containerID="cri-o://25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569" gracePeriod=30 Jul 02 20:28:09.048198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.048175 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:28:09.161940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.161831 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4wnw\" (UniqueName: \"kubernetes.io/projected/ec401059-ca35-42e5-811a-23acb014629a-kube-api-access-l4wnw\") pod \"ec401059-ca35-42e5-811a-23acb014629a\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " Jul 02 20:28:09.161940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.161884 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec401059-ca35-42e5-811a-23acb014629a-webhook-cert\") pod \"ec401059-ca35-42e5-811a-23acb014629a\" (UID: \"ec401059-ca35-42e5-811a-23acb014629a\") " Jul 02 20:28:09.164110 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.164070 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec401059-ca35-42e5-811a-23acb014629a-kube-api-access-l4wnw" (OuterVolumeSpecName: "kube-api-access-l4wnw") pod "ec401059-ca35-42e5-811a-23acb014629a" (UID: "ec401059-ca35-42e5-811a-23acb014629a"). InnerVolumeSpecName "kube-api-access-l4wnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:28:09.164220 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.164121 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec401059-ca35-42e5-811a-23acb014629a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ec401059-ca35-42e5-811a-23acb014629a" (UID: "ec401059-ca35-42e5-811a-23acb014629a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:28:09.263078 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.263037 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4wnw\" (UniqueName: \"kubernetes.io/projected/ec401059-ca35-42e5-811a-23acb014629a-kube-api-access-l4wnw\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:28:09.263078 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.263069 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec401059-ca35-42e5-811a-23acb014629a-webhook-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:28:09.647257 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.647220 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec401059-ca35-42e5-811a-23acb014629a" containerID="25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569" exitCode=0 Jul 02 20:28:09.647257 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.647261 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" Jul 02 20:28:09.647517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.647308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" event={"ID":"ec401059-ca35-42e5-811a-23acb014629a","Type":"ContainerDied","Data":"25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569"} Jul 02 20:28:09.647517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.647354 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758b44f4f5-kwtp8" event={"ID":"ec401059-ca35-42e5-811a-23acb014629a","Type":"ContainerDied","Data":"0b2b89cd74c498f25cd66530d0d92a919c2160ad5ad40f231a4599ddcdd5fbde"} Jul 02 20:28:09.647517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.647377 2573 scope.go:117] "RemoveContainer" containerID="25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569" Jul 02 20:28:09.661053 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.661033 2573 scope.go:117] "RemoveContainer" containerID="25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569" Jul 02 20:28:09.661347 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:28:09.661327 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569\": container with ID starting with 25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569 not found: ID does not exist" containerID="25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569" Jul 02 20:28:09.661422 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.661356 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569"} err="failed to get container status \"25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569\": rpc error: code = NotFound desc = could not find container \"25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569\": container with ID starting with 25ae8d3fc2247f146d40b40c58a3020e3ec6015c1c6563da74c8c7feccc66569 not found: ID does not exist" Jul 02 20:28:09.671771 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.671744 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-758b44f4f5-kwtp8"] Jul 02 20:28:09.677174 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:09.677148 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-758b44f4f5-kwtp8"] Jul 02 20:28:10.366420 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:10.366366 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec401059-ca35-42e5-811a-23acb014629a" path="/var/lib/kubelet/pods/ec401059-ca35-42e5-811a-23acb014629a/volumes" Jul 02 20:28:32.367738 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.367708 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zs2qv"] Jul 02 20:28:32.368092 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.368014 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec401059-ca35-42e5-811a-23acb014629a" containerName="manager" Jul 02 20:28:32.368092 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.368026 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec401059-ca35-42e5-811a-23acb014629a" containerName="manager" Jul 02 20:28:32.368160 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.368104 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec401059-ca35-42e5-811a-23acb014629a" containerName="manager" Jul 02 20:28:32.373640 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.373617 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.376087 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.376061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 20:28:32.376209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.376122 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rpsch\"" Jul 02 20:28:32.379845 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.379821 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zs2qv"] Jul 02 20:28:32.563181 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.563078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss7g9\" (UniqueName: \"kubernetes.io/projected/30443f35-97e6-4240-868c-ddd68357205a-kube-api-access-ss7g9\") pod \"payload-pre-processing-7964457696-zs2qv\" (UID: \"30443f35-97e6-4240-868c-ddd68357205a\") " pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.563181 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.563128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30443f35-97e6-4240-868c-ddd68357205a-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zs2qv\" (UID: \"30443f35-97e6-4240-868c-ddd68357205a\") " pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.664135 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.664104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss7g9\" (UniqueName: \"kubernetes.io/projected/30443f35-97e6-4240-868c-ddd68357205a-kube-api-access-ss7g9\") pod \"payload-pre-processing-7964457696-zs2qv\" (UID: \"30443f35-97e6-4240-868c-ddd68357205a\") " pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.664296 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.664144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30443f35-97e6-4240-868c-ddd68357205a-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zs2qv\" (UID: \"30443f35-97e6-4240-868c-ddd68357205a\") " pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.664860 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.664842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30443f35-97e6-4240-868c-ddd68357205a-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zs2qv\" (UID: \"30443f35-97e6-4240-868c-ddd68357205a\") " pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.671927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.671899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss7g9\" (UniqueName: \"kubernetes.io/projected/30443f35-97e6-4240-868c-ddd68357205a-kube-api-access-ss7g9\") pod \"payload-pre-processing-7964457696-zs2qv\" (UID: \"30443f35-97e6-4240-868c-ddd68357205a\") " pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.685359 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.685339 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:32.815548 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:32.815524 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zs2qv"] Jul 02 20:28:32.817761 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:28:32.817734 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30443f35_97e6_4240_868c_ddd68357205a.slice/crio-4feb9b63bc0afcfcf1f4e312faf0f2283e8cdb68d0e4c4c3a95eb41822b0db20 WatchSource:0}: Error finding container 4feb9b63bc0afcfcf1f4e312faf0f2283e8cdb68d0e4c4c3a95eb41822b0db20: Status 404 returned error can't find the container with id 4feb9b63bc0afcfcf1f4e312faf0f2283e8cdb68d0e4c4c3a95eb41822b0db20 Jul 02 20:28:33.775599 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:33.775555 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" event={"ID":"30443f35-97e6-4240-868c-ddd68357205a","Type":"ContainerStarted","Data":"4feb9b63bc0afcfcf1f4e312faf0f2283e8cdb68d0e4c4c3a95eb41822b0db20"} Jul 02 20:28:34.788255 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:34.788216 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" event={"ID":"30443f35-97e6-4240-868c-ddd68357205a","Type":"ContainerStarted","Data":"3bfb31aa6f6789c27d4c3cddc691a48926683de5517b9faaaea5939ba96f9506"} Jul 02 20:28:34.788714 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:34.788338 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:34.806238 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:34.806187 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" podStartSLOduration=1.358056922 podStartE2EDuration="2.806170986s" totalImagesPullingTime="1.448114064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:28:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:28:34.804633035 +0000 UTC m=+843.034259090" watchObservedRunningTime="2026-07-02 20:28:34.806170986 +0000 UTC m=+843.035797040" Jul 02 20:28:45.795987 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:45.795957 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-zs2qv" Jul 02 20:28:57.511629 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.511538 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt"] Jul 02 20:28:57.515491 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.515470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.518134 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.518113 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 20:28:57.518888 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.518866 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 20:28:57.518975 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.518919 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xgxfv\"" Jul 02 20:28:57.518975 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.518939 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 20:28:57.525308 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.525284 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt"] Jul 02 20:28:57.578315 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.578281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.578315 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.578317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.578523 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.578344 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjzd\" (UniqueName: \"kubernetes.io/projected/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-kube-api-access-tzjzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.578523 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.578427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.578523 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.578494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.578618 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.578524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.679640 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.679602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.679834 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.679647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.679834 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.679680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjzd\" (UniqueName: \"kubernetes.io/projected/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-kube-api-access-tzjzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.679834 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.679709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.679834 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.679776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.679834 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.679813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.680099 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.680078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.680153 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.680109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.680209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.680154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.682005 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.681984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.682300 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.682280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.687185 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.687163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjzd\" (UniqueName: \"kubernetes.io/projected/ff4fcb5b-0e6b-42a2-a6e8-4cd547313230-kube-api-access-tzjzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt\" (UID: \"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.828261 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.828173 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:28:57.968930 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:57.968906 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt"] Jul 02 20:28:57.970876 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:28:57.970851 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4fcb5b_0e6b_42a2_a6e8_4cd547313230.slice/crio-0f0423aca923924be10462736c1d71e6a6c181655351b93a7a27630ac4af102d WatchSource:0}: Error finding container 0f0423aca923924be10462736c1d71e6a6c181655351b93a7a27630ac4af102d: Status 404 returned error can't find the container with id 0f0423aca923924be10462736c1d71e6a6c181655351b93a7a27630ac4af102d Jul 02 20:28:58.911035 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:58.910993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" event={"ID":"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230","Type":"ContainerStarted","Data":"0f0423aca923924be10462736c1d71e6a6c181655351b93a7a27630ac4af102d"} Jul 02 20:28:59.917710 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:59.917670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" event={"ID":"ff4fcb5b-0e6b-42a2-a6e8-4cd547313230","Type":"ContainerStarted","Data":"22548d36bdf19f3c3aafc5184f7cd0b3e820b55375faef781ab070b4f575381a"} Jul 02 20:28:59.935610 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:28:59.935554 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" podStartSLOduration=1.800861524 podStartE2EDuration="2.935539307s" totalImagesPullingTime="1.134677783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:28:59.933699968 +0000 UTC m=+868.163326023" watchObservedRunningTime="2026-07-02 20:28:59.935539307 +0000 UTC m=+868.165165418" Jul 02 20:29:07.829178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:07.829138 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:29:07.829592 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:07.829214 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:29:07.841630 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:07.841604 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:29:07.968104 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:07.968076 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt" Jul 02 20:29:19.205380 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.205345 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb"] Jul 02 20:29:19.209108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.209085 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.211549 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.211526 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 20:29:19.219561 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.219541 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb"] Jul 02 20:29:19.373005 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.372971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.373199 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.373016 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.373199 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.373054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.373199 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.373093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.373199 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.373111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f19dac-33e8-4768-a29c-c5764941b7d0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.373199 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.373182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdlz\" (UniqueName: \"kubernetes.io/projected/30f19dac-33e8-4768-a29c-c5764941b7d0-kube-api-access-xgdlz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474296 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f19dac-33e8-4768-a29c-c5764941b7d0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474519 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdlz\" (UniqueName: \"kubernetes.io/projected/30f19dac-33e8-4768-a29c-c5764941b7d0-kube-api-access-xgdlz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474519 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474519 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474519 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474734 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.474911 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.475016 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.475016 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.474989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.476698 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.476668 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30f19dac-33e8-4768-a29c-c5764941b7d0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.476940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.476922 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30f19dac-33e8-4768-a29c-c5764941b7d0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.482353 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.482331 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdlz\" (UniqueName: \"kubernetes.io/projected/30f19dac-33e8-4768-a29c-c5764941b7d0-kube-api-access-xgdlz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dq4cb\" (UID: \"30f19dac-33e8-4768-a29c-c5764941b7d0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.547106 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.547069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:19.681630 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:19.681602 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb"] Jul 02 20:29:19.683490 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:29:19.683459 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f19dac_33e8_4768_a29c_c5764941b7d0.slice/crio-14d013ee64211bebc1b749053600292b8e54a61006222dd71859ce52b9f8a0f6 WatchSource:0}: Error finding container 14d013ee64211bebc1b749053600292b8e54a61006222dd71859ce52b9f8a0f6: Status 404 returned error can't find the container with id 14d013ee64211bebc1b749053600292b8e54a61006222dd71859ce52b9f8a0f6 Jul 02 20:29:20.024238 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:20.024192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" event={"ID":"30f19dac-33e8-4768-a29c-c5764941b7d0","Type":"ContainerStarted","Data":"0b6427bf2db5c55d226b7613744b6838a4fb67251cbc1db6178067650dd162a5"} Jul 02 20:29:20.024478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:20.024280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" event={"ID":"30f19dac-33e8-4768-a29c-c5764941b7d0","Type":"ContainerStarted","Data":"14d013ee64211bebc1b749053600292b8e54a61006222dd71859ce52b9f8a0f6"} Jul 02 20:29:20.041025 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:20.040967 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" podStartSLOduration=0.857262155 podStartE2EDuration="1.040950527s" totalImagesPullingTime="183.688372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:29:20.0401438 +0000 UTC m=+888.269769855" watchObservedRunningTime="2026-07-02 20:29:20.040950527 +0000 UTC m=+888.270576582" Jul 02 20:29:29.547803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:29.547715 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:29.547803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:29.547776 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:29.560215 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:29.560191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:29:30.085476 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:29:30.085437 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dq4cb" Jul 02 20:30:00.147178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.147140 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-6w2r4"] Jul 02 20:30:00.150371 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.150353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:00.152912 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.152887 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pz8h4\"" Jul 02 20:30:00.157353 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.157320 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-6w2r4"] Jul 02 20:30:00.205789 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.205745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjrw\" (UniqueName: \"kubernetes.io/projected/7cfffedf-8d0c-4f73-8648-99a87bc80c55-kube-api-access-frjrw\") pod \"maas-api-key-cleanup-29717070-6w2r4\" (UID: \"7cfffedf-8d0c-4f73-8648-99a87bc80c55\") " pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:00.306310 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.306268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjrw\" (UniqueName: \"kubernetes.io/projected/7cfffedf-8d0c-4f73-8648-99a87bc80c55-kube-api-access-frjrw\") pod \"maas-api-key-cleanup-29717070-6w2r4\" (UID: \"7cfffedf-8d0c-4f73-8648-99a87bc80c55\") " pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:00.315542 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.315513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjrw\" (UniqueName: \"kubernetes.io/projected/7cfffedf-8d0c-4f73-8648-99a87bc80c55-kube-api-access-frjrw\") pod \"maas-api-key-cleanup-29717070-6w2r4\" (UID: \"7cfffedf-8d0c-4f73-8648-99a87bc80c55\") " pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:00.463179 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.463146 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:00.597741 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.597710 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-6w2r4"] Jul 02 20:30:00.599853 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:30:00.599822 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfffedf_8d0c_4f73_8648_99a87bc80c55.slice/crio-543f018e68c5a9884bbf6828ae9a2119b4df9d0cb6c1e84a9b69e7bf9898e48c WatchSource:0}: Error finding container 543f018e68c5a9884bbf6828ae9a2119b4df9d0cb6c1e84a9b69e7bf9898e48c: Status 404 returned error can't find the container with id 543f018e68c5a9884bbf6828ae9a2119b4df9d0cb6c1e84a9b69e7bf9898e48c Jul 02 20:30:00.601697 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:00.601681 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:30:01.232893 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:01.232857 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" event={"ID":"7cfffedf-8d0c-4f73-8648-99a87bc80c55","Type":"ContainerStarted","Data":"543f018e68c5a9884bbf6828ae9a2119b4df9d0cb6c1e84a9b69e7bf9898e48c"} Jul 02 20:30:05.254199 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:05.254161 2573 generic.go:356] "Generic (PLEG): container finished" podID="7cfffedf-8d0c-4f73-8648-99a87bc80c55" containerID="b9f5ffc7f549e2e0066ce03ead97ca762c724b2e87f734c93afd701019d6162a" exitCode=0 Jul 02 20:30:05.254589 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:05.254244 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" event={"ID":"7cfffedf-8d0c-4f73-8648-99a87bc80c55","Type":"ContainerDied","Data":"b9f5ffc7f549e2e0066ce03ead97ca762c724b2e87f734c93afd701019d6162a"} Jul 02 20:30:06.392197 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:06.392172 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:06.462011 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:06.461977 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frjrw\" (UniqueName: \"kubernetes.io/projected/7cfffedf-8d0c-4f73-8648-99a87bc80c55-kube-api-access-frjrw\") pod \"7cfffedf-8d0c-4f73-8648-99a87bc80c55\" (UID: \"7cfffedf-8d0c-4f73-8648-99a87bc80c55\") " Jul 02 20:30:06.464052 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:06.464017 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cfffedf-8d0c-4f73-8648-99a87bc80c55-kube-api-access-frjrw" (OuterVolumeSpecName: "kube-api-access-frjrw") pod "7cfffedf-8d0c-4f73-8648-99a87bc80c55" (UID: "7cfffedf-8d0c-4f73-8648-99a87bc80c55"). InnerVolumeSpecName "kube-api-access-frjrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:06.563188 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:06.563114 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frjrw\" (UniqueName: \"kubernetes.io/projected/7cfffedf-8d0c-4f73-8648-99a87bc80c55-kube-api-access-frjrw\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:30:07.265129 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:07.265097 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" Jul 02 20:30:07.265323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:07.265134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-6w2r4" event={"ID":"7cfffedf-8d0c-4f73-8648-99a87bc80c55","Type":"ContainerDied","Data":"543f018e68c5a9884bbf6828ae9a2119b4df9d0cb6c1e84a9b69e7bf9898e48c"} Jul 02 20:30:07.265323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:30:07.265184 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="543f018e68c5a9884bbf6828ae9a2119b4df9d0cb6c1e84a9b69e7bf9898e48c" Jul 02 20:31:50.700000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.699965 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7756784977-x9plx"] Jul 02 20:31:50.700494 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.700315 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cfffedf-8d0c-4f73-8648-99a87bc80c55" containerName="cleanup" Jul 02 20:31:50.700494 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.700326 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cfffedf-8d0c-4f73-8648-99a87bc80c55" containerName="cleanup" Jul 02 20:31:50.700494 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.700411 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cfffedf-8d0c-4f73-8648-99a87bc80c55" containerName="cleanup" Jul 02 20:31:50.703290 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.703272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:50.705766 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.705741 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 20:31:50.706424 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.706386 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dv45p\"" Jul 02 20:31:50.706517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.706441 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 20:31:50.712981 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.712959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7756784977-x9plx"] Jul 02 20:31:50.774234 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.774185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2f9t\" (UniqueName: \"kubernetes.io/projected/bc973b56-6165-4d01-8740-69e6df7b8e84-kube-api-access-g2f9t\") pod \"maas-controller-7756784977-x9plx\" (UID: \"bc973b56-6165-4d01-8740-69e6df7b8e84\") " pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:50.774463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.774265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc973b56-6165-4d01-8740-69e6df7b8e84-webhook-cert\") pod \"maas-controller-7756784977-x9plx\" (UID: \"bc973b56-6165-4d01-8740-69e6df7b8e84\") " pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:50.874875 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.874839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2f9t\" (UniqueName: \"kubernetes.io/projected/bc973b56-6165-4d01-8740-69e6df7b8e84-kube-api-access-g2f9t\") pod \"maas-controller-7756784977-x9plx\" (UID: \"bc973b56-6165-4d01-8740-69e6df7b8e84\") " pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:50.875061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.874991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc973b56-6165-4d01-8740-69e6df7b8e84-webhook-cert\") pod \"maas-controller-7756784977-x9plx\" (UID: \"bc973b56-6165-4d01-8740-69e6df7b8e84\") " pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:50.877477 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.877445 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc973b56-6165-4d01-8740-69e6df7b8e84-webhook-cert\") pod \"maas-controller-7756784977-x9plx\" (UID: \"bc973b56-6165-4d01-8740-69e6df7b8e84\") " pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:50.882578 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:50.882555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2f9t\" (UniqueName: \"kubernetes.io/projected/bc973b56-6165-4d01-8740-69e6df7b8e84-kube-api-access-g2f9t\") pod \"maas-controller-7756784977-x9plx\" (UID: \"bc973b56-6165-4d01-8740-69e6df7b8e84\") " pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:51.014097 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:51.014054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:51.152490 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:51.152465 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7756784977-x9plx"] Jul 02 20:31:51.154162 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:31:51.154130 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc973b56_6165_4d01_8740_69e6df7b8e84.slice/crio-f3ec8fa4a27dc1373bd066cddb58ffeaf63eab950815a47916fa0cc492b1e5d5 WatchSource:0}: Error finding container f3ec8fa4a27dc1373bd066cddb58ffeaf63eab950815a47916fa0cc492b1e5d5: Status 404 returned error can't find the container with id f3ec8fa4a27dc1373bd066cddb58ffeaf63eab950815a47916fa0cc492b1e5d5 Jul 02 20:31:51.812936 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:51.812897 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7756784977-x9plx" event={"ID":"bc973b56-6165-4d01-8740-69e6df7b8e84","Type":"ContainerStarted","Data":"f3ec8fa4a27dc1373bd066cddb58ffeaf63eab950815a47916fa0cc492b1e5d5"} Jul 02 20:31:52.819724 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:52.819685 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7756784977-x9plx" event={"ID":"bc973b56-6165-4d01-8740-69e6df7b8e84","Type":"ContainerStarted","Data":"0140a94e05c293e2d83afcf241b4e3d94f459ad40f07562be3fc347ba56c40d7"} Jul 02 20:31:52.820116 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:52.819818 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:31:52.850379 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:31:52.850314 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7756784977-x9plx" podStartSLOduration=2.139372874 podStartE2EDuration="2.850290167s" totalImagesPullingTime="710.917293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:31:52.845904706 +0000 UTC m=+1041.075530762" watchObservedRunningTime="2026-07-02 20:31:52.850290167 +0000 UTC m=+1041.079916222" Jul 02 20:32:03.829879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:32:03.829845 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7756784977-x9plx" Jul 02 20:44:06.225240 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.225184 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp"] Jul 02 20:44:06.228791 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.228768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.231168 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.231144 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7ce02f69-openshift-default-dockercfg-4trqb\"" Jul 02 20:44:06.247960 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.247933 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp"] Jul 02 20:44:06.325843 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.325810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-podinfo\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326026 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.325862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istiod-ca-cert\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326026 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.325913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-credential-socket\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326026 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.325953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-envoy\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326026 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.326007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-socket\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.326051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4j5\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-kube-api-access-ps4j5\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.326085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-token\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.326111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-certs\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.326195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.326138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-data\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.427708 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427663 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-socket\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.427893 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4j5\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-kube-api-access-ps4j5\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.427893 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-token\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.427893 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-certs\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.427893 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-data\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428109 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-podinfo\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428109 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-socket\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428109 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.427966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istiod-ca-cert\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428109 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.428029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-credential-socket\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428109 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.428063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-envoy\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428349 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.428226 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-certs\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428349 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.428235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-data\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428608 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.428580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-credential-socket\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.428771 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.428750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istiod-ca-cert\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.430421 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.430383 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-envoy\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.430525 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.430499 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-podinfo\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.436526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.436499 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4j5\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-kube-api-access-ps4j5\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.436765 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.436744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-token\") pod \"e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.539809 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.539718 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:06.682452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.682428 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp"] Jul 02 20:44:06.684924 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:44:06.684894 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7216a8c6_b6f9_41ac_a8ee_13bfc40f3a9a.slice/crio-38f18075239fa32b01d3cf2918259339d02c59a39f74b38c467de8f4ea27bafc WatchSource:0}: Error finding container 38f18075239fa32b01d3cf2918259339d02c59a39f74b38c467de8f4ea27bafc: Status 404 returned error can't find the container with id 38f18075239fa32b01d3cf2918259339d02c59a39f74b38c467de8f4ea27bafc Jul 02 20:44:06.687525 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.687492 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:06.687599 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.687571 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:06.687640 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:06.687605 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:07.661073 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:07.661032 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" event={"ID":"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a","Type":"ContainerStarted","Data":"75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995"} Jul 02 20:44:07.661463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:07.661127 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" event={"ID":"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a","Type":"ContainerStarted","Data":"38f18075239fa32b01d3cf2918259339d02c59a39f74b38c467de8f4ea27bafc"} Jul 02 20:44:07.717812 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:07.717738 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" podStartSLOduration=1.7177169719999998 podStartE2EDuration="1.717716972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:44:07.715042891 +0000 UTC m=+1775.944668955" watchObservedRunningTime="2026-07-02 20:44:07.717716972 +0000 UTC m=+1775.947343027" Jul 02 20:44:08.540494 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:08.540452 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:08.545883 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:08.545852 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:08.667566 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:08.667534 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:08.668578 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:08.668556 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:12.733384 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:12.733343 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp"] Jul 02 20:44:12.733811 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:12.733624 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" podUID="7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" containerName="istio-proxy" containerID="cri-o://75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995" gracePeriod=30 Jul 02 20:44:17.988180 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:17.988127 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:18.136082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.135991 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-envoy\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.136082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.136032 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-podinfo\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.136082 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.136083 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istiod-ca-cert\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.136328 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.136123 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-certs\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.136328 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.136158 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-token\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.136328 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.136187 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps4j5\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-kube-api-access-ps4j5\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.136328 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.136212 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-credential-socket\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.137318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.137022 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:18.137318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.137121 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:44:18.137318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.137135 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-data\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.137318 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.137226 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-socket\") pod \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\" (UID: \"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a\") " Jul 02 20:44:18.137629 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.137553 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:18.137812 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.137751 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.138543 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.138573 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.138588 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.138611 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.138699 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.139227 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:18.139443 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.139231 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:44:18.146129 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.146012 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-kube-api-access-ps4j5" (OuterVolumeSpecName: "kube-api-access-ps4j5") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "kube-api-access-ps4j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:18.146129 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.145997 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" (UID: "7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:18.239294 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.239255 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.239294 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.239287 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps4j5\" (UniqueName: \"kubernetes.io/projected/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-kube-api-access-ps4j5\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.239294 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.239297 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.239294 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.239306 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.239588 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.239314 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:18.724593 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.724550 2573 generic.go:356] "Generic (PLEG): container finished" podID="7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" containerID="75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995" exitCode=0 Jul 02 20:44:18.724762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.724616 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" Jul 02 20:44:18.724762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.724631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" event={"ID":"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a","Type":"ContainerDied","Data":"75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995"} Jul 02 20:44:18.724762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.724693 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp" event={"ID":"7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a","Type":"ContainerDied","Data":"38f18075239fa32b01d3cf2918259339d02c59a39f74b38c467de8f4ea27bafc"} Jul 02 20:44:18.724762 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.724716 2573 scope.go:117] "RemoveContainer" containerID="75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995" Jul 02 20:44:18.734394 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.734370 2573 scope.go:117] "RemoveContainer" containerID="75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995" Jul 02 20:44:18.734720 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:44:18.734699 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995\": container with ID starting with 75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995 not found: ID does not exist" containerID="75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995" Jul 02 20:44:18.734800 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.734732 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995"} err="failed to get container status \"75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995\": rpc error: code = NotFound desc = could not find container \"75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995\": container with ID starting with 75a0749a4fde058692cc551d64260d5b06f6e5359fd24140905d350123fc2995 not found: ID does not exist" Jul 02 20:44:18.742973 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.742936 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp"] Jul 02 20:44:18.745364 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.745341 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7ce02f69-openshift-default-7cbd8b56c9-zqccp"] Jul 02 20:44:18.944279 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.944243 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67"] Jul 02 20:44:18.944686 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.944666 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" containerName="istio-proxy" Jul 02 20:44:18.944743 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.944689 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" containerName="istio-proxy" Jul 02 20:44:18.944780 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.944757 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" containerName="istio-proxy" Jul 02 20:44:18.949312 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.949285 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:18.952247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.952218 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6eb4b1ad-openshift-default-dockercfg-vvs9b\"" Jul 02 20:44:18.979147 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:18.979070 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67"] Jul 02 20:44:19.048164 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc17fad-8787-4000-8743-2a32be2ad479-istio-podinfo\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc17fad-8787-4000-8743-2a32be2ad479-istiod-ca-cert\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-certs\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-data\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smcb5\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-kube-api-access-smcb5\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-istio-token\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048331 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-credential-socket\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-socket\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.048647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.048485 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-envoy\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.148984 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.148936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-istio-token\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.148984 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.148981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-credential-socket\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-socket\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-envoy\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc17fad-8787-4000-8743-2a32be2ad479-istio-podinfo\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc17fad-8787-4000-8743-2a32be2ad479-istiod-ca-cert\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-certs\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149166 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-data\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149221 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcb5\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-kube-api-access-smcb5\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-credential-socket\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-certs\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149757 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149664 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-data\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149805 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-socket\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.149968 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.149944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc17fad-8787-4000-8743-2a32be2ad479-istiod-ca-cert\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.151544 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.151521 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-envoy\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.151778 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.151758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc17fad-8787-4000-8743-2a32be2ad479-istio-podinfo\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.157186 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.157162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-istio-token\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.157477 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.157392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smcb5\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-kube-api-access-smcb5\") pod \"e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.262635 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.262540 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:19.408554 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.408522 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67"] Jul 02 20:44:19.410031 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:44:19.410002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc17fad_8787_4000_8743_2a32be2ad479.slice/crio-37423e87206140273ca840c7a69b611b64ffbed3c7f8fa55b9bf3c4957d7a979 WatchSource:0}: Error finding container 37423e87206140273ca840c7a69b611b64ffbed3c7f8fa55b9bf3c4957d7a979: Status 404 returned error can't find the container with id 37423e87206140273ca840c7a69b611b64ffbed3c7f8fa55b9bf3c4957d7a979 Jul 02 20:44:19.412341 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.412303 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:19.412458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.412394 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:19.412530 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.412462 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:19.732837 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.732799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" event={"ID":"3cc17fad-8787-4000-8743-2a32be2ad479","Type":"ContainerStarted","Data":"8edc6bd9669c93b8b66ce71aeaac1e641892c0c6e0c432a235877942d67c34bc"} Jul 02 20:44:19.733000 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.732858 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" event={"ID":"3cc17fad-8787-4000-8743-2a32be2ad479","Type":"ContainerStarted","Data":"37423e87206140273ca840c7a69b611b64ffbed3c7f8fa55b9bf3c4957d7a979"} Jul 02 20:44:19.751897 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:19.751840 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" podStartSLOduration=1.7518213089999999 podStartE2EDuration="1.751821309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:44:19.750629563 +0000 UTC m=+1787.980255609" watchObservedRunningTime="2026-07-02 20:44:19.751821309 +0000 UTC m=+1787.981447403" Jul 02 20:44:20.263363 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:20.263327 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:20.268417 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:20.268379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:20.367458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:20.367421 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a" path="/var/lib/kubelet/pods/7216a8c6-b6f9-41ac-a8ee-13bfc40f3a9a/volumes" Jul 02 20:44:20.739107 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:20.739065 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:20.740107 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:20.740086 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:31.698684 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.698649 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67"] Jul 02 20:44:31.699179 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.698855 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" podUID="3cc17fad-8787-4000-8743-2a32be2ad479" containerName="istio-proxy" containerID="cri-o://8edc6bd9669c93b8b66ce71aeaac1e641892c0c6e0c432a235877942d67c34bc" gracePeriod=30 Jul 02 20:44:31.809722 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.809689 2573 generic.go:356] "Generic (PLEG): container finished" podID="3cc17fad-8787-4000-8743-2a32be2ad479" containerID="8edc6bd9669c93b8b66ce71aeaac1e641892c0c6e0c432a235877942d67c34bc" exitCode=0 Jul 02 20:44:31.809914 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.809758 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" event={"ID":"3cc17fad-8787-4000-8743-2a32be2ad479","Type":"ContainerDied","Data":"8edc6bd9669c93b8b66ce71aeaac1e641892c0c6e0c432a235877942d67c34bc"} Jul 02 20:44:31.850488 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.850466 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:31.973697 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973670 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc17fad-8787-4000-8743-2a32be2ad479-istio-podinfo\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.973856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973739 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc17fad-8787-4000-8743-2a32be2ad479-istiod-ca-cert\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.973856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973792 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-data\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.973856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973823 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-credential-socket\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.973856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973851 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-certs\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.974018 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973872 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-envoy\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.974018 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-istio-token\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.974018 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.973947 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-socket\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.974018 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974011 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smcb5\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-kube-api-access-smcb5\") pod \"3cc17fad-8787-4000-8743-2a32be2ad479\" (UID: \"3cc17fad-8787-4000-8743-2a32be2ad479\") " Jul 02 20:44:31.974216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974080 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:31.974216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974148 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:31.974216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974174 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cc17fad-8787-4000-8743-2a32be2ad479-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:44:31.974436 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974318 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc17fad-8787-4000-8743-2a32be2ad479-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:31.974436 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974338 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:31.974436 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974352 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:31.974436 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974392 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:31.974882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.974856 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:31.976063 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.976024 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cc17fad-8787-4000-8743-2a32be2ad479-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:44:31.976497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.976472 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:31.976497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.976473 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-kube-api-access-smcb5" (OuterVolumeSpecName: "kube-api-access-smcb5") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "kube-api-access-smcb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:31.976631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:31.976496 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cc17fad-8787-4000-8743-2a32be2ad479" (UID: "3cc17fad-8787-4000-8743-2a32be2ad479"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:32.075826 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.075786 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smcb5\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-kube-api-access-smcb5\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:32.076149 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.076122 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc17fad-8787-4000-8743-2a32be2ad479-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:32.076149 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.076151 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:32.076319 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.076160 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:32.076319 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.076171 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc17fad-8787-4000-8743-2a32be2ad479-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:32.076319 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.076204 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc17fad-8787-4000-8743-2a32be2ad479-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:32.815973 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.815940 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" Jul 02 20:44:32.816386 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.815947 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67" event={"ID":"3cc17fad-8787-4000-8743-2a32be2ad479","Type":"ContainerDied","Data":"37423e87206140273ca840c7a69b611b64ffbed3c7f8fa55b9bf3c4957d7a979"} Jul 02 20:44:32.816386 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.816083 2573 scope.go:117] "RemoveContainer" containerID="8edc6bd9669c93b8b66ce71aeaac1e641892c0c6e0c432a235877942d67c34bc" Jul 02 20:44:32.834412 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.834373 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67"] Jul 02 20:44:32.838101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:32.838076 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6eb4b1ad-openshift-default-7759b8479c-hff67"] Jul 02 20:44:34.366856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:34.366820 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc17fad-8787-4000-8743-2a32be2ad479" path="/var/lib/kubelet/pods/3cc17fad-8787-4000-8743-2a32be2ad479/volumes" Jul 02 20:44:37.862732 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.862697 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9"] Jul 02 20:44:37.863351 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.863242 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc17fad-8787-4000-8743-2a32be2ad479" containerName="istio-proxy" Jul 02 20:44:37.863351 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.863258 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc17fad-8787-4000-8743-2a32be2ad479" containerName="istio-proxy" Jul 02 20:44:37.863351 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.863323 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc17fad-8787-4000-8743-2a32be2ad479" containerName="istio-proxy" Jul 02 20:44:37.866354 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.866336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.868522 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.868501 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3986647f-openshift-default-dockercfg-5nzrd\"" Jul 02 20:44:37.879875 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.879849 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9"] Jul 02 20:44:37.925457 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-data\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-credential-socket\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-envoy\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-token\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-certs\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56dc51f2-4f2f-428a-9cce-44b8829987fb-istiod-ca-cert\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925649 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbpq4\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-kube-api-access-xbpq4\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-socket\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:37.925919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:37.925744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-podinfo\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026186 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-socket\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026186 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-podinfo\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-data\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-credential-socket\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-envoy\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-token\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-certs\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026352 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56dc51f2-4f2f-428a-9cce-44b8829987fb-istiod-ca-cert\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbpq4\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-kube-api-access-xbpq4\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026865 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-socket\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026921 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026852 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-credential-socket\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026921 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-data\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.026921 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.026904 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-certs\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.027494 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.027469 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56dc51f2-4f2f-428a-9cce-44b8829987fb-istiod-ca-cert\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.028764 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.028732 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-envoy\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.028953 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.028931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-podinfo\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.034497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.034457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-token\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.034767 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.034750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbpq4\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-kube-api-access-xbpq4\") pod \"e2e-derive-3986647f-openshift-default-664464945f-n8gw9\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.180681 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.180575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:38.366447 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:44:38.366416 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56dc51f2_4f2f_428a_9cce_44b8829987fb.slice/crio-5af25032773737ed4fab3efe98a5164131ffd1aaf715bb8b0d2c73a5fe46af6f WatchSource:0}: Error finding container 5af25032773737ed4fab3efe98a5164131ffd1aaf715bb8b0d2c73a5fe46af6f: Status 404 returned error can't find the container with id 5af25032773737ed4fab3efe98a5164131ffd1aaf715bb8b0d2c73a5fe46af6f Jul 02 20:44:38.368549 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.368487 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:38.368631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.368583 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:38.368631 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.368612 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:44:38.368714 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.368683 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9"] Jul 02 20:44:38.852217 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.852183 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" event={"ID":"56dc51f2-4f2f-428a-9cce-44b8829987fb","Type":"ContainerStarted","Data":"1a39aa27d6d35434f1bc8b751c525089f27055ca1f182d7de95e3fe38b86ba2d"} Jul 02 20:44:38.852466 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.852244 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" event={"ID":"56dc51f2-4f2f-428a-9cce-44b8829987fb","Type":"ContainerStarted","Data":"5af25032773737ed4fab3efe98a5164131ffd1aaf715bb8b0d2c73a5fe46af6f"} Jul 02 20:44:38.871368 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:38.871316 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" podStartSLOduration=1.87129883 podStartE2EDuration="1.87129883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:44:38.870534478 +0000 UTC m=+1807.100160532" watchObservedRunningTime="2026-07-02 20:44:38.87129883 +0000 UTC m=+1807.100924884" Jul 02 20:44:39.180943 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:39.180856 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:39.185745 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:39.185718 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:39.857926 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:39.857895 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:39.858919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:39.858902 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:43.691228 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:43.691193 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9"] Jul 02 20:44:43.691760 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:43.691420 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" podUID="56dc51f2-4f2f-428a-9cce-44b8829987fb" containerName="istio-proxy" containerID="cri-o://1a39aa27d6d35434f1bc8b751c525089f27055ca1f182d7de95e3fe38b86ba2d" gracePeriod=30 Jul 02 20:44:48.912283 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:48.912243 2573 generic.go:356] "Generic (PLEG): container finished" podID="56dc51f2-4f2f-428a-9cce-44b8829987fb" containerID="1a39aa27d6d35434f1bc8b751c525089f27055ca1f182d7de95e3fe38b86ba2d" exitCode=0 Jul 02 20:44:48.912784 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:48.912310 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" event={"ID":"56dc51f2-4f2f-428a-9cce-44b8829987fb","Type":"ContainerDied","Data":"1a39aa27d6d35434f1bc8b751c525089f27055ca1f182d7de95e3fe38b86ba2d"} Jul 02 20:44:48.954168 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:48.954099 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:49.029054 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029018 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-socket\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029255 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029073 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-certs\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029255 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029092 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56dc51f2-4f2f-428a-9cce-44b8829987fb-istiod-ca-cert\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029255 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029112 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-podinfo\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029255 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029150 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-credential-socket\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029438 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:49.029526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029460 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:49.029526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029430 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:49.029681 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029539 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56dc51f2-4f2f-428a-9cce-44b8829987fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:44:49.029739 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029674 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbpq4\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-kube-api-access-xbpq4\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029794 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029755 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-envoy\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029844 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029817 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-data\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.029895 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.029853 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-token\") pod \"56dc51f2-4f2f-428a-9cce-44b8829987fb\" (UID: \"56dc51f2-4f2f-428a-9cce-44b8829987fb\") " Jul 02 20:44:49.030153 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.030128 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.030153 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.030153 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.030153 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.030163 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56dc51f2-4f2f-428a-9cce-44b8829987fb-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.030422 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.030176 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.030933 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.030905 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:49.031597 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.031571 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-kube-api-access-xbpq4" (OuterVolumeSpecName: "kube-api-access-xbpq4") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "kube-api-access-xbpq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:49.031697 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.031622 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:44:49.032053 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.032036 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:44:49.032139 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.032121 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "56dc51f2-4f2f-428a-9cce-44b8829987fb" (UID: "56dc51f2-4f2f-428a-9cce-44b8829987fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:49.131576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.131536 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.131576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.131569 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbpq4\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-kube-api-access-xbpq4\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.131576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.131580 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.131576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.131589 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.131839 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.131597 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dc51f2-4f2f-428a-9cce-44b8829987fb-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:44:49.919178 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.919149 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" Jul 02 20:44:49.919576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.919172 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9" event={"ID":"56dc51f2-4f2f-428a-9cce-44b8829987fb","Type":"ContainerDied","Data":"5af25032773737ed4fab3efe98a5164131ffd1aaf715bb8b0d2c73a5fe46af6f"} Jul 02 20:44:49.919576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.919238 2573 scope.go:117] "RemoveContainer" containerID="1a39aa27d6d35434f1bc8b751c525089f27055ca1f182d7de95e3fe38b86ba2d" Jul 02 20:44:49.953991 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.953948 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9"] Jul 02 20:44:49.962917 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:49.962886 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3986647f-openshift-default-664464945f-n8gw9"] Jul 02 20:44:50.367543 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:44:50.367511 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56dc51f2-4f2f-428a-9cce-44b8829987fb" path="/var/lib/kubelet/pods/56dc51f2-4f2f-428a-9cce-44b8829987fb/volumes" Jul 02 20:45:00.136953 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.136917 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717085-4g24w"] Jul 02 20:45:00.137586 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.137492 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56dc51f2-4f2f-428a-9cce-44b8829987fb" containerName="istio-proxy" Jul 02 20:45:00.137586 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.137514 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56dc51f2-4f2f-428a-9cce-44b8829987fb" containerName="istio-proxy" Jul 02 20:45:00.137723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.137632 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56dc51f2-4f2f-428a-9cce-44b8829987fb" containerName="istio-proxy" Jul 02 20:45:00.142186 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.142164 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:00.144355 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.144331 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pz8h4\"" Jul 02 20:45:00.150792 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.150763 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717085-4g24w"] Jul 02 20:45:00.231301 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.231255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7t7\" (UniqueName: \"kubernetes.io/projected/43a7c642-7f01-4f89-93ad-9f708a601b68-kube-api-access-fr7t7\") pod \"maas-api-key-cleanup-29717085-4g24w\" (UID: \"43a7c642-7f01-4f89-93ad-9f708a601b68\") " pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:00.332344 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.332297 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7t7\" (UniqueName: \"kubernetes.io/projected/43a7c642-7f01-4f89-93ad-9f708a601b68-kube-api-access-fr7t7\") pod \"maas-api-key-cleanup-29717085-4g24w\" (UID: \"43a7c642-7f01-4f89-93ad-9f708a601b68\") " pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:00.340801 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.340780 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7t7\" (UniqueName: \"kubernetes.io/projected/43a7c642-7f01-4f89-93ad-9f708a601b68-kube-api-access-fr7t7\") pod \"maas-api-key-cleanup-29717085-4g24w\" (UID: \"43a7c642-7f01-4f89-93ad-9f708a601b68\") " pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:00.454129 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.454016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:00.586873 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.586845 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717085-4g24w"] Jul 02 20:45:00.588758 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:45:00.588727 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a7c642_7f01_4f89_93ad_9f708a601b68.slice/crio-dbf4aeb5db8c8b7ebcc394c3ecaeefa41e0b168475decf70837cc2229fc9e868 WatchSource:0}: Error finding container dbf4aeb5db8c8b7ebcc394c3ecaeefa41e0b168475decf70837cc2229fc9e868: Status 404 returned error can't find the container with id dbf4aeb5db8c8b7ebcc394c3ecaeefa41e0b168475decf70837cc2229fc9e868 Jul 02 20:45:00.978611 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.978574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" event={"ID":"43a7c642-7f01-4f89-93ad-9f708a601b68","Type":"ContainerStarted","Data":"11bfbc91c42ae43b42bc473fb9857e2e4a89a660580a935409dedb1bafd87bcd"} Jul 02 20:45:00.978818 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.978646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" event={"ID":"43a7c642-7f01-4f89-93ad-9f708a601b68","Type":"ContainerStarted","Data":"dbf4aeb5db8c8b7ebcc394c3ecaeefa41e0b168475decf70837cc2229fc9e868"} Jul 02 20:45:00.995986 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:00.995879 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" podStartSLOduration=0.995862211 podStartE2EDuration="995.862211ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:45:00.994130268 +0000 UTC m=+1829.223756345" watchObservedRunningTime="2026-07-02 20:45:00.995862211 +0000 UTC m=+1829.225488266" Jul 02 20:45:01.984928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:01.984891 2573 generic.go:356] "Generic (PLEG): container finished" podID="43a7c642-7f01-4f89-93ad-9f708a601b68" containerID="11bfbc91c42ae43b42bc473fb9857e2e4a89a660580a935409dedb1bafd87bcd" exitCode=0 Jul 02 20:45:01.985342 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:01.984976 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" event={"ID":"43a7c642-7f01-4f89-93ad-9f708a601b68","Type":"ContainerDied","Data":"11bfbc91c42ae43b42bc473fb9857e2e4a89a660580a935409dedb1bafd87bcd"} Jul 02 20:45:03.124912 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.124881 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:03.259453 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.259342 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr7t7\" (UniqueName: \"kubernetes.io/projected/43a7c642-7f01-4f89-93ad-9f708a601b68-kube-api-access-fr7t7\") pod \"43a7c642-7f01-4f89-93ad-9f708a601b68\" (UID: \"43a7c642-7f01-4f89-93ad-9f708a601b68\") " Jul 02 20:45:03.261551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.261513 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a7c642-7f01-4f89-93ad-9f708a601b68-kube-api-access-fr7t7" (OuterVolumeSpecName: "kube-api-access-fr7t7") pod "43a7c642-7f01-4f89-93ad-9f708a601b68" (UID: "43a7c642-7f01-4f89-93ad-9f708a601b68"). InnerVolumeSpecName "kube-api-access-fr7t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:45:03.360188 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.360153 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr7t7\" (UniqueName: \"kubernetes.io/projected/43a7c642-7f01-4f89-93ad-9f708a601b68-kube-api-access-fr7t7\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:45:03.996971 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.996941 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" Jul 02 20:45:03.996971 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.996955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-4g24w" event={"ID":"43a7c642-7f01-4f89-93ad-9f708a601b68","Type":"ContainerDied","Data":"dbf4aeb5db8c8b7ebcc394c3ecaeefa41e0b168475decf70837cc2229fc9e868"} Jul 02 20:45:03.997190 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:45:03.997024 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbf4aeb5db8c8b7ebcc394c3ecaeefa41e0b168475decf70837cc2229fc9e868" Jul 02 20:46:26.522761 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.522716 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr"] Jul 02 20:46:26.523383 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.523232 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a7c642-7f01-4f89-93ad-9f708a601b68" containerName="cleanup" Jul 02 20:46:26.523383 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.523253 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a7c642-7f01-4f89-93ad-9f708a601b68" containerName="cleanup" Jul 02 20:46:26.523544 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.523391 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a7c642-7f01-4f89-93ad-9f708a601b68" containerName="cleanup" Jul 02 20:46:26.526694 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.526670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.529206 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.529188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5b080c83-openshift-default-dockercfg-kk6l5\"" Jul 02 20:46:26.541672 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.541642 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr"] Jul 02 20:46:26.583069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-credential-socket\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583272 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-envoy\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583272 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-podinfo\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583272 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583181 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-token\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583272 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istiod-ca-cert\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-socket\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg8qr\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-kube-api-access-hg8qr\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583386 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-certs\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.583590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.583476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-data\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684694 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-podinfo\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684694 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-token\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istiod-ca-cert\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-socket\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg8qr\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-kube-api-access-hg8qr\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-certs\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.684958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-data\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685220 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.684970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-credential-socket\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685220 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.685015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-envoy\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685334 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.685283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-socket\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685436 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.685385 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-data\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.685506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-certs\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685584 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.685520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-credential-socket\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.685645 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.685620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istiod-ca-cert\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.687219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.687198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-envoy\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.687315 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.687259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-podinfo\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.698083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.698061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-token\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.698972 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.698949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg8qr\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-kube-api-access-hg8qr\") pod \"e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:26.837863 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:26.837759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:27.001622 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.001598 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr"] Jul 02 20:46:27.003687 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:46:27.003658 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7a6cdc_1c3b_49fb_b55a_7adf75aac933.slice/crio-4448a4b2a55013addeb34ff91a7b433bcf45477d91dba2cefe1846db9d8e00fc WatchSource:0}: Error finding container 4448a4b2a55013addeb34ff91a7b433bcf45477d91dba2cefe1846db9d8e00fc: Status 404 returned error can't find the container with id 4448a4b2a55013addeb34ff91a7b433bcf45477d91dba2cefe1846db9d8e00fc Jul 02 20:46:27.005881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.005844 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:46:27.005951 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.005912 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:46:27.005951 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.005940 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:46:27.423018 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.422976 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" event={"ID":"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933","Type":"ContainerStarted","Data":"32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0"} Jul 02 20:46:27.423206 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.423032 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" event={"ID":"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933","Type":"ContainerStarted","Data":"4448a4b2a55013addeb34ff91a7b433bcf45477d91dba2cefe1846db9d8e00fc"} Jul 02 20:46:27.449692 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.449635 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" podStartSLOduration=1.449615144 podStartE2EDuration="1.449615144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:46:27.449048384 +0000 UTC m=+1915.678674442" watchObservedRunningTime="2026-07-02 20:46:27.449615144 +0000 UTC m=+1915.679241199" Jul 02 20:46:27.838805 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:27.838763 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:28.843092 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:28.843062 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:29.433223 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:29.433191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:29.434108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:29.434089 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:42.514850 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:42.514814 2573 generic.go:356] "Generic (PLEG): container finished" podID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerID="32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0" exitCode=0 Jul 02 20:46:42.515320 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:42.514888 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" event={"ID":"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933","Type":"ContainerDied","Data":"32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0"} Jul 02 20:46:42.515320 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:42.515267 2573 scope.go:117] "RemoveContainer" containerID="32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0" Jul 02 20:46:42.516297 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:42.516266 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:46:42.516429 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:42.516358 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:46:42.516513 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:42.516428 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:46:43.522262 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:43.522224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" event={"ID":"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933","Type":"ContainerStarted","Data":"215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58"} Jul 02 20:46:43.840031 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:43.839919 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:43.840216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:43.840101 2573 patch_prober.go:28] interesting pod/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:46:43.840216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:43.840148 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:46:44.433883 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:44.433849 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:44.838588 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:44.838543 2573 patch_prober.go:28] interesting pod/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:46:44.839091 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:44.838615 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:46:45.838820 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:45.838779 2573 patch_prober.go:28] interesting pod/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:46:45.839434 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:45.839382 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:46:46.839004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:46.838533 2573 patch_prober.go:28] interesting pod/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:46:46.839004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:46.838619 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 02 20:46:47.714208 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:47.714174 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr"] Jul 02 20:46:47.714432 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:47.714371 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" containerID="cri-o://215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58" gracePeriod=30 Jul 02 20:46:52.978651 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:52.978580 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:53.138690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.138662 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-envoy\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.138690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.138694 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-socket\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.138931 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.138733 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-certs\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.138931 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.138755 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istiod-ca-cert\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.138931 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.138829 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-credential-socket\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.138931 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.138857 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-token\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.139145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139001 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg8qr\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-kube-api-access-hg8qr\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.139145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139012 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:46:53.139145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139086 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-podinfo\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.139145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139086 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:46:53.139145 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139123 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-data\") pod \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\" (UID: \"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933\") " Jul 02 20:46:53.139383 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139308 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:46:53.139577 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139550 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:46:53.139654 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139585 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.139654 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139606 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.139654 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139633 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.139998 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.139980 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:46:53.141429 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.141394 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:46:53.141517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.141450 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:46:53.141517 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.141480 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:46:53.141586 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.141546 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-kube-api-access-hg8qr" (OuterVolumeSpecName: "kube-api-access-hg8qr") pod "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" (UID: "0e7a6cdc-1c3b-49fb-b55a-7adf75aac933"). InnerVolumeSpecName "kube-api-access-hg8qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:46:53.240478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.240372 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.240478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.240425 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.240478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.240434 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.240478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.240442 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.240478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.240452 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.240478 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.240460 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg8qr\" (UniqueName: \"kubernetes.io/projected/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933-kube-api-access-hg8qr\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:46:53.580034 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.579942 2573 generic.go:356] "Generic (PLEG): container finished" podID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerID="215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58" exitCode=0 Jul 02 20:46:53.580034 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.579997 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" Jul 02 20:46:53.580214 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.580024 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" event={"ID":"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933","Type":"ContainerDied","Data":"215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58"} Jul 02 20:46:53.580214 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.580083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr" event={"ID":"0e7a6cdc-1c3b-49fb-b55a-7adf75aac933","Type":"ContainerDied","Data":"4448a4b2a55013addeb34ff91a7b433bcf45477d91dba2cefe1846db9d8e00fc"} Jul 02 20:46:53.580214 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.580106 2573 scope.go:117] "RemoveContainer" containerID="215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58" Jul 02 20:46:53.590096 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.590079 2573 scope.go:117] "RemoveContainer" containerID="32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0" Jul 02 20:46:53.598029 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.598008 2573 scope.go:117] "RemoveContainer" containerID="215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58" Jul 02 20:46:53.598536 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:46:53.598389 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58\": container with ID starting with 215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58 not found: ID does not exist" containerID="215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58" Jul 02 20:46:53.598536 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.598471 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58"} err="failed to get container status \"215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58\": rpc error: code = NotFound desc = could not find container \"215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58\": container with ID starting with 215910f013f1b682e9134e05078919db2f236da91117551ca9a1c24b2f023f58 not found: ID does not exist" Jul 02 20:46:53.598536 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.598519 2573 scope.go:117] "RemoveContainer" containerID="32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0" Jul 02 20:46:53.599069 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:46:53.599048 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0\": container with ID starting with 32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0 not found: ID does not exist" containerID="32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0" Jul 02 20:46:53.599141 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.599076 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0"} err="failed to get container status \"32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0\": rpc error: code = NotFound desc = could not find container \"32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0\": container with ID starting with 32ee2fd56e8d4a4f8d0ada12235217b2ccdf162601679cafb3321f52729006c0 not found: ID does not exist" Jul 02 20:46:53.601158 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.601140 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr"] Jul 02 20:46:53.605143 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:53.605122 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5b080c83-openshift-default-fc8b49f59-mslcr"] Jul 02 20:46:54.366602 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:46:54.366567 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" path="/var/lib/kubelet/pods/0e7a6cdc-1c3b-49fb-b55a-7adf75aac933/volumes" Jul 02 20:47:06.582680 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.582647 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd"] Jul 02 20:47:06.583252 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.583025 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" Jul 02 20:47:06.583252 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.583040 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" Jul 02 20:47:06.583252 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.583119 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" Jul 02 20:47:06.583252 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.583139 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" Jul 02 20:47:06.585965 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.585950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.588110 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.588088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-13937e3a-openshift-default-dockercfg-m2k94\"" Jul 02 20:47:06.598182 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.598155 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd"] Jul 02 20:47:06.657724 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-podinfo\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.657913 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-envoy\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.657913 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a897026-4f36-4396-9f67-b16a5a0ed151-istiod-ca-cert\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.657913 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-certs\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.658071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcf2s\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-kube-api-access-pcf2s\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.658071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-socket\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.658071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-credential-socket\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.658071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.657985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-token\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.658071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.658054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-data\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.758728 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.758695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-data\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.758728 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.758731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-podinfo\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.758753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-envoy\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.758877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a897026-4f36-4396-9f67-b16a5a0ed151-istiod-ca-cert\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.758948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-certs\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.758977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcf2s\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-kube-api-access-pcf2s\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759004 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-socket\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759281 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-credential-socket\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759281 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-token\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759281 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-data\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-socket\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-credential-socket\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759637 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-certs\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.759750 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.759726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a897026-4f36-4396-9f67-b16a5a0ed151-istiod-ca-cert\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.761184 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.761156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-envoy\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.761424 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.761384 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-podinfo\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.773645 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.773614 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcf2s\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-kube-api-access-pcf2s\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.774120 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.774102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-token\") pod \"e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:06.896536 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:06.896450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:07.033976 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.033947 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd"] Jul 02 20:47:07.035639 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:47:07.035614 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a897026_4f36_4396_9f67_b16a5a0ed151.slice/crio-9585266cf85eaab42ea94be59b133518aa5768b72ba49cf34b9329614f98a714 WatchSource:0}: Error finding container 9585266cf85eaab42ea94be59b133518aa5768b72ba49cf34b9329614f98a714: Status 404 returned error can't find the container with id 9585266cf85eaab42ea94be59b133518aa5768b72ba49cf34b9329614f98a714 Jul 02 20:47:07.037773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.037740 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:47:07.037851 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.037821 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:47:07.037894 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.037850 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:47:07.660161 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.660113 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" event={"ID":"2a897026-4f36-4396-9f67-b16a5a0ed151","Type":"ContainerStarted","Data":"f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb"} Jul 02 20:47:07.660589 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.660175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" event={"ID":"2a897026-4f36-4396-9f67-b16a5a0ed151","Type":"ContainerStarted","Data":"9585266cf85eaab42ea94be59b133518aa5768b72ba49cf34b9329614f98a714"} Jul 02 20:47:07.680120 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.680069 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" podStartSLOduration=1.680051201 podStartE2EDuration="1.680051201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:47:07.679820687 +0000 UTC m=+1955.909446768" watchObservedRunningTime="2026-07-02 20:47:07.680051201 +0000 UTC m=+1955.909677258" Jul 02 20:47:07.897144 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:07.897109 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:08.902895 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:08.902861 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:09.672316 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:09.672286 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:09.673155 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:09.673132 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:20.739277 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:20.739244 2573 generic.go:356] "Generic (PLEG): container finished" podID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerID="f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb" exitCode=0 Jul 02 20:47:20.739725 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:20.739320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" event={"ID":"2a897026-4f36-4396-9f67-b16a5a0ed151","Type":"ContainerDied","Data":"f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb"} Jul 02 20:47:20.739768 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:20.739723 2573 scope.go:117] "RemoveContainer" containerID="f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb" Jul 02 20:47:20.740832 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:20.740801 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:47:20.740903 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:20.740866 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:47:20.740903 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:20.740897 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:47:21.751211 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:21.751167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" event={"ID":"2a897026-4f36-4396-9f67-b16a5a0ed151","Type":"ContainerStarted","Data":"1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772"} Jul 02 20:47:21.897246 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:21.897204 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:21.898524 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:21.898495 2573 patch_prober.go:28] interesting pod/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:47:21.898671 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:21.898554 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 20:47:22.897297 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:22.897259 2573 patch_prober.go:28] interesting pod/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:47:22.897728 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:22.897327 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 20:47:23.897189 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:23.897153 2573 patch_prober.go:28] interesting pod/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:47:23.897373 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:23.897206 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 20:47:24.673123 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:24.673043 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:24.897563 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:24.897526 2573 patch_prober.go:28] interesting pod/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:47:24.897962 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:24.897597 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 02 20:47:25.901958 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:25.901915 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:47:25.903088 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:47:25.903066 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:48:41.808576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:41.808541 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd"] Jul 02 20:48:41.809062 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:41.808778 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" containerID="cri-o://1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772" gracePeriod=30 Jul 02 20:48:47.063196 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.063167 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:48:47.214265 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.214232 2573 generic.go:356] "Generic (PLEG): container finished" podID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerID="1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772" exitCode=0 Jul 02 20:48:47.214461 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.214286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" event={"ID":"2a897026-4f36-4396-9f67-b16a5a0ed151","Type":"ContainerDied","Data":"1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772"} Jul 02 20:48:47.214461 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.214332 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" event={"ID":"2a897026-4f36-4396-9f67-b16a5a0ed151","Type":"ContainerDied","Data":"9585266cf85eaab42ea94be59b133518aa5768b72ba49cf34b9329614f98a714"} Jul 02 20:48:47.214461 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.214350 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd" Jul 02 20:48:47.214461 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.214358 2573 scope.go:117] "RemoveContainer" containerID="1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772" Jul 02 20:48:47.223428 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.223385 2573 scope.go:117] "RemoveContainer" containerID="f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb" Jul 02 20:48:47.231164 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.231149 2573 scope.go:117] "RemoveContainer" containerID="1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772" Jul 02 20:48:47.231443 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:48:47.231424 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772\": container with ID starting with 1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772 not found: ID does not exist" containerID="1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772" Jul 02 20:48:47.231519 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.231458 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772"} err="failed to get container status \"1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772\": rpc error: code = NotFound desc = could not find container \"1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772\": container with ID starting with 1377e4381e28bdf2caf817246c6b426d2263abc87b59ce8bf50f2f9c4b1bb772 not found: ID does not exist" Jul 02 20:48:47.231519 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.231480 2573 scope.go:117] "RemoveContainer" containerID="f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb" Jul 02 20:48:47.231722 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:48:47.231705 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb\": container with ID starting with f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb not found: ID does not exist" containerID="f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb" Jul 02 20:48:47.231775 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.231728 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb"} err="failed to get container status \"f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb\": rpc error: code = NotFound desc = could not find container \"f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb\": container with ID starting with f651206a22a264ce195f1dcbefbab445d0553cb3ebdf16ea26abde3b35360efb not found: ID does not exist" Jul 02 20:48:47.232938 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.232922 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-certs\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.232995 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.232975 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcf2s\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-kube-api-access-pcf2s\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233050 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233006 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-envoy\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233050 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233023 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-socket\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233050 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233040 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-credential-socket\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233054 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-token\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233078 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a897026-4f36-4396-9f67-b16a5a0ed151-istiod-ca-cert\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233133 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-data\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233209 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233176 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-podinfo\") pod \"2a897026-4f36-4396-9f67-b16a5a0ed151\" (UID: \"2a897026-4f36-4396-9f67-b16a5a0ed151\") " Jul 02 20:48:47.233435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233218 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:48:47.233435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233335 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:48:47.233435 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233352 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:48:47.233604 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233535 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.233604 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233556 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.233604 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233568 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.233744 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.233636 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a897026-4f36-4396-9f67-b16a5a0ed151-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:48:47.234238 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.234215 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:48:47.235218 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.235184 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:48:47.235324 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.235285 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:48:47.235612 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.235592 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-kube-api-access-pcf2s" (OuterVolumeSpecName: "kube-api-access-pcf2s") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "kube-api-access-pcf2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:48:47.235691 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.235630 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a897026-4f36-4396-9f67-b16a5a0ed151" (UID: "2a897026-4f36-4396-9f67-b16a5a0ed151"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:48:47.334613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.334576 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.334613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.334607 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcf2s\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-kube-api-access-pcf2s\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.334613 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.334621 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.334864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.334633 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.334864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.334644 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a897026-4f36-4396-9f67-b16a5a0ed151-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.334864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.334655 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a897026-4f36-4396-9f67-b16a5a0ed151-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:48:47.536606 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.536572 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd"] Jul 02 20:48:47.542415 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:47.542367 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-13937e3a-openshift-default-6bf46bd47-w27jd"] Jul 02 20:48:48.373247 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:48:48.373200 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" path="/var/lib/kubelet/pods/2a897026-4f36-4396-9f67-b16a5a0ed151/volumes" Jul 02 20:49:36.823251 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823159 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r"] Jul 02 20:49:36.823752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823569 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" Jul 02 20:49:36.823752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823581 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" Jul 02 20:49:36.823752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823596 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" Jul 02 20:49:36.823752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823601 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7a6cdc-1c3b-49fb-b55a-7adf75aac933" containerName="istio-proxy" Jul 02 20:49:36.823752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823663 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" Jul 02 20:49:36.823752 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.823675 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" Jul 02 20:49:36.826782 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.826761 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.829191 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.829166 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-587503-openshift-default-dockercfg-kxlrn\"" Jul 02 20:49:36.840182 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.840152 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r"] Jul 02 20:49:36.955983 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.955936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-data\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.955983 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.955982 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv42g\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-kube-api-access-pv42g\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-envoy\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istiod-ca-cert\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-socket\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-certs\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-credential-socket\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956369 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-podinfo\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:36.956369 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:36.956223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-token\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057638 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-socket\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057638 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-certs\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-credential-socket\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-podinfo\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-token\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-data\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.057882 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv42g\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-kube-api-access-pv42g\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058091 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057886 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-envoy\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058091 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.057908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istiod-ca-cert\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058091 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.058062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-socket\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058254 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.058094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-credential-socket\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058254 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.058192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-certs\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058254 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.058245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-data\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.058821 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.058798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istiod-ca-cert\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.060179 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.060157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-envoy\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.060265 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.060249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-podinfo\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.065700 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.065674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-token\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.065799 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.065763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv42g\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-kube-api-access-pv42g\") pod \"e2e-inf-a-587503-openshift-default-74489958d9-4kg5r\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.136968 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.136878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:37.283031 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.283006 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r"] Jul 02 20:49:37.285225 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:49:37.285190 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4097ada_39a3_4829_9996_bd0a3d38ea7d.slice/crio-e38b213d8f484b4e28427750cda1151d88548c1ebb5132d74ffb9a3598184543 WatchSource:0}: Error finding container e38b213d8f484b4e28427750cda1151d88548c1ebb5132d74ffb9a3598184543: Status 404 returned error can't find the container with id e38b213d8f484b4e28427750cda1151d88548c1ebb5132d74ffb9a3598184543 Jul 02 20:49:37.287353 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.287310 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:37.287516 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.287440 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:37.287516 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.287500 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:37.489079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.489031 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" event={"ID":"d4097ada-39a3-4829-9996-bd0a3d38ea7d","Type":"ContainerStarted","Data":"0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8"} Jul 02 20:49:37.489283 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.489100 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" event={"ID":"d4097ada-39a3-4829-9996-bd0a3d38ea7d","Type":"ContainerStarted","Data":"e38b213d8f484b4e28427750cda1151d88548c1ebb5132d74ffb9a3598184543"} Jul 02 20:49:37.511009 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:37.510950 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podStartSLOduration=1.510933039 podStartE2EDuration="1.510933039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:49:37.508500927 +0000 UTC m=+2105.738126981" watchObservedRunningTime="2026-07-02 20:49:37.510933039 +0000 UTC m=+2105.740559092" Jul 02 20:49:38.137969 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:38.137927 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:38.143836 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:38.143806 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:38.494542 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:38.494513 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:38.495583 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:38.495565 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:44.640775 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.640737 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f"] Jul 02 20:49:44.641237 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.641098 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" Jul 02 20:49:44.641237 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.641114 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a897026-4f36-4396-9f67-b16a5a0ed151" containerName="istio-proxy" Jul 02 20:49:44.644836 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.644813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.647187 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.647164 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-237f0d-openshift-default-dockercfg-kvzqt\"" Jul 02 20:49:44.656949 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.656924 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f"] Jul 02 20:49:44.727998 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.727955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-socket\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728173 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728060 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istiod-ca-cert\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728173 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-credential-socket\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728173 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-envoy\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728173 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-podinfo\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728367 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-certs\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728367 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-data\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728367 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-token\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.728499 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.728375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvfkk\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-kube-api-access-pvfkk\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.828991 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.828953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-data\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.828991 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.828991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-token\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfkk\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-kube-api-access-pvfkk\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-socket\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istiod-ca-cert\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-credential-socket\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-envoy\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-podinfo\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-certs\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829680 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-data\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829680 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-socket\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829764 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-credential-socket\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829764 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-certs\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.829933 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.829914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istiod-ca-cert\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.831529 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.831506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-envoy\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.831723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.831706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-podinfo\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.836980 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.836957 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-token\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.837230 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.837213 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfkk\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-kube-api-access-pvfkk\") pod \"e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:44.956978 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:44.956881 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:45.098071 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.098047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f"] Jul 02 20:49:45.099440 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:49:45.099411 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7e9f89_e409_49a5_ad8e_9b22ce53a5c3.slice/crio-9f22daad415fafe398547fdb75d1ecabe636bde490bcd99472a64de9ce458c50 WatchSource:0}: Error finding container 9f22daad415fafe398547fdb75d1ecabe636bde490bcd99472a64de9ce458c50: Status 404 returned error can't find the container with id 9f22daad415fafe398547fdb75d1ecabe636bde490bcd99472a64de9ce458c50 Jul 02 20:49:45.101576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.101542 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:45.101681 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.101621 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:45.101681 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.101666 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:45.538627 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.538582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" event={"ID":"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3","Type":"ContainerStarted","Data":"8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78"} Jul 02 20:49:45.538849 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.538666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" event={"ID":"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3","Type":"ContainerStarted","Data":"9f22daad415fafe398547fdb75d1ecabe636bde490bcd99472a64de9ce458c50"} Jul 02 20:49:45.580536 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.580479 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podStartSLOduration=1.580461962 podStartE2EDuration="1.580461962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:49:45.577748564 +0000 UTC m=+2113.807374618" watchObservedRunningTime="2026-07-02 20:49:45.580461962 +0000 UTC m=+2113.810088016" Jul 02 20:49:45.957559 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:45.957455 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:46.962928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:46.962889 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:47.550767 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:47.550733 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:47.551674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:47.551646 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:49:54.536666 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:54.536621 2573 patch_prober.go:28] interesting pod/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 20:49:54.537280 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:54.537240 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 20:49:55.598440 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:55.598341 2573 generic.go:356] "Generic (PLEG): container finished" podID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerID="0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8" exitCode=0 Jul 02 20:49:55.598948 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:55.598435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" event={"ID":"d4097ada-39a3-4829-9996-bd0a3d38ea7d","Type":"ContainerDied","Data":"0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8"} Jul 02 20:49:55.599013 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:55.598976 2573 scope.go:117] "RemoveContainer" containerID="0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8" Jul 02 20:49:55.600031 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:55.600003 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:55.600130 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:55.600067 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:55.600130 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:55.600100 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:49:56.605729 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:56.605691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" event={"ID":"d4097ada-39a3-4829-9996-bd0a3d38ea7d","Type":"ContainerStarted","Data":"ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8"} Jul 02 20:49:57.137909 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:57.137866 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:49:57.138121 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:57.138013 2573 patch_prober.go:28] interesting pod/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:49:57.138121 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:57.138068 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 20:49:58.138112 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:58.138067 2573 patch_prober.go:28] interesting pod/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:49:58.138636 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:58.138144 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 20:49:59.138378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:59.138326 2573 patch_prober.go:28] interesting pod/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:49:59.138898 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:49:59.138421 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 20:50:00.137871 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:00.137386 2573 patch_prober.go:28] interesting pod/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:50:00.137871 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:00.137480 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 02 20:50:01.141370 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:01.141339 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:50:01.141858 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:01.141769 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:50:01.142395 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:01.142378 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:50:02.552856 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.552820 2573 patch_prober.go:28] interesting pod/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 02 20:50:02.553308 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.552876 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 02 20:50:02.642081 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.642044 2573 generic.go:356] "Generic (PLEG): container finished" podID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerID="8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78" exitCode=0 Jul 02 20:50:02.642282 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.642114 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" event={"ID":"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3","Type":"ContainerDied","Data":"8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78"} Jul 02 20:50:02.642644 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.642626 2573 scope.go:117] "RemoveContainer" containerID="8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78" Jul 02 20:50:02.643719 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.643688 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:50:02.643797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.643778 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:50:02.643843 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:02.643830 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:50:03.661698 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:03.661660 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" event={"ID":"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3","Type":"ContainerStarted","Data":"2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d"} Jul 02 20:50:03.957473 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:03.957335 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:50:03.957658 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:03.957586 2573 patch_prober.go:28] interesting pod/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 02 20:50:03.957730 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:03.957655 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 02 20:50:04.957778 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:04.957736 2573 patch_prober.go:28] interesting pod/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 02 20:50:04.958278 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:04.957806 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 02 20:50:05.957303 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:05.957255 2573 patch_prober.go:28] interesting pod/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 02 20:50:05.957524 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:05.957312 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 02 20:50:06.957690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:06.957651 2573 patch_prober.go:28] interesting pod/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 02 20:50:06.958101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:06.957714 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 02 20:50:07.960976 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:07.960945 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:50:07.961460 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:07.961316 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:50:07.962050 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:50:07.962027 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:51:49.766458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:49.766418 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r"] Jul 02 20:51:49.767026 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:49.766645 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" containerID="cri-o://ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8" gracePeriod=30 Jul 02 20:51:55.020331 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.020295 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:51:55.103819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103736 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istiod-ca-cert\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.103819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103776 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-socket\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.103819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103810 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-token\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103834 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-credential-socket\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103872 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv42g\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-kube-api-access-pv42g\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103935 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-envoy\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.103982 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-data\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104069 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104003 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-certs\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104345 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104077 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-podinfo\") pod \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\" (UID: \"d4097ada-39a3-4829-9996-bd0a3d38ea7d\") " Jul 02 20:51:55.104345 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104107 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:51:55.104345 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104147 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:51:55.104345 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104206 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:51:55.104596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104505 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:51:55.104596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104519 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.104596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104548 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.104596 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.104561 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.105084 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.105056 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:51:55.106152 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.106125 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:51:55.106253 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.106120 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:51:55.106253 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.106169 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:51:55.106253 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.106179 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-kube-api-access-pv42g" (OuterVolumeSpecName: "kube-api-access-pv42g") pod "d4097ada-39a3-4829-9996-bd0a3d38ea7d" (UID: "d4097ada-39a3-4829-9996-bd0a3d38ea7d"). InnerVolumeSpecName "kube-api-access-pv42g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:51:55.205333 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.205290 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.205333 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.205326 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv42g\" (UniqueName: \"kubernetes.io/projected/d4097ada-39a3-4829-9996-bd0a3d38ea7d-kube-api-access-pv42g\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.205333 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.205339 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.205611 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.205351 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.205611 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.205363 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4097ada-39a3-4829-9996-bd0a3d38ea7d-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.205611 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.205373 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4097ada-39a3-4829-9996-bd0a3d38ea7d-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:51:55.270803 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.270770 2573 generic.go:356] "Generic (PLEG): container finished" podID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerID="ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8" exitCode=0 Jul 02 20:51:55.270977 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.270823 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" Jul 02 20:51:55.270977 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.270860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" event={"ID":"d4097ada-39a3-4829-9996-bd0a3d38ea7d","Type":"ContainerDied","Data":"ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8"} Jul 02 20:51:55.270977 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.270913 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r" event={"ID":"d4097ada-39a3-4829-9996-bd0a3d38ea7d","Type":"ContainerDied","Data":"e38b213d8f484b4e28427750cda1151d88548c1ebb5132d74ffb9a3598184543"} Jul 02 20:51:55.270977 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.270934 2573 scope.go:117] "RemoveContainer" containerID="ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8" Jul 02 20:51:55.280661 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.280640 2573 scope.go:117] "RemoveContainer" containerID="0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8" Jul 02 20:51:55.291690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.291662 2573 scope.go:117] "RemoveContainer" containerID="ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8" Jul 02 20:51:55.292019 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:51:55.291998 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8\": container with ID starting with ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8 not found: ID does not exist" containerID="ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8" Jul 02 20:51:55.292086 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.292028 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8"} err="failed to get container status \"ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8\": rpc error: code = NotFound desc = could not find container \"ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8\": container with ID starting with ee20bf8832fa1dd8f36d8b1698b6f9fb72a395e1c60866e460fd07ef0bc767c8 not found: ID does not exist" Jul 02 20:51:55.292086 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.292047 2573 scope.go:117] "RemoveContainer" containerID="0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8" Jul 02 20:51:55.292294 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:51:55.292280 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8\": container with ID starting with 0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8 not found: ID does not exist" containerID="0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8" Jul 02 20:51:55.292370 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.292297 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8"} err="failed to get container status \"0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8\": rpc error: code = NotFound desc = could not find container \"0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8\": container with ID starting with 0dff320d03e756c0ff853912886f36fa4bc70c2c21da2f7c45a231fe8aa9acb8 not found: ID does not exist" Jul 02 20:51:55.293801 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.293776 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r"] Jul 02 20:51:55.297384 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:55.297360 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-587503-openshift-default-74489958d9-4kg5r"] Jul 02 20:51:56.366648 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:56.366618 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" path="/var/lib/kubelet/pods/d4097ada-39a3-4829-9996-bd0a3d38ea7d/volumes" Jul 02 20:51:56.817860 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:56.817827 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f"] Jul 02 20:51:56.818124 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:56.818090 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" containerID="cri-o://2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d" gracePeriod=30 Jul 02 20:51:57.704480 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.704449 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t"] Jul 02 20:51:57.704879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.704857 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" Jul 02 20:51:57.704879 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.704879 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" Jul 02 20:51:57.705107 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.704903 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" Jul 02 20:51:57.705107 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.704920 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" Jul 02 20:51:57.705107 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.705016 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" Jul 02 20:51:57.705107 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.705033 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4097ada-39a3-4829-9996-bd0a3d38ea7d" containerName="istio-proxy" Jul 02 20:51:57.709545 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.709528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.712441 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.712423 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3f65e9-openshift-default-dockercfg-zpcdt\"" Jul 02 20:51:57.723116 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.723091 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t"] Jul 02 20:51:57.827501 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-podinfo\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827501 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827514 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-data\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827766 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-certs\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827766 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-token\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827766 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskcx\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-kube-api-access-qskcx\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827766 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-socket\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827904 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istiod-ca-cert\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827904 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-envoy\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.827904 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.827863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-credential-socket\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929282 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-envoy\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-credential-socket\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-podinfo\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-data\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929662 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-certs\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929721 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929661 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-token\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929782 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-credential-socket\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929782 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskcx\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-kube-api-access-qskcx\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929889 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-socket\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.929889 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-data\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.930068 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istiod-ca-cert\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.930068 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.930053 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-socket\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.930174 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.929999 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-certs\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.930551 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.930534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istiod-ca-cert\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.932138 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.932112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-envoy\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.932361 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.932344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-podinfo\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.938835 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.938805 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskcx\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-kube-api-access-qskcx\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:57.939830 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:57.939802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-token\") pod \"e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:58.020036 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.019995 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:58.161310 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.161282 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t"] Jul 02 20:51:58.163122 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:51:58.163096 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9930f1af_e541_4803_bd78_8cd8d1d3d5c3.slice/crio-198e1069f89903c286acb325516da06552647cfa72d197c77aa7fe7898df0504 WatchSource:0}: Error finding container 198e1069f89903c286acb325516da06552647cfa72d197c77aa7fe7898df0504: Status 404 returned error can't find the container with id 198e1069f89903c286acb325516da06552647cfa72d197c77aa7fe7898df0504 Jul 02 20:51:58.165442 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.165369 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:51:58.165541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.165448 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:51:58.165541 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.165479 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:51:58.289758 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.289662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" event={"ID":"9930f1af-e541-4803-bd78-8cd8d1d3d5c3","Type":"ContainerStarted","Data":"ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b"} Jul 02 20:51:58.289758 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.289723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" event={"ID":"9930f1af-e541-4803-bd78-8cd8d1d3d5c3","Type":"ContainerStarted","Data":"198e1069f89903c286acb325516da06552647cfa72d197c77aa7fe7898df0504"} Jul 02 20:51:58.312928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:58.312828 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" podStartSLOduration=1.312807241 podStartE2EDuration="1.312807241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:51:58.310457898 +0000 UTC m=+2246.540083949" watchObservedRunningTime="2026-07-02 20:51:58.312807241 +0000 UTC m=+2246.542433296" Jul 02 20:51:59.021002 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:59.020957 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:59.026201 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:59.026178 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:59.294744 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:59.294660 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:51:59.295607 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:51:59.295589 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:02.069602 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.069574 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:52:02.170433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170297 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-token\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170364 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-certs\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170433 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170426 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-socket\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170472 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-data\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170508 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istiod-ca-cert\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170581 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-credential-socket\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170608 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-podinfo\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170632 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvfkk\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-kube-api-access-pvfkk\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.170723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170669 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-envoy\") pod \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\" (UID: \"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3\") " Jul 02 20:52:02.171024 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170742 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:02.171024 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170860 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:02.171024 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.170901 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:02.171195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.171066 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:52:02.171195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.171151 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.171195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.171171 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.171195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.171182 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.171195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.171191 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.171645 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.171608 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:02.172730 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.172706 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:52:02.172901 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.172876 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-kube-api-access-pvfkk" (OuterVolumeSpecName: "kube-api-access-pvfkk") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "kube-api-access-pvfkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:52:02.173014 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.172927 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:52:02.173195 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.173181 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" (UID: "aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:02.272497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.272463 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.272497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.272490 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.272497 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.272500 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvfkk\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-kube-api-access-pvfkk\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.272728 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.272509 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.272728 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.272518 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:02.311775 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.311732 2573 generic.go:356] "Generic (PLEG): container finished" podID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerID="2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d" exitCode=0 Jul 02 20:52:02.311946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.311787 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" Jul 02 20:52:02.311946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.311827 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" event={"ID":"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3","Type":"ContainerDied","Data":"2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d"} Jul 02 20:52:02.311946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.311904 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f" event={"ID":"aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3","Type":"ContainerDied","Data":"9f22daad415fafe398547fdb75d1ecabe636bde490bcd99472a64de9ce458c50"} Jul 02 20:52:02.311946 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.311936 2573 scope.go:117] "RemoveContainer" containerID="2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d" Jul 02 20:52:02.322282 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.322263 2573 scope.go:117] "RemoveContainer" containerID="8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78" Jul 02 20:52:02.330727 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.330680 2573 scope.go:117] "RemoveContainer" containerID="2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d" Jul 02 20:52:02.330952 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:52:02.330935 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d\": container with ID starting with 2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d not found: ID does not exist" containerID="2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d" Jul 02 20:52:02.331014 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.330959 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d"} err="failed to get container status \"2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d\": rpc error: code = NotFound desc = could not find container \"2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d\": container with ID starting with 2cf2b0badbae32117f81356c1ee89545f3e27d3ada4f6ab1c1a071dbef96f28d not found: ID does not exist" Jul 02 20:52:02.331014 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.330974 2573 scope.go:117] "RemoveContainer" containerID="8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78" Jul 02 20:52:02.331199 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:52:02.331180 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78\": container with ID starting with 8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78 not found: ID does not exist" containerID="8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78" Jul 02 20:52:02.331240 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.331207 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78"} err="failed to get container status \"8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78\": rpc error: code = NotFound desc = could not find container \"8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78\": container with ID starting with 8868b8c47ea4838892fb36da6ea39ded0e877eed3753611deee12564cee50a78 not found: ID does not exist" Jul 02 20:52:02.351742 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.351715 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f"] Jul 02 20:52:02.356557 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.356534 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-237f0d-openshift-default-859f765895-rhh2f"] Jul 02 20:52:02.366924 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:02.366899 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" path="/var/lib/kubelet/pods/aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3/volumes" Jul 02 20:52:05.592967 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.592929 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm"] Jul 02 20:52:05.593350 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.593283 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" Jul 02 20:52:05.593350 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.593293 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" Jul 02 20:52:05.593441 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.593357 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" Jul 02 20:52:05.593441 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.593366 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" Jul 02 20:52:05.597908 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.597885 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.600230 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.600206 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-199208-openshift-default-dockercfg-2q5t9\"" Jul 02 20:52:05.612441 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.612416 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm"] Jul 02 20:52:05.698529 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-socket\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698717 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-podinfo\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698717 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-token\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698717 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698607 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-envoy\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698889 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-certs\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698889 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-credential-socket\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698889 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988f7147-40cc-447e-88ab-51eb70dacbbb-istiod-ca-cert\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.698889 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-kube-api-access-5wrhw\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.699090 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.698904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-data\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799388 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-data\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-socket\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-podinfo\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-token\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799530 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-envoy\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-certs\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-credential-socket\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988f7147-40cc-447e-88ab-51eb70dacbbb-istiod-ca-cert\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-kube-api-access-5wrhw\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799773 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799740 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-data\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.799978 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.799788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-socket\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.800564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.800536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-certs\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.800675 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.800545 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-credential-socket\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.800675 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.800570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988f7147-40cc-447e-88ab-51eb70dacbbb-istiod-ca-cert\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.801786 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.801765 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-envoy\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.801995 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.801977 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-podinfo\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.807482 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.807456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-token\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.807887 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.807864 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-kube-api-access-5wrhw\") pod \"e2e-api-b-199208-openshift-default-8c78744bc-csqkm\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:05.908600 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:05.908502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:06.051677 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.051650 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm"] Jul 02 20:52:06.053305 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:52:06.053277 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988f7147_40cc_447e_88ab_51eb70dacbbb.slice/crio-09cb1b283e58367d4ee60b0340a1459842d6814cedbe2d703f95e5fb66448888 WatchSource:0}: Error finding container 09cb1b283e58367d4ee60b0340a1459842d6814cedbe2d703f95e5fb66448888: Status 404 returned error can't find the container with id 09cb1b283e58367d4ee60b0340a1459842d6814cedbe2d703f95e5fb66448888 Jul 02 20:52:06.056477 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.055773 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:06.056477 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.055853 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:06.056477 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.055893 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:06.335983 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.335949 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" event={"ID":"988f7147-40cc-447e-88ab-51eb70dacbbb","Type":"ContainerStarted","Data":"a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51"} Jul 02 20:52:06.336190 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.336010 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" event={"ID":"988f7147-40cc-447e-88ab-51eb70dacbbb","Type":"ContainerStarted","Data":"09cb1b283e58367d4ee60b0340a1459842d6814cedbe2d703f95e5fb66448888"} Jul 02 20:52:06.356302 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.356243 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podStartSLOduration=1.356226039 podStartE2EDuration="1.356226039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:52:06.353643568 +0000 UTC m=+2254.583269655" watchObservedRunningTime="2026-07-02 20:52:06.356226039 +0000 UTC m=+2254.585852092" Jul 02 20:52:06.909177 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:06.909129 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:07.913627 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:07.913598 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:08.347951 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:08.347918 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:08.349035 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:08.349014 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:18.405323 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:18.405285 2573 generic.go:356] "Generic (PLEG): container finished" podID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerID="ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b" exitCode=0 Jul 02 20:52:18.405751 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:18.405352 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" event={"ID":"9930f1af-e541-4803-bd78-8cd8d1d3d5c3","Type":"ContainerDied","Data":"ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b"} Jul 02 20:52:18.405808 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:18.405778 2573 scope.go:117] "RemoveContainer" containerID="ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b" Jul 02 20:52:18.406916 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:18.406889 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:18.406978 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:18.406959 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:18.407024 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:18.406990 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:19.413205 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:19.413167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" event={"ID":"9930f1af-e541-4803-bd78-8cd8d1d3d5c3","Type":"ContainerStarted","Data":"c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c"} Jul 02 20:52:20.020950 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:20.020915 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:20.021219 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:20.021195 2573 patch_prober.go:28] interesting pod/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 02 20:52:20.021277 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:20.021255 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 02 20:52:21.021128 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:21.021088 2573 patch_prober.go:28] interesting pod/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 02 20:52:21.021540 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:21.021143 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 02 20:52:22.020554 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:22.020513 2573 patch_prober.go:28] interesting pod/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 02 20:52:22.020797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:22.020750 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 02 20:52:23.021080 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:23.021032 2573 patch_prober.go:28] interesting pod/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 02 20:52:23.021526 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:23.021107 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 02 20:52:24.025518 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:24.025486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:24.026001 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:24.025853 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:24.026608 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:24.026587 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:24.390679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:24.390584 2573 patch_prober.go:28] interesting pod/e2e-api-b-199208-openshift-default-8c78744bc-csqkm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 20:52:24.390679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:24.390659 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 20:52:25.449010 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:25.448924 2573 generic.go:356] "Generic (PLEG): container finished" podID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerID="a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51" exitCode=0 Jul 02 20:52:25.449010 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:25.448995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" event={"ID":"988f7147-40cc-447e-88ab-51eb70dacbbb","Type":"ContainerDied","Data":"a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51"} Jul 02 20:52:25.449504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:25.449485 2573 scope.go:117] "RemoveContainer" containerID="a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51" Jul 02 20:52:25.450376 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:25.450348 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:25.450462 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:25.450436 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:25.450504 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:25.450475 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:26.458480 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:26.458441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" event={"ID":"988f7147-40cc-447e-88ab-51eb70dacbbb","Type":"ContainerStarted","Data":"83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a"} Jul 02 20:52:26.909228 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:26.909185 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:26.909449 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:26.909381 2573 patch_prober.go:28] interesting pod/e2e-api-b-199208-openshift-default-8c78744bc-csqkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 02 20:52:26.909509 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:26.909455 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 02 20:52:27.459387 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:27.459350 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t"] Jul 02 20:52:27.460558 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:27.460223 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" containerID="cri-o://c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c" gracePeriod=30 Jul 02 20:52:27.909782 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:27.909750 2573 patch_prober.go:28] interesting pod/e2e-api-b-199208-openshift-default-8c78744bc-csqkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 02 20:52:27.909955 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:27.909820 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 02 20:52:28.909769 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:28.909735 2573 patch_prober.go:28] interesting pod/e2e-api-b-199208-openshift-default-8c78744bc-csqkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 02 20:52:28.910144 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:28.909791 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 02 20:52:29.909524 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:29.909486 2573 patch_prober.go:28] interesting pod/e2e-api-b-199208-openshift-default-8c78744bc-csqkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 02 20:52:29.909704 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:29.909551 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 02 20:52:30.912985 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:30.912955 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:30.913438 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:30.913352 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:30.914165 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:30.914145 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:32.712895 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.712868 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:32.863777 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863679 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-certs\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.863777 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863721 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qskcx\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-kube-api-access-qskcx\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.863777 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863771 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-socket\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863808 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-data\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863823 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-token\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863844 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-podinfo\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.863999 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:32.864070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864006 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istiod-ca-cert\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864347 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864109 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-envoy\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864347 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864148 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-credential-socket\") pod \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\" (UID: \"9930f1af-e541-4803-bd78-8cd8d1d3d5c3\") " Jul 02 20:52:32.864347 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864149 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:32.864539 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864468 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:32.864598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864543 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.864598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864564 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.864598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864576 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:52:32.864844 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.864775 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:32.866200 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.866172 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-kube-api-access-qskcx" (OuterVolumeSpecName: "kube-api-access-qskcx") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "kube-api-access-qskcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:52:32.866200 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.866179 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:52:32.866340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.866237 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:32.866340 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.866238 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9930f1af-e541-4803-bd78-8cd8d1d3d5c3" (UID: "9930f1af-e541-4803-bd78-8cd8d1d3d5c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:52:32.965561 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965522 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qskcx\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-kube-api-access-qskcx\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.965561 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965552 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.965561 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965563 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.965561 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965571 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.965830 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965579 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.965830 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965587 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:32.965830 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:32.965594 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9930f1af-e541-4803-bd78-8cd8d1d3d5c3-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:33.499149 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.499114 2573 generic.go:356] "Generic (PLEG): container finished" podID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerID="c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c" exitCode=0 Jul 02 20:52:33.499334 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.499171 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" Jul 02 20:52:33.499334 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.499207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" event={"ID":"9930f1af-e541-4803-bd78-8cd8d1d3d5c3","Type":"ContainerDied","Data":"c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c"} Jul 02 20:52:33.499334 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.499267 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t" event={"ID":"9930f1af-e541-4803-bd78-8cd8d1d3d5c3","Type":"ContainerDied","Data":"198e1069f89903c286acb325516da06552647cfa72d197c77aa7fe7898df0504"} Jul 02 20:52:33.499334 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.499299 2573 scope.go:117] "RemoveContainer" containerID="c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c" Jul 02 20:52:33.509106 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.508918 2573 scope.go:117] "RemoveContainer" containerID="ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b" Jul 02 20:52:33.517421 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.517378 2573 scope.go:117] "RemoveContainer" containerID="c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c" Jul 02 20:52:33.517674 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:52:33.517651 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c\": container with ID starting with c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c not found: ID does not exist" containerID="c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c" Jul 02 20:52:33.517746 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.517682 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c"} err="failed to get container status \"c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c\": rpc error: code = NotFound desc = could not find container \"c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c\": container with ID starting with c45360b33a0d933fb7303d0ba84a45706146f0e3141df9120934ae93f0b8cd2c not found: ID does not exist" Jul 02 20:52:33.517746 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.517699 2573 scope.go:117] "RemoveContainer" containerID="ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b" Jul 02 20:52:33.517985 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:52:33.517966 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b\": container with ID starting with ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b not found: ID does not exist" containerID="ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b" Jul 02 20:52:33.518040 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.517990 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b"} err="failed to get container status \"ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b\": rpc error: code = NotFound desc = could not find container \"ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b\": container with ID starting with ec8ec55888c5dd57e681e2076cd2adfcc577d2a415eb1c970a06c3e00b7eb53b not found: ID does not exist" Jul 02 20:52:33.521029 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.521010 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t"] Jul 02 20:52:33.527241 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:33.527221 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3f65e9-openshift-default-5965c8cf7f-c979t"] Jul 02 20:52:34.367097 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:34.367064 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" path="/var/lib/kubelet/pods/9930f1af-e541-4803-bd78-8cd8d1d3d5c3/volumes" Jul 02 20:52:34.686864 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:34.686778 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm"] Jul 02 20:52:34.687061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:34.687030 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" containerID="cri-o://83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a" gracePeriod=30 Jul 02 20:52:39.946452 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:39.946373 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:40.029763 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029728 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-envoy\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.029961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029794 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988f7147-40cc-447e-88ab-51eb70dacbbb-istiod-ca-cert\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.029961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029825 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-podinfo\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.029961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029852 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-kube-api-access-5wrhw\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.029961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029890 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-socket\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.029961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029915 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-certs\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.029961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.029949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-token\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.030266 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030012 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-data\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.030266 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030046 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-credential-socket\") pod \"988f7147-40cc-447e-88ab-51eb70dacbbb\" (UID: \"988f7147-40cc-447e-88ab-51eb70dacbbb\") " Jul 02 20:52:40.030266 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030208 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:40.030458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030306 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/988f7147-40cc-447e-88ab-51eb70dacbbb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:52:40.030458 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030391 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.030583 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030458 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:40.030583 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.030545 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:40.031280 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.031254 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-data" (OuterVolumeSpecName: "istio-data") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:40.032227 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.032195 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:52:40.032330 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.032254 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-kube-api-access-5wrhw" (OuterVolumeSpecName: "kube-api-access-5wrhw") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "kube-api-access-5wrhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:52:40.032440 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.032423 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:52:40.032568 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.032547 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-token" (OuterVolumeSpecName: "istio-token") pod "988f7147-40cc-447e-88ab-51eb70dacbbb" (UID: "988f7147-40cc-447e-88ab-51eb70dacbbb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:52:40.131070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131027 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-kube-api-access-5wrhw\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131065 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131070 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131079 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131086 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131097 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131105 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131114 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988f7147-40cc-447e-88ab-51eb70dacbbb-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.131325 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.131122 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988f7147-40cc-447e-88ab-51eb70dacbbb-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:52:40.542427 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.542369 2573 generic.go:356] "Generic (PLEG): container finished" podID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerID="83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a" exitCode=0 Jul 02 20:52:40.542427 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.542424 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" Jul 02 20:52:40.542674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.542446 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" event={"ID":"988f7147-40cc-447e-88ab-51eb70dacbbb","Type":"ContainerDied","Data":"83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a"} Jul 02 20:52:40.542674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.542513 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm" event={"ID":"988f7147-40cc-447e-88ab-51eb70dacbbb","Type":"ContainerDied","Data":"09cb1b283e58367d4ee60b0340a1459842d6814cedbe2d703f95e5fb66448888"} Jul 02 20:52:40.542674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.542541 2573 scope.go:117] "RemoveContainer" containerID="83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a" Jul 02 20:52:40.554105 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.554081 2573 scope.go:117] "RemoveContainer" containerID="a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51" Jul 02 20:52:40.559814 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.559773 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm"] Jul 02 20:52:40.562026 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.562004 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-199208-openshift-default-8c78744bc-csqkm"] Jul 02 20:52:40.564284 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.564265 2573 scope.go:117] "RemoveContainer" containerID="83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a" Jul 02 20:52:40.564619 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:52:40.564599 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a\": container with ID starting with 83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a not found: ID does not exist" containerID="83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a" Jul 02 20:52:40.564679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.564629 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a"} err="failed to get container status \"83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a\": rpc error: code = NotFound desc = could not find container \"83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a\": container with ID starting with 83326d5512e21c63daf9742219abefb840b96c17b57c271196cefe3c2a72d03a not found: ID does not exist" Jul 02 20:52:40.564679 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.564649 2573 scope.go:117] "RemoveContainer" containerID="a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51" Jul 02 20:52:40.564893 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:52:40.564874 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51\": container with ID starting with a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51 not found: ID does not exist" containerID="a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51" Jul 02 20:52:40.564939 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:40.564898 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51"} err="failed to get container status \"a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51\": rpc error: code = NotFound desc = could not find container \"a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51\": container with ID starting with a9319232fe6361d654b4c420712dcd920614364d0fb528650a22e4675131ff51 not found: ID does not exist" Jul 02 20:52:42.366369 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:42.366308 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" path="/var/lib/kubelet/pods/988f7147-40cc-447e-88ab-51eb70dacbbb/volumes" Jul 02 20:52:43.661471 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661430 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f"] Jul 02 20:52:43.661881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661809 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" Jul 02 20:52:43.661881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661822 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" Jul 02 20:52:43.661881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661829 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" Jul 02 20:52:43.661881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661836 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" Jul 02 20:52:43.661881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661856 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" Jul 02 20:52:43.661881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661867 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7e9f89-e409-49a5-ad8e-9b22ce53a5c3" containerName="istio-proxy" Jul 02 20:52:43.662095 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661887 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" Jul 02 20:52:43.662095 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661895 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" Jul 02 20:52:43.662095 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.661997 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" Jul 02 20:52:43.662095 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.662009 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" Jul 02 20:52:43.662095 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.662019 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="988f7147-40cc-447e-88ab-51eb70dacbbb" containerName="istio-proxy" Jul 02 20:52:43.666606 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.666578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.668966 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.668938 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-9994a6-openshift-default-dockercfg-st596\"" Jul 02 20:52:43.677077 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.677047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f"] Jul 02 20:52:43.763081 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crvrf\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-kube-api-access-crvrf\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-data\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763289 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-podinfo\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763454 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-token\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763454 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-certs\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-credential-socket\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-envoy\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d02d15-5118-43d4-9796-ad28c5c736de-istiod-ca-cert\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.763576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.763552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-socket\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-data\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864674 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864681 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-podinfo\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-token\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-certs\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-credential-socket\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-envoy\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d02d15-5118-43d4-9796-ad28c5c736de-istiod-ca-cert\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.864927 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-socket\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.865225 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.864934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crvrf\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-kube-api-access-crvrf\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.865225 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.865188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-certs\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.865369 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.865345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-credential-socket\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.865451 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.865371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-socket\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.865451 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.865373 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-data\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.865632 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.865612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d02d15-5118-43d4-9796-ad28c5c736de-istiod-ca-cert\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.867146 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.867119 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-envoy\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.867362 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.867344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-podinfo\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.872758 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.872734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-token\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.872899 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.872881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crvrf\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-kube-api-access-crvrf\") pod \"e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:43.978079 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:43.978042 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:44.121835 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.121808 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f"] Jul 02 20:52:44.123519 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:52:44.123489 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d02d15_5118_43d4_9796_ad28c5c736de.slice/crio-663e3b67b6570744c226dd36ab10db3ce4c6e4a75b301fcb3320726b98c7f63a WatchSource:0}: Error finding container 663e3b67b6570744c226dd36ab10db3ce4c6e4a75b301fcb3320726b98c7f63a: Status 404 returned error can't find the container with id 663e3b67b6570744c226dd36ab10db3ce4c6e4a75b301fcb3320726b98c7f63a Jul 02 20:52:44.125841 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.125806 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:44.125932 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.125887 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:44.125932 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.125920 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:44.565724 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.565679 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" event={"ID":"a1d02d15-5118-43d4-9796-ad28c5c736de","Type":"ContainerStarted","Data":"1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060"} Jul 02 20:52:44.565938 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.565744 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" event={"ID":"a1d02d15-5118-43d4-9796-ad28c5c736de","Type":"ContainerStarted","Data":"663e3b67b6570744c226dd36ab10db3ce4c6e4a75b301fcb3320726b98c7f63a"} Jul 02 20:52:44.584278 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.584223 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" podStartSLOduration=1.5842061589999998 podStartE2EDuration="1.584206159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:52:44.582679059 +0000 UTC m=+2292.812305113" watchObservedRunningTime="2026-07-02 20:52:44.584206159 +0000 UTC m=+2292.813832212" Jul 02 20:52:44.978505 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:44.978463 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:45.984183 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:45.984145 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:46.578764 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:46.578728 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:46.579919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:46.579886 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:52:59.652369 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:59.652321 2573 generic.go:356] "Generic (PLEG): container finished" podID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerID="1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060" exitCode=0 Jul 02 20:52:59.652829 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:59.652393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" event={"ID":"a1d02d15-5118-43d4-9796-ad28c5c736de","Type":"ContainerDied","Data":"1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060"} Jul 02 20:52:59.652880 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:59.652841 2573 scope.go:117] "RemoveContainer" containerID="1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060" Jul 02 20:52:59.653919 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:59.653883 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:59.654058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:59.653955 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:52:59.654058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:52:59.653985 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 20:53:00.661488 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:00.661452 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" event={"ID":"a1d02d15-5118-43d4-9796-ad28c5c736de","Type":"ContainerStarted","Data":"cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6"} Jul 02 20:53:00.978872 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:00.978842 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:53:00.980043 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:00.980021 2573 patch_prober.go:28] interesting pod/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 02 20:53:00.980109 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:00.980068 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 02 20:53:01.579234 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:01.579201 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:53:01.978838 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:01.978805 2573 patch_prober.go:28] interesting pod/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 02 20:53:01.979224 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:01.978864 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 02 20:53:02.979150 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:02.979115 2573 patch_prober.go:28] interesting pod/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 02 20:53:02.979564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:02.979183 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 02 20:53:03.979563 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:03.979519 2573 patch_prober.go:28] interesting pod/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 02 20:53:03.979961 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:03.979583 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 02 20:53:04.983058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:04.983024 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:53:04.984182 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:53:04.984162 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:59:09.396675 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:09.396630 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f"] Jul 02 20:59:09.397260 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:09.396914 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" containerID="cri-o://cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6" gracePeriod=30 Jul 02 20:59:14.665222 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.665149 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:59:14.667245 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.667207 2573 generic.go:356] "Generic (PLEG): container finished" podID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerID="cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6" exitCode=0 Jul 02 20:59:14.667378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.667261 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" Jul 02 20:59:14.667378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.667300 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" event={"ID":"a1d02d15-5118-43d4-9796-ad28c5c736de","Type":"ContainerDied","Data":"cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6"} Jul 02 20:59:14.667378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.667367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f" event={"ID":"a1d02d15-5118-43d4-9796-ad28c5c736de","Type":"ContainerDied","Data":"663e3b67b6570744c226dd36ab10db3ce4c6e4a75b301fcb3320726b98c7f63a"} Jul 02 20:59:14.667515 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.667414 2573 scope.go:117] "RemoveContainer" containerID="cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6" Jul 02 20:59:14.677041 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.677013 2573 scope.go:117] "RemoveContainer" containerID="1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060" Jul 02 20:59:14.685799 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.685776 2573 scope.go:117] "RemoveContainer" containerID="cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6" Jul 02 20:59:14.686118 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:59:14.686097 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6\": container with ID starting with cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6 not found: ID does not exist" containerID="cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6" Jul 02 20:59:14.686175 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.686130 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6"} err="failed to get container status \"cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6\": rpc error: code = NotFound desc = could not find container \"cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6\": container with ID starting with cad56fef35c12d337b63af6bb753d1c5132f2b912ed2f0d8dfa07ef157e8cae6 not found: ID does not exist" Jul 02 20:59:14.686175 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.686151 2573 scope.go:117] "RemoveContainer" containerID="1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060" Jul 02 20:59:14.686429 ip-10-0-136-87 kubenswrapper[2573]: E0702 20:59:14.686381 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060\": container with ID starting with 1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060 not found: ID does not exist" containerID="1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060" Jul 02 20:59:14.686486 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.686436 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060"} err="failed to get container status \"1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060\": rpc error: code = NotFound desc = could not find container \"1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060\": container with ID starting with 1298d413ae1f05e9ac832312c9fdae3858ae3aa5da9a5768f39d84ce8a407060 not found: ID does not exist" Jul 02 20:59:14.774008 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.773977 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-token\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774008 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774013 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-credential-socket\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774062 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-podinfo\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774090 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-envoy\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774110 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crvrf\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-kube-api-access-crvrf\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774143 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-data\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774195 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-socket\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774225 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-certs\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774298 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774266 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d02d15-5118-43d4-9796-ad28c5c736de-istiod-ca-cert\") pod \"a1d02d15-5118-43d4-9796-ad28c5c736de\" (UID: \"a1d02d15-5118-43d4-9796-ad28c5c736de\") " Jul 02 20:59:14.774733 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774683 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:59:14.774997 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774943 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:59:14.774997 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.774959 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d02d15-5118-43d4-9796-ad28c5c736de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:59:14.775200 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.775070 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:59:14.775559 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.775529 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:59:14.776723 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.776697 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:59:14.776982 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.776957 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-kube-api-access-crvrf" (OuterVolumeSpecName: "kube-api-access-crvrf") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "kube-api-access-crvrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:59:14.777054 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.776986 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:59:14.777054 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.777030 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1d02d15-5118-43d4-9796-ad28c5c736de" (UID: "a1d02d15-5118-43d4-9796-ad28c5c736de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:59:14.875642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875600 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-token\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875635 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-credential-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875645 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-podinfo\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875642 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875653 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-envoy\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875922 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875663 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crvrf\" (UniqueName: \"kubernetes.io/projected/a1d02d15-5118-43d4-9796-ad28c5c736de-kube-api-access-crvrf\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875922 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875671 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-istio-data\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875922 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875680 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-socket\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875922 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875687 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d02d15-5118-43d4-9796-ad28c5c736de-workload-certs\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.875922 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.875695 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d02d15-5118-43d4-9796-ad28c5c736de-istiod-ca-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 02 20:59:14.989560 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.989521 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f"] Jul 02 20:59:14.994656 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:14.994630 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-9994a6-openshift-default-7d9c999c5f-4jj5f"] Jul 02 20:59:15.035708 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:15.035681 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717070-6w2r4_7cfffedf-8d0c-4f73-8648-99a87bc80c55/cleanup/0.log" Jul 02 20:59:15.145797 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:15.145768 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717085-4g24w_43a7c642-7f01-4f89-93ad-9f708a601b68/cleanup/0.log" Jul 02 20:59:15.259675 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:15.259584 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7756784977-x9plx_bc973b56-6165-4d01-8740-69e6df7b8e84/manager/0.log" Jul 02 20:59:15.724655 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:15.724625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b478dcdf-f2sfm_185f564e-f1ca-4ef3-8144-ea28b4a14359/copy-manifests/0.log" Jul 02 20:59:15.731496 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:15.731461 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b478dcdf-f2sfm_185f564e-f1ca-4ef3-8144-ea28b4a14359/manager/0.log" Jul 02 20:59:16.366681 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.366644 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" path="/var/lib/kubelet/pods/a1d02d15-5118-43d4-9796-ad28c5c736de/volumes" Jul 02 20:59:16.754544 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.754511 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w_50e31422-a7be-4a30-8a78-d239b7a564aa/pull/0.log" Jul 02 20:59:16.761189 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.761168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w_50e31422-a7be-4a30-8a78-d239b7a564aa/extract/0.log" Jul 02 20:59:16.767339 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.767319 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w_50e31422-a7be-4a30-8a78-d239b7a564aa/util/0.log" Jul 02 20:59:16.880510 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.880480 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf_b46f8347-a7d1-480d-b31f-a4921c39b784/util/0.log" Jul 02 20:59:16.887557 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.887518 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf_b46f8347-a7d1-480d-b31f-a4921c39b784/pull/0.log" Jul 02 20:59:16.894411 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:16.894378 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf_b46f8347-a7d1-480d-b31f-a4921c39b784/extract/0.log" Jul 02 20:59:17.003016 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:17.002985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2_2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f/util/0.log" Jul 02 20:59:17.009994 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:17.009925 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2_2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f/pull/0.log" Jul 02 20:59:17.017108 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:17.017085 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2_2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f/extract/0.log" Jul 02 20:59:17.126448 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:17.126392 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl_76db5cb2-b239-4c7d-81fa-fd38152ef0c0/util/0.log" Jul 02 20:59:17.135463 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:17.135435 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl_76db5cb2-b239-4c7d-81fa-fd38152ef0c0/pull/0.log" Jul 02 20:59:17.142727 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:17.142707 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl_76db5cb2-b239-4c7d-81fa-fd38152ef0c0/extract/0.log" Jul 02 20:59:18.405728 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:18.405685 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cmw7g_ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36/istio-proxy/0.log" Jul 02 20:59:18.522582 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:18.522548 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2xlcd_08817152-acd4-4c1d-b5e8-4e43c50ae52a/discovery/0.log" Jul 02 20:59:18.984354 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:18.984323 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zs2qv_30443f35-97e6-4240-868c-ddd68357205a/payload-pre-processing/0.log" Jul 02 20:59:19.216083 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:19.216052 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4c9dbcfc-phdxg_a87a736a-f2e4-4c38-8fbe-d4887256c30b/router/0.log" Jul 02 20:59:19.560860 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:19.560830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vfndt_ff4fcb5b-0e6b-42a2-a6e8-4cd547313230/main/0.log" Jul 02 20:59:19.789301 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:19.789268 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dq4cb_30f19dac-33e8-4768-a29c-c5764941b7d0/main/0.log" Jul 02 20:59:27.091711 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:27.091627 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fc9mb_1f158ad7-3cb9-4535-b637-45ca7f8aebd6/global-pull-secret-syncer/0.log" Jul 02 20:59:27.243911 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:27.243882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vqtn2_402779b2-26bc-41cb-a41e-6ad8b986f920/konnectivity-agent/0.log" Jul 02 20:59:27.287213 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:27.287167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-87.ec2.internal_1ecdd7f5cd600edbcf6d8937cb7364b4/haproxy/0.log" Jul 02 20:59:31.725101 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.725066 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w_50e31422-a7be-4a30-8a78-d239b7a564aa/extract/0.log" Jul 02 20:59:31.748343 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.748314 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w_50e31422-a7be-4a30-8a78-d239b7a564aa/util/0.log" Jul 02 20:59:31.771564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.771524 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595x75w_50e31422-a7be-4a30-8a78-d239b7a564aa/pull/0.log" Jul 02 20:59:31.803160 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.803134 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf_b46f8347-a7d1-480d-b31f-a4921c39b784/extract/0.log" Jul 02 20:59:31.830065 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.830036 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf_b46f8347-a7d1-480d-b31f-a4921c39b784/util/0.log" Jul 02 20:59:31.852110 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.852082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gwlxf_b46f8347-a7d1-480d-b31f-a4921c39b784/pull/0.log" Jul 02 20:59:31.883336 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.883308 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2_2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f/extract/0.log" Jul 02 20:59:31.903508 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.903476 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2_2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f/util/0.log" Jul 02 20:59:31.925598 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.925576 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sx8v2_2f2292ae-86a0-4a29-bd01-eb6dbdcd6f8f/pull/0.log" Jul 02 20:59:31.952639 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.952606 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl_76db5cb2-b239-4c7d-81fa-fd38152ef0c0/extract/0.log" Jul 02 20:59:31.974647 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:31.974617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl_76db5cb2-b239-4c7d-81fa-fd38152ef0c0/util/0.log" Jul 02 20:59:32.000978 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:32.000908 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2ftl_76db5cb2-b239-4c7d-81fa-fd38152ef0c0/pull/0.log" Jul 02 20:59:34.738138 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:34.738107 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-574d6d9f5b-n9zcv_d0ec122d-0100-404c-bc42-d18b0a628fcf/metrics-server/0.log" Jul 02 20:59:34.768216 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:34.768176 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-xsl8m_25948159-f68b-4776-be63-ef37343324a2/monitoring-plugin/0.log" Jul 02 20:59:35.001058 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.001026 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxnq2_88e254a4-9e65-4e09-9a0a-7f5ebaaac03a/node-exporter/0.log" Jul 02 20:59:35.023707 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.023678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxnq2_88e254a4-9e65-4e09-9a0a-7f5ebaaac03a/kube-rbac-proxy/0.log" Jul 02 20:59:35.044831 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.044803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxnq2_88e254a4-9e65-4e09-9a0a-7f5ebaaac03a/init-textfile/0.log" Jul 02 20:59:35.426604 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.426520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-r78sb_9b9e6547-4306-4253-8bbf-a1f8d8809661/prometheus-operator-admission-webhook/0.log" Jul 02 20:59:35.542460 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.542429 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dcc5db59-qnhsj_82713245-d63d-47a5-9100-7b4b2928d65b/thanos-query/0.log" Jul 02 20:59:35.561875 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.561849 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dcc5db59-qnhsj_82713245-d63d-47a5-9100-7b4b2928d65b/kube-rbac-proxy-web/0.log" Jul 02 20:59:35.586043 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.586013 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dcc5db59-qnhsj_82713245-d63d-47a5-9100-7b4b2928d65b/kube-rbac-proxy/0.log" Jul 02 20:59:35.607245 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.607219 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dcc5db59-qnhsj_82713245-d63d-47a5-9100-7b4b2928d65b/prom-label-proxy/0.log" Jul 02 20:59:35.630226 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.630198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dcc5db59-qnhsj_82713245-d63d-47a5-9100-7b4b2928d65b/kube-rbac-proxy-rules/0.log" Jul 02 20:59:35.655534 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:35.655508 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dcc5db59-qnhsj_82713245-d63d-47a5-9100-7b4b2928d65b/kube-rbac-proxy-metrics/0.log" Jul 02 20:59:36.867261 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:36.867229 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-l28dq_9b467fdc-d292-4d06-a401-16258182fd4b/networking-console-plugin/0.log" Jul 02 20:59:37.733791 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.733751 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf"] Jul 02 20:59:37.734120 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734108 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" Jul 02 20:59:37.734167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734123 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" Jul 02 20:59:37.734167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734138 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" Jul 02 20:59:37.734167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734144 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" Jul 02 20:59:37.734167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734159 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" Jul 02 20:59:37.734167 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734164 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" Jul 02 20:59:37.734343 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734222 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9930f1af-e541-4803-bd78-8cd8d1d3d5c3" containerName="istio-proxy" Jul 02 20:59:37.734343 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.734231 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d02d15-5118-43d4-9796-ad28c5c736de" containerName="istio-proxy" Jul 02 20:59:37.738716 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.738691 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.741055 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.741024 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9mtnv\"/\"default-dockercfg-5s2gd\"" Jul 02 20:59:37.741203 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.741079 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9mtnv\"/\"openshift-service-ca.crt\"" Jul 02 20:59:37.741740 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.741721 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9mtnv\"/\"kube-root-ca.crt\"" Jul 02 20:59:37.748176 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.748148 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf"] Jul 02 20:59:37.770940 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.770904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8ns\" (UniqueName: \"kubernetes.io/projected/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-kube-api-access-5p8ns\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.771229 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.771206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-sys\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.771392 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.771377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-podres\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.771564 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.771547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-proc\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.771690 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.771675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-lib-modules\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.872957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-lib-modules\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873022 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8ns\" (UniqueName: \"kubernetes.io/projected/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-kube-api-access-5p8ns\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873061 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-sys\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-podres\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-proc\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-lib-modules\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873191 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-proc\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-sys\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.873590 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.873257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-podres\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:37.882041 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:37.882008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8ns\" (UniqueName: \"kubernetes.io/projected/501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab-kube-api-access-5p8ns\") pod \"perf-node-gather-daemonset-vpgpf\" (UID: \"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab\") " pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:38.050198 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.050157 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:38.194967 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.194936 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf"] Jul 02 20:59:38.196984 ip-10-0-136-87 kubenswrapper[2573]: W0702 20:59:38.196953 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod501d2ad1_5ac1_4a4a_ac2b_5ef1d94f6cab.slice/crio-23c6ea3da5000c53c70c2ba32920d6801397a2aa7973cc0a2e55508f2ccceff5 WatchSource:0}: Error finding container 23c6ea3da5000c53c70c2ba32920d6801397a2aa7973cc0a2e55508f2ccceff5: Status 404 returned error can't find the container with id 23c6ea3da5000c53c70c2ba32920d6801397a2aa7973cc0a2e55508f2ccceff5 Jul 02 20:59:38.673532 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.673503 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-t7n6s_46643ebe-1c16-4256-b5ca-b414516a1cee/volume-data-source-validator/0.log" Jul 02 20:59:38.800248 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.800207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" event={"ID":"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab","Type":"ContainerStarted","Data":"9e060a5bbae1f9f472e22d87177e1e9ad7c5fd39c72cebca866e667c94f62abb"} Jul 02 20:59:38.800486 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.800278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" event={"ID":"501d2ad1-5ac1-4a4a-ac2b-5ef1d94f6cab","Type":"ContainerStarted","Data":"23c6ea3da5000c53c70c2ba32920d6801397a2aa7973cc0a2e55508f2ccceff5"} Jul 02 20:59:38.800486 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.800327 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:38.818372 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:38.818316 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" podStartSLOduration=1.8183001490000001 podStartE2EDuration="1.818300149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:59:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:59:38.815962336 +0000 UTC m=+2707.045588390" watchObservedRunningTime="2026-07-02 20:59:38.818300149 +0000 UTC m=+2707.047926203" Jul 02 20:59:39.777582 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:39.777550 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n7p4j_1ddd6efa-48ec-425c-840f-9b983bfa1775/dns/0.log" Jul 02 20:59:39.798559 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:39.798533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n7p4j_1ddd6efa-48ec-425c-840f-9b983bfa1775/kube-rbac-proxy/0.log" Jul 02 20:59:39.956603 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:39.956569 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psmhp_d5e6d1c3-c826-4e46-958f-0ba71390bd70/dns-node-resolver/0.log" Jul 02 20:59:40.663819 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:40.663781 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2v4jt_fa79b396-59d6-442a-b571-acd5c4aae7cf/node-ca/0.log" Jul 02 20:59:41.757378 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:41.757347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cmw7g_ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36/istio-proxy/0.log" Jul 02 20:59:41.867906 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:41.867869 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2xlcd_08817152-acd4-4c1d-b5e8-4e43c50ae52a/discovery/0.log" Jul 02 20:59:42.041754 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:42.041666 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zs2qv_30443f35-97e6-4240-868c-ddd68357205a/payload-pre-processing/0.log" Jul 02 20:59:42.115968 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:42.115937 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4c9dbcfc-phdxg_a87a736a-f2e4-4c38-8fbe-d4887256c30b/router/0.log" Jul 02 20:59:42.834474 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:42.834445 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k779v_98fb307c-b913-4ee9-9ed0-1f76cc8d104f/serve-healthcheck-canary/0.log" Jul 02 20:59:43.434832 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:43.434793 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cs7hl_865a2c34-7554-48d9-b20c-85e62bacf2af/kube-rbac-proxy/0.log" Jul 02 20:59:43.459804 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:43.459776 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cs7hl_865a2c34-7554-48d9-b20c-85e62bacf2af/exporter/0.log" Jul 02 20:59:43.484881 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:43.484850 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cs7hl_865a2c34-7554-48d9-b20c-85e62bacf2af/extractor/0.log" Jul 02 20:59:44.814576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:44.814544 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9mtnv/perf-node-gather-daemonset-vpgpf" Jul 02 20:59:45.942718 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:45.942659 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717070-6w2r4_7cfffedf-8d0c-4f73-8648-99a87bc80c55/cleanup/0.log" Jul 02 20:59:45.967185 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:45.967156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717085-4g24w_43a7c642-7f01-4f89-93ad-9f708a601b68/cleanup/0.log" Jul 02 20:59:46.061898 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:46.061866 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7756784977-x9plx_bc973b56-6165-4d01-8740-69e6df7b8e84/manager/0.log" Jul 02 20:59:46.261781 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:46.261753 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b478dcdf-f2sfm_185f564e-f1ca-4ef3-8144-ea28b4a14359/manager/0.log" Jul 02 20:59:46.284112 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:46.284092 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b478dcdf-f2sfm_185f564e-f1ca-4ef3-8144-ea28b4a14359/copy-manifests/0.log" Jul 02 20:59:47.955582 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:47.955555 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cmw7g_ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36/istio-proxy/0.log" Jul 02 20:59:48.028928 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:48.028891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b47c96757-8kp2c_6a8e805c-ff17-464e-a5e4-1043f3e79477/manager/0.log" Jul 02 20:59:48.061719 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:48.061694 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2xlcd_08817152-acd4-4c1d-b5e8-4e43c50ae52a/discovery/0.log" Jul 02 20:59:48.169230 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:48.169143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zs2qv_30443f35-97e6-4240-868c-ddd68357205a/payload-pre-processing/0.log" Jul 02 20:59:48.221168 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:48.221140 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4c9dbcfc-phdxg_a87a736a-f2e4-4c38-8fbe-d4887256c30b/router/0.log" Jul 02 20:59:49.407051 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:49.407026 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cmw7g_ab5f23b3-fbb3-43ca-be93-bdb2e15e2c36/istio-proxy/0.log" Jul 02 20:59:49.512576 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:49.512542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2xlcd_08817152-acd4-4c1d-b5e8-4e43c50ae52a/discovery/0.log" Jul 02 20:59:49.635957 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:49.635862 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zs2qv_30443f35-97e6-4240-868c-ddd68357205a/payload-pre-processing/0.log" Jul 02 20:59:49.688427 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:49.688379 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4c9dbcfc-phdxg_a87a736a-f2e4-4c38-8fbe-d4887256c30b/router/0.log" Jul 02 20:59:53.125830 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:53.125803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-wbffc_2a784cf8-5c30-4767-b976-c7d69265f72f/migrator/0.log" Jul 02 20:59:53.147607 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:53.147581 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-wbffc_2a784cf8-5c30-4767-b976-c7d69265f72f/graceful-termination/0.log" Jul 02 20:59:53.522158 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:53.522120 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-m8b49_8efdf623-86a7-4dce-9fa6-88d8c14ab130/kube-storage-version-migrator-operator/1.log" Jul 02 20:59:53.522866 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:53.522844 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-m8b49_8efdf623-86a7-4dce-9fa6-88d8c14ab130/kube-storage-version-migrator-operator/0.log" Jul 02 20:59:54.668332 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.668300 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/kube-multus-additional-cni-plugins/0.log" Jul 02 20:59:54.690599 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.690572 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/egress-router-binary-copy/0.log" Jul 02 20:59:54.711744 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.711721 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/cni-plugins/0.log" Jul 02 20:59:54.733904 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.733885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/bond-cni-plugin/0.log" Jul 02 20:59:54.757129 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.757103 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/routeoverride-cni/0.log" Jul 02 20:59:54.777913 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.777894 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/whereabouts-cni-bincopy/0.log" Jul 02 20:59:54.798727 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:54.798704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwvm5_80339ccf-b5ba-4802-b7ed-85683cd123c6/whereabouts-cni/0.log" Jul 02 20:59:55.036279 ip-10-0-136-87 kubenswrapper[2573]: I0702 20:59:55.036248 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wph8f_d9eeb65e-7db1-449f-b52a-f17296528b06/kube-multus/0.log"