Jul 20 19:12:58.048780 ip-10-0-132-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 19:12:58.048792 ip-10-0-132-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 19:12:58.048802 ip-10-0-132-142 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 19:12:58.049219 ip-10-0-132-142 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 19:13:08.298109 ip-10-0-132-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 19:13:08.298134 ip-10-0-132-142 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2043a2438de6497e91eaf479e09789c5 -- Jul 20 19:14:58.487840 ip-10-0-132-142 systemd[1]: Starting Kubernetes Kubelet... Jul 20 19:14:58.840236 ip-10-0-132-142 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:14:58.840236 ip-10-0-132-142 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 19:14:58.840236 ip-10-0-132-142 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:14:58.840236 ip-10-0-132-142 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 19:14:58.840236 ip-10-0-132-142 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:14:58.841653 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.841567 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 19:14:58.845728 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845711 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:14:58.845728 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845729 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845733 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845736 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845739 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845742 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845753 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845756 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845759 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845762 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845764 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845767 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845770 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845773 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845775 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845778 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845781 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845783 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845786 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845790 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:14:58.845797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845794 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845797 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845800 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845803 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845806 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845809 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845812 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845814 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845817 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845819 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845822 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845826 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845830 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845833 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845836 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845839 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845847 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845850 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845852 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:14:58.846260 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845854 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845858 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845862 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845865 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845867 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845870 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845872 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845875 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845877 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845880 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845882 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845885 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845887 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845890 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845893 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845896 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845899 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845902 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845904 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:14:58.846724 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845907 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845909 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845912 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845914 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845917 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845920 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845923 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845925 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845928 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845930 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845934 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845937 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845939 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845942 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845945 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845947 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845950 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845952 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845955 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845957 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:14:58.847212 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845961 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845963 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845966 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845968 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845971 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845973 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845975 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845978 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845981 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845984 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845987 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845990 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845993 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845995 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.845998 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846000 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846003 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846005 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846008 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846011 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:14:58.848005 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846731 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846739 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846742 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846746 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846749 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846752 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846755 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846757 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846760 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846766 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846770 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846773 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846776 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846778 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846781 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846784 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846786 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846789 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846797 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846800 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:14:58.848510 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846804 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846806 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846809 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846812 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846814 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846817 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846819 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846822 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846824 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846827 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846830 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846834 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846838 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846840 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846843 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846847 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846851 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846854 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846857 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846860 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:14:58.849046 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846863 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846865 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846868 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846871 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846874 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846877 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846880 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846883 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846886 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846888 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846892 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846894 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846897 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846900 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846902 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846905 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846907 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846910 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846913 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:14:58.849588 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846915 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846918 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846920 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846923 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846925 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846929 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846932 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846935 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846937 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846940 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846942 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846946 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846949 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846952 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846954 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846957 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846961 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846964 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846967 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:14:58.850073 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846970 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846973 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846976 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846979 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846982 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846984 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846988 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846990 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846993 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846995 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.846998 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847001 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847003 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847006 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847008 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847011 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847013 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847016 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847018 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847022 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:14:58.850553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847025 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847435 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847442 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847445 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847448 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847451 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847454 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847457 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847460 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847465 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847469 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847473 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847476 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847479 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847483 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847486 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847489 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847492 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847496 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:14:58.851109 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847499 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847502 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847505 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847508 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847511 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847513 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847516 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847519 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847522 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847525 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847546 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847549 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847553 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847555 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847559 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847562 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847564 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847567 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847570 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:14:58.852350 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847572 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847576 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847578 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847582 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847585 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847588 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847590 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847594 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847597 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847600 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847603 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847606 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847608 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847611 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847614 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847617 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847619 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847622 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847625 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847627 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:14:58.852885 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847630 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847633 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847636 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847640 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847644 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847647 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847650 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847653 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847655 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847658 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847661 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847664 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847666 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847669 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847672 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847675 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847678 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847680 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847683 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847686 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:14:58.853395 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847689 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847691 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847694 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847697 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847700 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847703 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847706 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847708 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847711 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847716 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847719 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847722 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847724 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847727 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847730 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847734 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847741 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847744 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847747 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847750 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:14:58.853963 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847753 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.847756 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847826 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847834 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847841 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847846 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847850 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847854 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847858 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847863 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847867 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847870 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847874 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847877 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847881 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847884 2576 flags.go:64] FLAG: --cgroup-root="" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847888 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847891 2576 flags.go:64] FLAG: --client-ca-file="" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847894 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847897 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847902 2576 flags.go:64] FLAG: --cluster-domain="" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847905 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847909 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847912 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 19:14:58.854473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847916 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847920 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847923 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847927 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847932 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847936 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847939 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847942 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847946 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847950 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847954 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847958 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847961 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847964 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847968 2576 flags.go:64] FLAG: --enable-server="true" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847971 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847976 2576 flags.go:64] FLAG: --event-burst="100" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847979 2576 flags.go:64] FLAG: --event-qps="50" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847983 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847986 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847989 2576 flags.go:64] FLAG: --eviction-hard="" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847993 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847996 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.847999 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848003 2576 flags.go:64] FLAG: --eviction-soft="" Jul 20 19:14:58.855282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848006 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848010 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848013 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848016 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848020 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848023 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848026 2576 flags.go:64] FLAG: --feature-gates="" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848030 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848033 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848037 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848042 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848047 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848050 2576 flags.go:64] FLAG: --help="false" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848054 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-132-142.ec2.internal" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848057 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848060 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848064 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848068 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848071 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848074 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848077 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848080 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848083 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 19:14:58.856341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848086 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848089 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848092 2576 flags.go:64] FLAG: --kube-reserved="" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848096 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848099 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848102 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848105 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848108 2576 flags.go:64] FLAG: --lock-file="" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848111 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848114 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848117 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848123 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848126 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848129 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848132 2576 flags.go:64] FLAG: --logging-format="text" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848136 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848139 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848142 2576 flags.go:64] FLAG: --manifest-url="" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848145 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848152 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848157 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848161 2576 flags.go:64] FLAG: --max-pods="110" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848164 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848168 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848171 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 19:14:58.857091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848174 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848178 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848181 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848185 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848193 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848196 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848200 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848203 2576 flags.go:64] FLAG: --pod-cidr="" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848206 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848213 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848216 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848219 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848222 2576 flags.go:64] FLAG: --port="10250" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848226 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848229 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056a7586f522b521c" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848232 2576 flags.go:64] FLAG: --qos-reserved="" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848235 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848238 2576 flags.go:64] FLAG: --register-node="true" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848241 2576 flags.go:64] FLAG: --register-with-taints="" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848246 2576 flags.go:64] FLAG: --registry-burst="10" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848249 2576 flags.go:64] FLAG: --registry-qps="5" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848252 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848255 2576 flags.go:64] FLAG: --reserved-memory="" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848259 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848262 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 19:14:58.857840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848265 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848268 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848274 2576 flags.go:64] FLAG: --runonce="false" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848277 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848280 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848283 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848287 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848290 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848293 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848297 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848300 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848304 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848307 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848310 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848313 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848316 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848319 2576 flags.go:64] FLAG: --system-cgroups="" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848322 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848328 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848331 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848334 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848338 2576 flags.go:64] FLAG: --tls-min-version="" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848341 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848344 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848347 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 19:14:58.858491 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848350 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848353 2576 flags.go:64] FLAG: --v="2" Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848358 2576 flags.go:64] FLAG: --version="false" Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848362 2576 flags.go:64] FLAG: --vmodule="" Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848366 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848369 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848494 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848498 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848501 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848507 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848510 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848513 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848516 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848520 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848523 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848527 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848530 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848533 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848536 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848540 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848542 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:14:58.859151 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848545 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848548 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848551 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848553 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848556 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848559 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848562 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848565 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848581 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848585 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848588 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848591 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848594 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848596 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848599 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848602 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848605 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848608 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848611 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:14:58.859834 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848613 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848617 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848620 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848623 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848626 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848629 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848632 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848634 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848637 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848640 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848643 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848646 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848649 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848652 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848655 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848658 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848660 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848663 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848666 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:14:58.860390 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848670 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848674 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848677 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848680 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848683 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848686 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848688 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848691 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848694 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848697 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848699 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848702 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848705 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848707 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848711 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848714 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848717 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848720 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848724 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848728 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:14:58.860899 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848732 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848735 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848738 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848741 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848744 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848747 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848750 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848753 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848756 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848760 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848763 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848767 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848770 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848773 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848776 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848783 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848786 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848789 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848791 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:14:58.861411 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848794 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848797 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848800 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848803 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848805 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848808 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.848811 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.848817 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.858265 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.858283 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.859057 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.859065 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859133 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859138 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859142 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:14:58.861924 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859145 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859148 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859152 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859155 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859159 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859162 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859167 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859172 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859175 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859178 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859182 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859184 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859187 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859190 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859193 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859196 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859199 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859202 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859210 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:14:58.862316 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859214 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859217 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859220 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859222 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859225 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859229 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859233 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859237 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859241 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859245 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859248 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859251 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859254 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859256 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859259 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859262 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859265 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859268 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859270 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859273 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:14:58.862821 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859276 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859280 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859283 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859286 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859288 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859292 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859294 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859297 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859300 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859303 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859306 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859308 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859311 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859314 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859316 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859319 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859322 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859325 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859328 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859331 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:14:58.863326 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859334 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859338 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859341 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859344 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859346 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859349 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859352 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859355 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859358 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859361 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859364 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859367 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859370 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859372 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859375 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859378 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859381 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859387 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859390 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:14:58.863846 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859394 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859397 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859401 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859404 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859407 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859410 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859413 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859416 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859418 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859421 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859424 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859427 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859430 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859432 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859435 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859438 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859441 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:14:58.864325 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859443 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.859449 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859609 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859616 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859620 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859623 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859626 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859629 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859632 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859636 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859639 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859642 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859645 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859647 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859651 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:14:58.864833 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859654 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859657 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859660 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859663 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859665 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859669 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859671 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859674 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859677 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859679 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859682 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859685 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859688 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859690 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859694 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859696 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859699 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859704 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859707 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:14:58.865232 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859711 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859715 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859718 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859722 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859725 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859732 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859735 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859738 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859741 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859744 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859747 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859751 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859755 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859758 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859761 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859764 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859766 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859769 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859772 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:14:58.865730 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859775 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859778 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859781 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859784 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859788 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859791 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859794 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859796 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859799 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859802 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859805 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859808 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859811 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859814 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859816 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859819 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859822 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859825 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859828 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:14:58.866243 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859831 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859833 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859836 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859839 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859842 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859845 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859848 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859852 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859855 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859858 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859861 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859864 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859867 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859870 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859872 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859875 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859878 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859881 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859884 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859886 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859889 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:14:58.866749 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859892 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859894 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859897 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859900 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859903 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859906 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:14:58.859908 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.859914 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.860041 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.862940 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.864180 2576 server.go:1019] "Starting client certificate rotation" Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.864289 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.864324 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:14:58.867288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.866556 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:14:58.868135 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.868120 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:14:58.878516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.878484 2576 log.go:25] "Validated CRI v1 runtime API" Jul 20 19:14:58.882223 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.882205 2576 log.go:25] "Validated CRI v1 image API" Jul 20 19:14:58.883264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.883244 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 19:14:58.887455 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.887426 2576 fs.go:135] Filesystem UUIDs: map[43dd342d-bff5-458f-945b-38935a45b8d0:/dev/nvme0n1p4 564d2ec9-2cbc-423f-8d58-1fa80dedc2e4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 20 19:14:58.887530 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.887455 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 19:14:58.894903 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.894754 2576 manager.go:216] Machine: {Timestamp:2026-07-20 19:14:58.893624478 +0000 UTC m=+0.286364005 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101668 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2db522e2b002b7decac22d2f13ba9e SystemUUID:ec2db522-e2b0-02b7-deca-c22d2f13ba9e BootID:2043a243-8de6-497e-91ea-f479e09789c5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:26:de:e9:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:26:de:e9:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:75:68:58:46:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 19:14:58.894903 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.894887 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 19:14:58.895043 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.895028 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 19:14:58.895789 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.895768 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:14:58.897246 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.897215 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 19:14:58.897447 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.897250 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 19:14:58.898013 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.898001 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 19:14:58.898052 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.898016 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 19:14:58.898052 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.898025 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:14:58.898718 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.898706 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:14:58.900121 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.900110 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 19:14:58.904224 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904211 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:14:58.904356 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904346 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 19:14:58.904393 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904384 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 20 19:14:58.904423 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904398 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 19:14:58.904423 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904418 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 19:14:58.904487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904428 2576 kubelet.go:398] "Adding apiserver pod source" Jul 20 19:14:58.904487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904439 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 19:14:58.904944 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904931 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:14:58.904983 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.904952 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:14:58.907742 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.907720 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 19:14:58.909941 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.909924 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 19:14:58.910003 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.909958 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 19:14:58.911191 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911157 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 19:14:58.911191 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911181 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 19:14:58.911191 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911190 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911219 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911239 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911256 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911280 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911291 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911302 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 19:14:58.911314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911313 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 19:14:58.911501 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911328 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 19:14:58.911501 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.911336 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 19:14:58.912534 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.912518 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 19:14:58.912534 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.912529 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 19:14:58.916019 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.915995 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 19:14:58.916090 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.916004 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 19:14:58.916271 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.916253 2576 server.go:1268] "Started kubelet" Jul 20 19:14:58.916599 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.916559 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 19:14:58.916893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.916843 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 19:14:58.917006 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.916843 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 19:14:58.917006 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.916961 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 19:14:58.917179 ip-10-0-132-142 systemd[1]: Started Kubernetes Kubelet. Jul 20 19:14:58.918893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.918873 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 19:14:58.919671 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.919654 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 20 19:14:58.922864 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.922844 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 19:14:58.924780 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.923895 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-142.ec2.internal.18c4156a5cfae978 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-142.ec2.internal,UID:ip-10-0-132-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-142.ec2.internal,},FirstTimestamp:2026-07-20 19:14:58.916223352 +0000 UTC m=+0.308962878,LastTimestamp:2026-07-20 19:14:58.916223352 +0000 UTC m=+0.308962878,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-142.ec2.internal,}" Jul 20 19:14:58.926471 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.926455 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 19:14:58.926538 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.926460 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 19:14:58.926606 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.926591 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:58.928766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.927001 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 19:14:58.928766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.927042 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 19:14:58.928766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.927223 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 20 19:14:58.928766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.927233 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 20 19:14:58.928766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.928687 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 19:14:58.930001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.929979 2576 factory.go:55] Registering systemd factory Jul 20 19:14:58.930085 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.930007 2576 factory.go:223] Registration of the systemd container factory successfully Jul 20 19:14:58.930678 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.930653 2576 factory.go:153] Registering CRI-O factory Jul 20 19:14:58.930678 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.930677 2576 factory.go:223] Registration of the crio container factory successfully Jul 20 19:14:58.930840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.930794 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 19:14:58.930840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.930825 2576 factory.go:103] Registering Raw factory Jul 20 19:14:58.930967 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.930852 2576 manager.go:1196] Started watching for new ooms in manager Jul 20 19:14:58.931401 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.931383 2576 manager.go:349] Starting recovery of all containers Jul 20 19:14:58.934141 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.934106 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 19:14:58.934314 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.934257 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 19:14:58.944669 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.944645 2576 manager.go:354] Recovery completed Jul 20 19:14:58.949317 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.949302 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:58.951269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951246 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:58.951343 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951288 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:58.951343 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951304 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:58.951955 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951936 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 19:14:58.951955 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951955 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 19:14:58.952058 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951975 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:14:58.952058 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.951945 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:58.952856 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.952836 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:58.952933 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.952875 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:58.952933 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.952893 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:58.953361 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.953280 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-142.ec2.internal.18c4156a5f11b1d8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-142.ec2.internal,UID:ip-10-0-132-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-142.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-142.ec2.internal,},FirstTimestamp:2026-07-20 19:14:58.951270872 +0000 UTC m=+0.344010398,LastTimestamp:2026-07-20 19:14:58.951270872 +0000 UTC m=+0.344010398,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-142.ec2.internal,}" Jul 20 19:14:58.954987 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.954968 2576 policy_none.go:49] "None policy: Start" Jul 20 19:14:58.955050 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.954996 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 19:14:58.955050 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.955013 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 19:14:58.955726 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.955710 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppp9g" Jul 20 19:14:58.957800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.957785 2576 policy_none.go:47] "Start" Jul 20 19:14:58.961719 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:58.961701 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppp9g" Jul 20 19:14:58.962905 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.962804 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-142.ec2.internal.18c4156a5f12172a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-142.ec2.internal,UID:ip-10-0-132-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-142.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-142.ec2.internal,},FirstTimestamp:2026-07-20 19:14:58.95129681 +0000 UTC m=+0.344036336,LastTimestamp:2026-07-20 19:14:58.95129681 +0000 UTC m=+0.344036336,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-142.ec2.internal,}" Jul 20 19:14:58.964967 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:58.964891 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-142.ec2.internal.18c4156a5f12456e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-142.ec2.internal,UID:ip-10-0-132-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-142.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-142.ec2.internal,},FirstTimestamp:2026-07-20 19:14:58.951308654 +0000 UTC m=+0.344048181,LastTimestamp:2026-07-20 19:14:58.951308654 +0000 UTC m=+0.344048181,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-142.ec2.internal,}" Jul 20 19:14:59.006506 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.006326 2576 manager.go:337] "Starting Device Plugin manager" Jul 20 19:14:59.006690 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.006534 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 19:14:59.006690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.006550 2576 server.go:87] "Starting device plugin registration server" Jul 20 19:14:59.006873 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.006860 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 19:14:59.006916 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.006874 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 19:14:59.007023 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.006989 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 19:14:59.007122 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.007108 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 19:14:59.007122 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.007121 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 19:14:59.008198 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.008175 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 19:14:59.008312 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.008235 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.034220 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.034175 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 19:14:59.041947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.035504 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 19:14:59.041947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.035544 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 19:14:59.041947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.035583 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 19:14:59.041947 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.035621 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 19:14:59.041947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.039218 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:14:59.108539 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.108475 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:59.109639 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.109619 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:59.109753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.109659 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:59.109753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.109676 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:59.109753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.109709 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.119757 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.119737 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.119855 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.119762 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-142.ec2.internal\": node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.136240 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.136199 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal"] Jul 20 19:14:59.136354 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.136272 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:59.137170 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.137153 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:59.137238 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.137185 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:59.137238 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.137196 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:59.139836 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.139823 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:59.139978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.139962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.140023 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.139993 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:59.140605 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.140588 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:59.140658 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.140622 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:59.140658 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.140633 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:59.140738 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.140595 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:59.140738 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.140697 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:59.140738 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.140707 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:59.143202 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.143180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.143299 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.143206 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:59.143898 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.143882 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:59.143970 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.143907 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:59.143970 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.143922 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:14:59.151348 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.151331 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.168349 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.168327 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-142.ec2.internal\" not found" node="ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.173143 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.173126 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-142.ec2.internal\" not found" node="ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.252230 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.252141 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.329453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.329420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ccd5778a6add9aa48fb07f3ce65790-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal\" (UID: \"18ccd5778a6add9aa48fb07f3ce65790\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.329568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.329460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b50cf1cf50a6e5e2eb27256335c2c144-config\") pod \"kube-apiserver-proxy-ip-10-0-132-142.ec2.internal\" (UID: \"b50cf1cf50a6e5e2eb27256335c2c144\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.329568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.329524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18ccd5778a6add9aa48fb07f3ce65790-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal\" (UID: \"18ccd5778a6add9aa48fb07f3ce65790\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.352331 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.352291 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.429794 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.429761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18ccd5778a6add9aa48fb07f3ce65790-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal\" (UID: \"18ccd5778a6add9aa48fb07f3ce65790\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.429893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.429788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18ccd5778a6add9aa48fb07f3ce65790-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal\" (UID: \"18ccd5778a6add9aa48fb07f3ce65790\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.429893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.429855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ccd5778a6add9aa48fb07f3ce65790-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal\" (UID: \"18ccd5778a6add9aa48fb07f3ce65790\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.430001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.429909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b50cf1cf50a6e5e2eb27256335c2c144-config\") pod \"kube-apiserver-proxy-ip-10-0-132-142.ec2.internal\" (UID: \"b50cf1cf50a6e5e2eb27256335c2c144\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.430001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.429948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ccd5778a6add9aa48fb07f3ce65790-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal\" (UID: \"18ccd5778a6add9aa48fb07f3ce65790\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.430001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.429970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b50cf1cf50a6e5e2eb27256335c2c144-config\") pod \"kube-apiserver-proxy-ip-10-0-132-142.ec2.internal\" (UID: \"b50cf1cf50a6e5e2eb27256335c2c144\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.453474 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.453434 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.472015 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.471984 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.476122 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.476092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" Jul 20 19:14:59.555602 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.555464 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.656478 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.656421 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.756843 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.756799 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.845355 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.845267 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:14:59.857810 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.857775 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.863337 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.863293 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 19:14:59.863539 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.863497 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:14:59.863622 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.863535 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:14:59.958235 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:14:59.958196 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:14:59.966418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.966374 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:09:59 +0000 UTC" deadline="2028-04-21 18:47:15.707792076 +0000 UTC" Jul 20 19:14:59.966418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.966412 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15383h32m15.741383724s" Jul 20 19:14:59.984678 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.984642 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:14:59.986226 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.986207 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:14:59.986327 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.986240 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:14:59.986327 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:14:59.986252 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:15:00.048365 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:00.048322 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50cf1cf50a6e5e2eb27256335c2c144.slice/crio-934e267b4a5f4b60abc027469eea4b1ab15fee42a4f6a14fab4131b0d0981914 WatchSource:0}: Error finding container 934e267b4a5f4b60abc027469eea4b1ab15fee42a4f6a14fab4131b0d0981914: Status 404 returned error can't find the container with id 934e267b4a5f4b60abc027469eea4b1ab15fee42a4f6a14fab4131b0d0981914 Jul 20 19:15:00.055658 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.055569 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:15:00.058319 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:00.058283 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-142.ec2.internal\" not found" Jul 20 19:15:00.064152 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:00.064126 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ccd5778a6add9aa48fb07f3ce65790.slice/crio-7b9364aac5028b2a0585e0681b87fb942d8d1dffec2e8fccb9a44b2b90823ae4 WatchSource:0}: Error finding container 7b9364aac5028b2a0585e0681b87fb942d8d1dffec2e8fccb9a44b2b90823ae4: Status 404 returned error can't find the container with id 7b9364aac5028b2a0585e0681b87fb942d8d1dffec2e8fccb9a44b2b90823ae4 Jul 20 19:15:00.077522 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.077496 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:00.127692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.127599 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" Jul 20 19:15:00.145031 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.145004 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:15:00.146633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.146614 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" Jul 20 19:15:00.158931 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.158905 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:15:00.407081 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.406996 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:00.905408 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.905327 2576 apiserver.go:52] "Watching apiserver" Jul 20 19:15:00.915906 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.915581 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 19:15:00.917373 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.917335 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-5mn9d","kube-system/konnectivity-agent-lsjgw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal","openshift-multus/multus-9vxxb","openshift-multus/multus-additional-cni-plugins-pwvvx","openshift-network-operator/iptables-alerter-685vb","openshift-ovn-kubernetes/ovnkube-node-m4kvq","kube-system/global-pull-secret-syncer-f42sp","kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p","openshift-cluster-node-tuning-operator/tuned-fwd5x","openshift-dns/node-resolver-vt6nr","openshift-image-registry/node-ca-k9fhj","openshift-multus/network-metrics-daemon-hzv2j"] Jul 20 19:15:00.920305 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.920274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.923016 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.922992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:00.923517 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.923496 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 19:15:00.923647 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.923585 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 19:15:00.925068 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.924854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 19:15:00.925068 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.925004 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 19:15:00.925250 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.925118 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.925250 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.925140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g6nd5\"" Jul 20 19:15:00.925456 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.925389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:00.925456 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.925452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.925700 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:00.925479 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:00.926224 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.925900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 19:15:00.926931 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.926908 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 19:15:00.927673 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.927649 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.928124 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.928106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b6g26\"" Jul 20 19:15:00.929212 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.928883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.929212 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.929016 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.931873 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.931852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.932532 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.932512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.932649 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.932581 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czf9f\"" Jul 20 19:15:00.932890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.932872 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 19:15:00.933153 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.933129 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.933259 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.933237 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 19:15:00.934924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.934906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 19:15:00.935568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.935493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:00.936012 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.935989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdvmd\"" Jul 20 19:15:00.936735 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.936716 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 19:15:00.938531 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.938488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:00.938632 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:00.938596 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:00.939163 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.939143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpkjt\"" Jul 20 19:15:00.939250 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.939166 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.939398 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.939360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.939398 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.939401 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 19:15:00.940212 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.940181 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:15:00.941149 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:00.941243 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:00.941206 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-etc-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-cni-bin\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-ovnkube-config\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-system-cni-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-system-cni-dir\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.941701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-kubelet\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-systemd\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-env-overrides\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/015476e6-0abe-4284-95a3-8454a66b916a-ovn-node-metrics-cert\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-cni-binary-copy\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-systemd-units\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.941999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-ovn\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-cni-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-kubelet\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-multus-certs\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82p8l\" (UniqueName: \"kubernetes.io/projected/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-kube-api-access-82p8l\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-cnibin\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.942125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-var-lib-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-node-log\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-ovnkube-script-lib\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qrpv\" (UniqueName: \"kubernetes.io/projected/0e401ed6-b6f5-444d-b724-532d696079c1-kube-api-access-5qrpv\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwdrn\" (UniqueName: \"kubernetes.io/projected/64e93309-65de-4877-8a56-6eaa173f2fd5-kube-api-access-nwdrn\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-os-release\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-k8s-cni-cncf-io\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-hostroot\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-log-socket\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e401ed6-b6f5-444d-b724-532d696079c1-serviceca\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-socket-dir-parent\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-conf-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-daemon-config\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-etc-kubernetes\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-cni-netd\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.942785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nfwg\" (UniqueName: \"kubernetes.io/projected/015476e6-0abe-4284-95a3-8454a66b916a-kube-api-access-6nfwg\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-run-netns\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-cnibin\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-netns\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-cni-multus\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-os-release\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-slash\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e401ed6-b6f5-444d-b724-532d696079c1-host\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-cni-bin\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:00.943493 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.942901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k57zq\" (UniqueName: \"kubernetes.io/projected/11200e60-7310-49fd-9bce-bd093517d357-kube-api-access-k57zq\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:00.944064 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.943869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:00.946423 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.946401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:00.946994 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.946883 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 19:15:00.947183 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.947100 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 19:15:00.947258 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.947236 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xwzgw\"" Jul 20 19:15:00.949230 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.949207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:00.949776 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.949753 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.949869 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.949807 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.950091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.950067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j44k9\"" Jul 20 19:15:00.950280 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.950257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 19:15:00.951798 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.951755 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.952085 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.952067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:00.952243 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.952228 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7lgp8\"" Jul 20 19:15:00.952864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.952620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.954994 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.954972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 19:15:00.955432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.955414 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 19:15:00.955745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.955724 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvgs2\"" Jul 20 19:15:00.966796 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.966751 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rf8k5" Jul 20 19:15:00.975358 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:00.975338 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rf8k5" Jul 20 19:15:01.030515 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.030479 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 19:15:01.043161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-cni-multus\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.043161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-cni-bin\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94728ae5-352b-4526-a994-3fcde78a2135-host-slash\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-cni-multus\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-etc-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-ovnkube-config\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-cni-bin\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-system-cni-dir\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysconfig\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.043413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-system-cni-dir\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-sys\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/015476e6-0abe-4284-95a3-8454a66b916a-ovn-node-metrics-cert\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043485 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-etc-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-cni-binary-copy\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043528 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-run\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-lib-modules\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/766a7aaf-d001-4c0b-ab1c-a1107f5921ec-agent-certs\") pod \"konnectivity-agent-lsjgw\" (UID: \"766a7aaf-d001-4c0b-ab1c-a1107f5921ec\") " pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-systemd-units\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-ovn\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-cnibin\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysctl-conf\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/766a7aaf-d001-4c0b-ab1c-a1107f5921ec-konnectivity-ca\") pod \"konnectivity-agent-lsjgw\" (UID: \"766a7aaf-d001-4c0b-ab1c-a1107f5921ec\") " pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-ovnkube-script-lib\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qrpv\" (UniqueName: \"kubernetes.io/projected/0e401ed6-b6f5-444d-b724-532d696079c1-kube-api-access-5qrpv\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.044027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043850 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-systemd-units\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwdrn\" (UniqueName: \"kubernetes.io/projected/64e93309-65de-4877-8a56-6eaa173f2fd5-kube-api-access-nwdrn\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-os-release\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.043936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-k8s-cni-cncf-io\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-os-release\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-ovn\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-cnibin\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-hostroot\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-hosts-file\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-log-socket\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e401ed6-b6f5-444d-b724-532d696079c1-serviceca\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-device-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.044274 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044271 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044289 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-ovnkube-config\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-sys-fs\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-cni-binary-copy\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-modprobe-d\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.044977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-k8s-cni-cncf-io\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044364 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-log-socket\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.044378 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:01.54435579 +0000 UTC m=+2.937095305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-hostroot\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-cni-netd\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-ovnkube-script-lib\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-cni-netd\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nfwg\" (UniqueName: \"kubernetes.io/projected/015476e6-0abe-4284-95a3-8454a66b916a-kube-api-access-6nfwg\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-host\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c744d9be-c396-4bde-aaf3-9dce4688e5ec-tmp\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2jk\" (UniqueName: \"kubernetes.io/projected/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-kube-api-access-sg2jk\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044666 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-cnibin\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-os-release\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-cnibin\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.045914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044808 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e401ed6-b6f5-444d-b724-532d696079c1-serviceca\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-os-release\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-slash\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e401ed6-b6f5-444d-b724-532d696079c1-host\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k57zq\" (UniqueName: \"kubernetes.io/projected/11200e60-7310-49fd-9bce-bd093517d357-kube-api-access-k57zq\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e401ed6-b6f5-444d-b724-532d696079c1-host\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-slash\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-socket-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94728ae5-352b-4526-a994-3fcde78a2135-iptables-alerter-script\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.044962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11200e60-7310-49fd-9bce-bd093517d357-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-cni-bin\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-system-cni-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045081 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-kubernetes\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.046824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-systemd\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045138 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-cni-bin\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-var-lib-kubelet\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-tmp-dir\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045195 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-system-cni-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-kubelet\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-systemd\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-env-overrides\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st72w\" (UniqueName: \"kubernetes.io/projected/5eea965d-a996-46f5-82de-28a232f8d0ad-kube-api-access-st72w\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-run-systemd\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-kubelet\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysctl-d\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-cni-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-kubelet\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-multus-certs\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82p8l\" (UniqueName: \"kubernetes.io/projected/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-kube-api-access-82p8l\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.047594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfdecac6-161c-4f42-8d9e-b42a74bfa964-dbus\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-var-lib-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045854 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/015476e6-0abe-4284-95a3-8454a66b916a-env-overrides\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-node-log\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-conf-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-multus-certs\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045950 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.045957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfdecac6-161c-4f42-8d9e-b42a74bfa964-kubelet-config\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-var-lib-openvswitch\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" event={"ID":"18ccd5778a6add9aa48fb07f3ce65790","Type":"ContainerStarted","Data":"7b9364aac5028b2a0585e0681b87fb942d8d1dffec2e8fccb9a44b2b90823ae4"} Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-node-log\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-conf-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046181 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-var-lib-kubelet\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-cni-dir\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-tuned\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56vjf\" (UniqueName: \"kubernetes.io/projected/94728ae5-352b-4526-a994-3fcde78a2135-kube-api-access-56vjf\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.048219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-socket-dir-parent\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-daemon-config\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046482 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-socket-dir-parent\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-etc-kubernetes\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-etc-kubernetes\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-registration-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj86j\" (UniqueName: \"kubernetes.io/projected/c744d9be-c396-4bde-aaf3-9dce4688e5ec-kube-api-access-lj86j\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-run-netns\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-netns\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046844 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-run-netns\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-multus-daemon-config\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-host-run-netns\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.046964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015476e6-0abe-4284-95a3-8454a66b916a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.047221 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11200e60-7310-49fd-9bce-bd093517d357-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.047781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" event={"ID":"b50cf1cf50a6e5e2eb27256335c2c144","Type":"ContainerStarted","Data":"934e267b4a5f4b60abc027469eea4b1ab15fee42a4f6a14fab4131b0d0981914"} Jul 20 19:15:01.048958 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.048804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/015476e6-0abe-4284-95a3-8454a66b916a-ovn-node-metrics-cert\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.058134 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.058101 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qrpv\" (UniqueName: \"kubernetes.io/projected/0e401ed6-b6f5-444d-b724-532d696079c1-kube-api-access-5qrpv\") pod \"node-ca-k9fhj\" (UID: \"0e401ed6-b6f5-444d-b724-532d696079c1\") " pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.058755 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.058726 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwdrn\" (UniqueName: \"kubernetes.io/projected/64e93309-65de-4877-8a56-6eaa173f2fd5-kube-api-access-nwdrn\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:01.058896 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.058730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k57zq\" (UniqueName: \"kubernetes.io/projected/11200e60-7310-49fd-9bce-bd093517d357-kube-api-access-k57zq\") pod \"multus-additional-cni-plugins-pwvvx\" (UID: \"11200e60-7310-49fd-9bce-bd093517d357\") " pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.059502 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.059475 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nfwg\" (UniqueName: \"kubernetes.io/projected/015476e6-0abe-4284-95a3-8454a66b916a-kube-api-access-6nfwg\") pod \"ovnkube-node-m4kvq\" (UID: \"015476e6-0abe-4284-95a3-8454a66b916a\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.060929 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.060895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82p8l\" (UniqueName: \"kubernetes.io/projected/6b346a67-39ca-4cc2-9b1c-b40e7ea19540-kube-api-access-82p8l\") pod \"multus-9vxxb\" (UID: \"6b346a67-39ca-4cc2-9b1c-b40e7ea19540\") " pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.148152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysconfig\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-sys\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-run\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-lib-modules\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/766a7aaf-d001-4c0b-ab1c-a1107f5921ec-agent-certs\") pod \"konnectivity-agent-lsjgw\" (UID: \"766a7aaf-d001-4c0b-ab1c-a1107f5921ec\") " pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysconfig\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysctl-conf\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-run\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/766a7aaf-d001-4c0b-ab1c-a1107f5921ec-konnectivity-ca\") pod \"konnectivity-agent-lsjgw\" (UID: \"766a7aaf-d001-4c0b-ab1c-a1107f5921ec\") " pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-hosts-file\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-lib-modules\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysctl-conf\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148376 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-sys\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.148414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-device-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-hosts-file\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-sys-fs\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-modprobe-d\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148497 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-device-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148487 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-sys-fs\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-host\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c744d9be-c396-4bde-aaf3-9dce4688e5ec-tmp\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2jk\" (UniqueName: \"kubernetes.io/projected/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-kube-api-access-sg2jk\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-host\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-socket-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94728ae5-352b-4526-a994-3fcde78a2135-iptables-alerter-script\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-modprobe-d\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.148793 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-kubernetes\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.149048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-kubernetes\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.148912 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:01.648891019 +0000 UTC m=+3.041630549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-systemd\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.148944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-systemd\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-var-lib-kubelet\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-socket-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-tmp-dir\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-var-lib-kubelet\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st72w\" (UniqueName: \"kubernetes.io/projected/5eea965d-a996-46f5-82de-28a232f8d0ad-kube-api-access-st72w\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysctl-d\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfdecac6-161c-4f42-8d9e-b42a74bfa964-dbus\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/766a7aaf-d001-4c0b-ab1c-a1107f5921ec-konnectivity-ca\") pod \"konnectivity-agent-lsjgw\" (UID: \"766a7aaf-d001-4c0b-ab1c-a1107f5921ec\") " pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfdecac6-161c-4f42-8d9e-b42a74bfa964-kubelet-config\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-tuned\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56vjf\" (UniqueName: \"kubernetes.io/projected/94728ae5-352b-4526-a994-3fcde78a2135-kube-api-access-56vjf\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfdecac6-161c-4f42-8d9e-b42a74bfa964-dbus\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-registration-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj86j\" (UniqueName: \"kubernetes.io/projected/c744d9be-c396-4bde-aaf3-9dce4688e5ec-kube-api-access-lj86j\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94728ae5-352b-4526-a994-3fcde78a2135-host-slash\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149396 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94728ae5-352b-4526-a994-3fcde78a2135-iptables-alerter-script\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-tmp-dir\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-sysctl-d\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94728ae5-352b-4526-a994-3fcde78a2135-host-slash\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-registration-dir\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfdecac6-161c-4f42-8d9e-b42a74bfa964-kubelet-config\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.150880 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.149651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eea965d-a996-46f5-82de-28a232f8d0ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.151438 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.151176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c744d9be-c396-4bde-aaf3-9dce4688e5ec-tmp\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.151651 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.151623 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c744d9be-c396-4bde-aaf3-9dce4688e5ec-etc-tuned\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.151953 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.151933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/766a7aaf-d001-4c0b-ab1c-a1107f5921ec-agent-certs\") pod \"konnectivity-agent-lsjgw\" (UID: \"766a7aaf-d001-4c0b-ab1c-a1107f5921ec\") " pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.156605 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.156535 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:01.156605 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.156563 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:01.156605 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.156581 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:01.156834 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.156649 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:01.656630292 +0000 UTC m=+3.049369816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:01.158136 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.158111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2jk\" (UniqueName: \"kubernetes.io/projected/c19cada6-cfc9-4684-aaa7-d6d3aef3fc60-kube-api-access-sg2jk\") pod \"node-resolver-vt6nr\" (UID: \"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60\") " pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.158430 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.158409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st72w\" (UniqueName: \"kubernetes.io/projected/5eea965d-a996-46f5-82de-28a232f8d0ad-kube-api-access-st72w\") pod \"aws-ebs-csi-driver-node-fch7p\" (UID: \"5eea965d-a996-46f5-82de-28a232f8d0ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.159587 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.159566 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56vjf\" (UniqueName: \"kubernetes.io/projected/94728ae5-352b-4526-a994-3fcde78a2135-kube-api-access-56vjf\") pod \"iptables-alerter-685vb\" (UID: \"94728ae5-352b-4526-a994-3fcde78a2135\") " pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.159799 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.159782 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj86j\" (UniqueName: \"kubernetes.io/projected/c744d9be-c396-4bde-aaf3-9dce4688e5ec-kube-api-access-lj86j\") pod \"tuned-fwd5x\" (UID: \"c744d9be-c396-4bde-aaf3-9dce4688e5ec\") " pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.238910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.238861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:01.245681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.245657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9fhj" Jul 20 19:15:01.257920 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.257881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9vxxb" Jul 20 19:15:01.265213 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.265176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" Jul 20 19:15:01.274377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.274353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-685vb" Jul 20 19:15:01.282633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.282610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:01.288646 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.288623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" Jul 20 19:15:01.296676 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.296649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" Jul 20 19:15:01.302745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.302716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vt6nr" Jul 20 19:15:01.314963 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.314931 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:01.554140 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.554047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:01.554320 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.554182 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:01.554320 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.554256 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:02.554236743 +0000 UTC m=+3.946976264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:01.654910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.654866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:01.655097 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.655051 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:01.655164 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.655151 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:02.655133679 +0000 UTC m=+4.047873192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:01.756254 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.756172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:01.756442 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.756392 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:01.756442 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.756425 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:01.756442 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.756440 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:01.756621 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:01.756546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:02.75650885 +0000 UTC m=+4.149248367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:01.851299 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.851193 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:15:01.979397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.979329 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:10:01 +0000 UTC" deadline="2028-01-14 00:04:48.856899936 +0000 UTC" Jul 20 19:15:01.979397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:01.979390 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13012h49m46.877513091s" Jul 20 19:15:02.179474 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.179435 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94728ae5_352b_4526_a994_3fcde78a2135.slice/crio-56b747ca52fa81943965e7546e80829e01af7f3392551087493a655d523c4e2d WatchSource:0}: Error finding container 56b747ca52fa81943965e7546e80829e01af7f3392551087493a655d523c4e2d: Status 404 returned error can't find the container with id 56b747ca52fa81943965e7546e80829e01af7f3392551087493a655d523c4e2d Jul 20 19:15:02.181291 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.181192 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b346a67_39ca_4cc2_9b1c_b40e7ea19540.slice/crio-f040d7ecde482d301664b01dedf1d8f9b88be36eac9d9a7cfd1b6e596c6a30a3 WatchSource:0}: Error finding container f040d7ecde482d301664b01dedf1d8f9b88be36eac9d9a7cfd1b6e596c6a30a3: Status 404 returned error can't find the container with id f040d7ecde482d301664b01dedf1d8f9b88be36eac9d9a7cfd1b6e596c6a30a3 Jul 20 19:15:02.182352 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.182324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eea965d_a996_46f5_82de_28a232f8d0ad.slice/crio-97ad5492b6783158d6a3cea291f2aa47de14e0523b3a53e5af45ad579ef3c0e6 WatchSource:0}: Error finding container 97ad5492b6783158d6a3cea291f2aa47de14e0523b3a53e5af45ad579ef3c0e6: Status 404 returned error can't find the container with id 97ad5492b6783158d6a3cea291f2aa47de14e0523b3a53e5af45ad579ef3c0e6 Jul 20 19:15:02.183728 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.183638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11200e60_7310_49fd_9bce_bd093517d357.slice/crio-98d9b20627dc8aeb284d9c8c8b4aea88a53a6e28072cead9b84b7eee2a2f3420 WatchSource:0}: Error finding container 98d9b20627dc8aeb284d9c8c8b4aea88a53a6e28072cead9b84b7eee2a2f3420: Status 404 returned error can't find the container with id 98d9b20627dc8aeb284d9c8c8b4aea88a53a6e28072cead9b84b7eee2a2f3420 Jul 20 19:15:02.186344 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.186318 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e401ed6_b6f5_444d_b724_532d696079c1.slice/crio-6179dfe9726a445c2572457edf6f803e74a159e9a43416b101ad058a8b72d71d WatchSource:0}: Error finding container 6179dfe9726a445c2572457edf6f803e74a159e9a43416b101ad058a8b72d71d: Status 404 returned error can't find the container with id 6179dfe9726a445c2572457edf6f803e74a159e9a43416b101ad058a8b72d71d Jul 20 19:15:02.210889 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.210850 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19cada6_cfc9_4684_aaa7_d6d3aef3fc60.slice/crio-98524bca70ff2072bef7049d7cd36ef68b071de380b3f39dd0f0f376fb589aa7 WatchSource:0}: Error finding container 98524bca70ff2072bef7049d7cd36ef68b071de380b3f39dd0f0f376fb589aa7: Status 404 returned error can't find the container with id 98524bca70ff2072bef7049d7cd36ef68b071de380b3f39dd0f0f376fb589aa7 Jul 20 19:15:02.211977 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.211948 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015476e6_0abe_4284_95a3_8454a66b916a.slice/crio-9ffe40381a122b275d99b842f99f764bc5fee5e922baf04c501a9f241e004877 WatchSource:0}: Error finding container 9ffe40381a122b275d99b842f99f764bc5fee5e922baf04c501a9f241e004877: Status 404 returned error can't find the container with id 9ffe40381a122b275d99b842f99f764bc5fee5e922baf04c501a9f241e004877 Jul 20 19:15:02.212873 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.212849 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc744d9be_c396_4bde_aaf3_9dce4688e5ec.slice/crio-e260ff81e85cb6e454e113937e1099cfab6cef1f974e83fcb93143721800fcc6 WatchSource:0}: Error finding container e260ff81e85cb6e454e113937e1099cfab6cef1f974e83fcb93143721800fcc6: Status 404 returned error can't find the container with id e260ff81e85cb6e454e113937e1099cfab6cef1f974e83fcb93143721800fcc6 Jul 20 19:15:02.214980 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:02.214955 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766a7aaf_d001_4c0b_ab1c_a1107f5921ec.slice/crio-97d0ad8afc6fbf326e8532f4b6886b5087beeee48b5e93a60a9ebb974824984f WatchSource:0}: Error finding container 97d0ad8afc6fbf326e8532f4b6886b5087beeee48b5e93a60a9ebb974824984f: Status 404 returned error can't find the container with id 97d0ad8afc6fbf326e8532f4b6886b5087beeee48b5e93a60a9ebb974824984f Jul 20 19:15:02.564198 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:02.563984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:02.564354 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.564145 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:02.564354 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.564342 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:04.564320709 +0000 UTC m=+5.957060240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:02.664665 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:02.664626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:02.664828 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.664778 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:02.664901 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.664841 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:04.66482413 +0000 UTC m=+6.057563652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:02.765709 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:02.765611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:02.765843 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.765759 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:02.765843 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.765773 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:02.765843 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.765783 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:02.765843 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:02.765837 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:04.765822887 +0000 UTC m=+6.158562399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:02.980637 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:02.980558 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:10:01 +0000 UTC" deadline="2028-01-03 19:11:14.587944416 +0000 UTC" Jul 20 19:15:02.980637 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:02.980630 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12767h56m11.607319049s" Jul 20 19:15:03.041264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.037783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:03.041264 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:03.037922 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:03.041264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.038368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:03.041264 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:03.038491 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:03.041264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.038560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:03.041264 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:03.038662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:03.053285 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.053243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsjgw" event={"ID":"766a7aaf-d001-4c0b-ab1c-a1107f5921ec","Type":"ContainerStarted","Data":"97d0ad8afc6fbf326e8532f4b6886b5087beeee48b5e93a60a9ebb974824984f"} Jul 20 19:15:03.054912 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.054831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9vxxb" event={"ID":"6b346a67-39ca-4cc2-9b1c-b40e7ea19540","Type":"ContainerStarted","Data":"f040d7ecde482d301664b01dedf1d8f9b88be36eac9d9a7cfd1b6e596c6a30a3"} Jul 20 19:15:03.056300 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.056244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-685vb" event={"ID":"94728ae5-352b-4526-a994-3fcde78a2135","Type":"ContainerStarted","Data":"56b747ca52fa81943965e7546e80829e01af7f3392551087493a655d523c4e2d"} Jul 20 19:15:03.060890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.060841 2576 generic.go:356] "Generic (PLEG): container finished" podID="18ccd5778a6add9aa48fb07f3ce65790" containerID="1790c3d2beccecbf2c22afa17da3c55f99a9a3291ba9d50cc63e95b76f25eccc" exitCode=0 Jul 20 19:15:03.061004 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.060941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" event={"ID":"18ccd5778a6add9aa48fb07f3ce65790","Type":"ContainerDied","Data":"1790c3d2beccecbf2c22afa17da3c55f99a9a3291ba9d50cc63e95b76f25eccc"} Jul 20 19:15:03.064352 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.064320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" event={"ID":"b50cf1cf50a6e5e2eb27256335c2c144","Type":"ContainerStarted","Data":"116155ce0097f1fdc048f06a5ecccd34572d1c4caf092c5753ab90dbedf14507"} Jul 20 19:15:03.067202 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.067050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" event={"ID":"c744d9be-c396-4bde-aaf3-9dce4688e5ec","Type":"ContainerStarted","Data":"e260ff81e85cb6e454e113937e1099cfab6cef1f974e83fcb93143721800fcc6"} Jul 20 19:15:03.069507 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.069480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"9ffe40381a122b275d99b842f99f764bc5fee5e922baf04c501a9f241e004877"} Jul 20 19:15:03.071293 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.071268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vt6nr" event={"ID":"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60","Type":"ContainerStarted","Data":"98524bca70ff2072bef7049d7cd36ef68b071de380b3f39dd0f0f376fb589aa7"} Jul 20 19:15:03.072826 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.072802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9fhj" event={"ID":"0e401ed6-b6f5-444d-b724-532d696079c1","Type":"ContainerStarted","Data":"6179dfe9726a445c2572457edf6f803e74a159e9a43416b101ad058a8b72d71d"} Jul 20 19:15:03.074434 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.074376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerStarted","Data":"98d9b20627dc8aeb284d9c8c8b4aea88a53a6e28072cead9b84b7eee2a2f3420"} Jul 20 19:15:03.077213 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:03.077175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" event={"ID":"5eea965d-a996-46f5-82de-28a232f8d0ad","Type":"ContainerStarted","Data":"97ad5492b6783158d6a3cea291f2aa47de14e0523b3a53e5af45ad579ef3c0e6"} Jul 20 19:15:04.112329 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:04.111870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" event={"ID":"18ccd5778a6add9aa48fb07f3ce65790","Type":"ContainerStarted","Data":"1f26698a8448cb2fb1f63466f09a25e9b1d7e07aac837cea2f392c63f9107330"} Jul 20 19:15:04.130751 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:04.130688 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-142.ec2.internal" podStartSLOduration=4.130667912 podStartE2EDuration="4.130667912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:03.095388286 +0000 UTC m=+4.488127823" watchObservedRunningTime="2026-07-20 19:15:04.130667912 +0000 UTC m=+5.523407446" Jul 20 19:15:04.131254 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:04.131213 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-142.ec2.internal" podStartSLOduration=4.13120113 podStartE2EDuration="4.13120113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:04.130080468 +0000 UTC m=+5.522820003" watchObservedRunningTime="2026-07-20 19:15:04.13120113 +0000 UTC m=+5.523940658" Jul 20 19:15:04.579762 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:04.579570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:04.579938 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.579769 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:04.579938 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.579851 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:08.579828942 +0000 UTC m=+9.972568467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:04.680228 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:04.680137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:04.680409 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.680302 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:04.680409 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.680367 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:08.680348896 +0000 UTC m=+10.073088421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:04.780805 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:04.780704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:04.780987 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.780883 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:04.780987 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.780907 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:04.780987 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.780920 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:04.780987 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:04.780985 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:08.780964321 +0000 UTC m=+10.173703846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:05.042267 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:05.041315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:05.042267 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:05.041448 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:05.042267 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:05.041888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:05.042267 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:05.041995 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:05.042267 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:05.042067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:05.042267 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:05.042141 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:07.035846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:07.035788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:07.036593 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:07.035946 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:07.036593 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:07.036083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:07.036593 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:07.036174 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:07.036593 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:07.036200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:07.036593 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:07.036268 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:08.616476 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:08.616429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:08.616917 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.616632 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:08.616917 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.616715 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:16.61669313 +0000 UTC m=+18.009432654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:08.717554 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:08.717521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:08.717749 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.717671 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:08.717749 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.717745 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:16.71772378 +0000 UTC m=+18.110463328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:08.818346 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:08.818265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:08.818570 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.818444 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:08.818570 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.818470 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:08.818570 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.818484 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:08.818570 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:08.818569 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:16.818548375 +0000 UTC m=+18.211287889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:09.041158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:09.040667 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:09.041158 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:09.040817 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:09.041158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:09.040909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:09.041158 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:09.041018 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:09.041158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:09.041043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:09.041158 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:09.041153 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:11.036861 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:11.036369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:11.036861 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:11.036407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:11.036861 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:11.036540 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:11.037432 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:11.036949 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:11.037432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:11.037002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:11.037432 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:11.037077 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:13.036068 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:13.036023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:13.036529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:13.036025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:13.036529 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:13.036157 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:13.036529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:13.036024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:13.036529 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:13.036245 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:13.036529 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:13.036283 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:15.036090 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:15.036052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:15.036552 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:15.036218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:15.036552 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:15.036217 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:15.036552 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:15.036342 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:15.036552 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:15.036401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:15.036552 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:15.036484 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:16.683450 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:16.683396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:16.683841 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.683558 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:16.683841 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.683628 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:32.683612173 +0000 UTC m=+34.076351685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:16.784483 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:16.784440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:16.784670 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.784605 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:16.784727 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.784682 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:32.784662984 +0000 UTC m=+34.177402508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:16.885035 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:16.884935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:16.885198 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.885147 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:16.885198 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.885171 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:16.885198 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.885183 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:16.885344 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:16.885253 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:32.885231722 +0000 UTC m=+34.277971236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:17.035893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:17.035852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:17.036070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:17.035861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:17.036070 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:17.035992 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:17.036162 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:17.035875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:17.036162 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:17.036093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:17.036256 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:17.036199 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:19.037216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:19.036783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:19.037216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:19.036884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:19.037216 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:19.036901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:19.037216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:19.036927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:19.037216 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:19.037024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:19.037216 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:19.037134 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:21.036926 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:21.036887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:21.036926 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:21.036916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:21.037396 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:21.036900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:21.037396 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:21.037020 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:21.037396 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:21.037096 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:21.037396 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:21.037197 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:22.157087 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.156649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" event={"ID":"c744d9be-c396-4bde-aaf3-9dce4688e5ec","Type":"ContainerStarted","Data":"4d14b7fb32e166e332cbb7cfc60294b9d8fbb19b15733a4480ce58af0e6f3487"} Jul 20 19:15:22.159411 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159392 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:15:22.159743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159723 2576 generic.go:356] "Generic (PLEG): container finished" podID="015476e6-0abe-4284-95a3-8454a66b916a" containerID="e00c165d55f04010adec4906aa5f8d906e6df182522b9de4a059f5ea44eaa8bc" exitCode=1 Jul 20 19:15:22.159813 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"62344a04cbc38cd5371cf29a392dc79d39584fbdacc5250eb14e91c4e8044b1b"} Jul 20 19:15:22.159884 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"9fb0044ce05d6b452b1a56d801e4985b35168eaa0db981517521f0ddd08c9421"} Jul 20 19:15:22.159921 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"56553b9f03879e5f1d0d884d251af5f74d86d6fc9b81207689752a6c41e51502"} Jul 20 19:15:22.159960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"cee2367f6758872fccde4de70516e001a016a9cc9a58d7c509815a1de1b45428"} Jul 20 19:15:22.160010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.159976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerDied","Data":"e00c165d55f04010adec4906aa5f8d906e6df182522b9de4a059f5ea44eaa8bc"} Jul 20 19:15:22.160056 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.160013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"cec3eafe7cdb4bb14fd4d098d1e25b4ade588fb63d3287813428a271ffc15509"} Jul 20 19:15:22.161190 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.161159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vt6nr" event={"ID":"c19cada6-cfc9-4684-aaa7-d6d3aef3fc60","Type":"ContainerStarted","Data":"db83fd9ffab4057d795fed1832366babd163bb25beb06e7f9fa17adbdd2e44a0"} Jul 20 19:15:22.162525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.162488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9fhj" event={"ID":"0e401ed6-b6f5-444d-b724-532d696079c1","Type":"ContainerStarted","Data":"6481ef05ad1a6e8832b3d0f91545c5e22d0750774b7d152241107898c5e00f5d"} Jul 20 19:15:22.163921 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.163902 2576 generic.go:356] "Generic (PLEG): container finished" podID="11200e60-7310-49fd-9bce-bd093517d357" containerID="12933c3fae2ab6f232c8fee2fe47e42c90e8c1d14e47d58d4b29e085a3e2815c" exitCode=0 Jul 20 19:15:22.164028 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.163986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerDied","Data":"12933c3fae2ab6f232c8fee2fe47e42c90e8c1d14e47d58d4b29e085a3e2815c"} Jul 20 19:15:22.165439 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.165401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" event={"ID":"5eea965d-a996-46f5-82de-28a232f8d0ad","Type":"ContainerStarted","Data":"cea9e96ba67dfd378b5a8c7613bdf50ce5b5dff326e5159250fd874f9ff714ab"} Jul 20 19:15:22.166738 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.166717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsjgw" event={"ID":"766a7aaf-d001-4c0b-ab1c-a1107f5921ec","Type":"ContainerStarted","Data":"dcb9221b547dbcadfe5fb249235f72461cf6181334ec48afc6bcd282c072cb33"} Jul 20 19:15:22.168190 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.168169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9vxxb" event={"ID":"6b346a67-39ca-4cc2-9b1c-b40e7ea19540","Type":"ContainerStarted","Data":"78ad104f6bb6bdbd6c47c2f8ba86840c96df2fd9acce30c6781aef4322a2e90b"} Jul 20 19:15:22.176117 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.176078 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fwd5x" podStartSLOduration=4.41995879 podStartE2EDuration="23.176065794s" totalImagesPullingTime="18.756107004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:22.175578114 +0000 UTC m=+23.568317647" watchObservedRunningTime="2026-07-20 19:15:22.176065794 +0000 UTC m=+23.568805330" Jul 20 19:15:22.197346 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.197299 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lsjgw" podStartSLOduration=4.4413077340000005 podStartE2EDuration="23.197282665s" totalImagesPullingTime="18.755974931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:22.197120732 +0000 UTC m=+23.589860265" watchObservedRunningTime="2026-07-20 19:15:22.197282665 +0000 UTC m=+23.590022199" Jul 20 19:15:22.213097 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.213049 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vt6nr" podStartSLOduration=4.4519833779999995 podStartE2EDuration="23.213035229s" totalImagesPullingTime="18.761051851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:22.212574401 +0000 UTC m=+23.605313933" watchObservedRunningTime="2026-07-20 19:15:22.213035229 +0000 UTC m=+23.605774762" Jul 20 19:15:22.243825 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.243769 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9vxxb" podStartSLOduration=4.399517223 podStartE2EDuration="23.24375315s" totalImagesPullingTime="18.844235927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:22.243723676 +0000 UTC m=+23.636463208" watchObservedRunningTime="2026-07-20 19:15:22.24375315 +0000 UTC m=+23.636492682" Jul 20 19:15:22.244268 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.244244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k9fhj" podStartSLOduration=4.479566819 podStartE2EDuration="23.24423528s" totalImagesPullingTime="18.764668461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:22.226708389 +0000 UTC m=+23.619447922" watchObservedRunningTime="2026-07-20 19:15:22.24423528 +0000 UTC m=+23.636974813" Jul 20 19:15:22.588092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:22.588055 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 19:15:23.021730 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.021572 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:15:22.588084987Z","UUID":"38eedfb8-7cbd-48e3-8cff-672e7dedda2a","Handler":null,"Name":"","Endpoint":""} Jul 20 19:15:23.023326 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.023305 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 19:15:23.023453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.023342 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 19:15:23.036091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.036064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:23.036241 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.036092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:23.036241 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.036064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:23.036241 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:23.036195 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:23.036407 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:23.036285 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:23.036407 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:23.036382 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:23.173450 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.173420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" event={"ID":"5eea965d-a996-46f5-82de-28a232f8d0ad","Type":"ContainerStarted","Data":"704025cdb03f60cd980792e148ab1325469f1e5fc13597aa82e24f1d3732eafc"} Jul 20 19:15:23.175472 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.175438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-685vb" event={"ID":"94728ae5-352b-4526-a994-3fcde78a2135","Type":"ContainerStarted","Data":"3c1575527b4898e5d34fb7c8d11b22cca857b69055e5f0f98e41ea9753ee0026"} Jul 20 19:15:23.195745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.195671 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-685vb" podStartSLOduration=5.386193377 podStartE2EDuration="24.195650062s" totalImagesPullingTime="18.809456685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:23.194699896 +0000 UTC m=+24.587439430" watchObservedRunningTime="2026-07-20 19:15:23.195650062 +0000 UTC m=+24.588389600" Jul 20 19:15:23.426049 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:23.426006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:24.181416 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:24.181335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:15:24.181859 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:24.181834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"811849081e69fa28c171a1fa7e0c4af60001b2d2bb262b3c59776ca6bcba97ed"} Jul 20 19:15:24.184639 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:24.184611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" event={"ID":"5eea965d-a996-46f5-82de-28a232f8d0ad","Type":"ContainerStarted","Data":"468dfc42d8fd0cbd10a03d402a2324ac74fff0052c8f71caaa3a8fd6d8180701"} Jul 20 19:15:24.203591 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:24.203525 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fch7p" podStartSLOduration=4.290221185 podStartE2EDuration="25.203502297s" totalImagesPullingTime="20.913281112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:24.203429458 +0000 UTC m=+25.596168989" watchObservedRunningTime="2026-07-20 19:15:24.203502297 +0000 UTC m=+25.596241824" Jul 20 19:15:25.036141 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:25.035958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:25.036304 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:25.036237 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:25.036304 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:25.035958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:25.036433 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:25.036334 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:25.036433 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:25.035958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:25.036433 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:25.036413 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:26.506428 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:26.506392 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:26.507036 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:26.507016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:27.036334 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.036142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:27.036334 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.036147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:27.036334 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:27.036274 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:27.036334 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.036148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:27.036712 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:27.036357 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:27.036712 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:27.036417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:27.195325 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.195157 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:15:27.195799 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.195769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"6a60b411efc8727891596e7c8feb1b9253b525099e445b7cb7a6af3260bf141e"} Jul 20 19:15:27.196069 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.196050 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:27.196254 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.196236 2576 scope.go:117] "RemoveContainer" containerID="e00c165d55f04010adec4906aa5f8d906e6df182522b9de4a059f5ea44eaa8bc" Jul 20 19:15:27.198105 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.198078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerStarted","Data":"f66b86efbf5e3c2dc165dda72bbf797a9725ea191eb9b07c62722ad52a2ae76d"} Jul 20 19:15:27.198996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.198972 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lsjgw" Jul 20 19:15:27.212629 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.212598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:27.707571 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:27.707442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:28.205848 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.205819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:15:28.206346 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.206313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" event={"ID":"015476e6-0abe-4284-95a3-8454a66b916a","Type":"ContainerStarted","Data":"670d7c650a3b8f1d5a11b0754d454393d5b4dcedac30e09a586083c7f1eca62e"} Jul 20 19:15:28.206522 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.206484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:28.208450 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.208427 2576 generic.go:356] "Generic (PLEG): container finished" podID="11200e60-7310-49fd-9bce-bd093517d357" containerID="f66b86efbf5e3c2dc165dda72bbf797a9725ea191eb9b07c62722ad52a2ae76d" exitCode=0 Jul 20 19:15:28.208625 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.208478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerDied","Data":"f66b86efbf5e3c2dc165dda72bbf797a9725ea191eb9b07c62722ad52a2ae76d"} Jul 20 19:15:28.223081 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.223057 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:15:28.261765 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:28.261710 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" podStartSLOduration=10.32248062 podStartE2EDuration="29.261692397s" totalImagesPullingTime="18.939211777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:28.236596659 +0000 UTC m=+29.629336194" watchObservedRunningTime="2026-07-20 19:15:28.261692397 +0000 UTC m=+29.654431930" Jul 20 19:15:29.037225 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.037195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:29.037594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.037292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:29.037594 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:29.037315 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:29.037594 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.037396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:29.037594 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:29.037453 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:29.037594 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:29.037482 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:29.053242 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.053213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5mn9d"] Jul 20 19:15:29.056672 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.056635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzv2j"] Jul 20 19:15:29.057461 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.057438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f42sp"] Jul 20 19:15:29.212603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.212520 2576 generic.go:356] "Generic (PLEG): container finished" podID="11200e60-7310-49fd-9bce-bd093517d357" containerID="929e3b82ac98f5b407ab80fdd0cfb59562a4f60a7046dd6c67e1e52c2a5d10a7" exitCode=0 Jul 20 19:15:29.212743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.212609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:29.212743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.212626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:29.212743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.212634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:29.212743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:29.212602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerDied","Data":"929e3b82ac98f5b407ab80fdd0cfb59562a4f60a7046dd6c67e1e52c2a5d10a7"} Jul 20 19:15:29.212743 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:29.212720 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:29.212913 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:29.212785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:29.213265 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:29.213238 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:30.217926 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:30.217894 2576 generic.go:356] "Generic (PLEG): container finished" podID="11200e60-7310-49fd-9bce-bd093517d357" containerID="e8a5f53c61fdd42bbd83cca16f6e58f50fc610dd512948b3030b17603a6048df" exitCode=0 Jul 20 19:15:30.218301 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:30.217978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerDied","Data":"e8a5f53c61fdd42bbd83cca16f6e58f50fc610dd512948b3030b17603a6048df"} Jul 20 19:15:31.036735 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:31.036698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:31.036908 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:31.036699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:31.036908 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:31.036831 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:31.037018 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:31.036929 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:31.037018 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:31.036699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:31.037107 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:31.037047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:32.707705 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:32.707463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:32.708226 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.707640 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:32.708226 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.707823 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs podName:64e93309-65de-4877-8a56-6eaa173f2fd5 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:04.707805549 +0000 UTC m=+66.100545083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs") pod "network-metrics-daemon-hzv2j" (UID: "64e93309-65de-4877-8a56-6eaa173f2fd5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:15:32.808540 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:32.808486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:32.808726 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.808684 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:32.808783 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.808773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret podName:cfdecac6-161c-4f42-8d9e-b42a74bfa964 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:04.808755926 +0000 UTC m=+66.201495437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret") pod "global-pull-secret-syncer-f42sp" (UID: "cfdecac6-161c-4f42-8d9e-b42a74bfa964") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:15:32.909775 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:32.909742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:32.909931 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.909896 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:15:32.909931 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.909914 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:15:32.909931 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.909926 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rtdtd for pod openshift-network-diagnostics/network-check-target-5mn9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:32.910031 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:32.909975 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd podName:91f80156-61b9-49dc-aa0d-2378fbdb7b4b nodeName:}" failed. No retries permitted until 2026-07-20 19:16:04.909960941 +0000 UTC m=+66.302700455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtdtd" (UniqueName: "kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd") pod "network-check-target-5mn9d" (UID: "91f80156-61b9-49dc-aa0d-2378fbdb7b4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:15:33.036697 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:33.036666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:33.036847 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:33.036701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:33.036847 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:33.036702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:33.036847 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:33.036798 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f42sp" podUID="cfdecac6-161c-4f42-8d9e-b42a74bfa964" Jul 20 19:15:33.037004 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:33.036926 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzv2j" podUID="64e93309-65de-4877-8a56-6eaa173f2fd5" Jul 20 19:15:33.037043 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:33.037002 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5mn9d" podUID="91f80156-61b9-49dc-aa0d-2378fbdb7b4b" Jul 20 19:15:34.833906 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.833881 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-142.ec2.internal" event="NodeReady" Jul 20 19:15:34.834368 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.834060 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 19:15:34.887472 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.887435 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-855ff7bd88-rlqr7"] Jul 20 19:15:34.892025 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.891999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:34.896557 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.896532 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 19:15:34.896775 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.896755 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 19:15:34.896863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.896779 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f54s5\"" Jul 20 19:15:34.896863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.896807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 19:15:34.902467 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.902445 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8"] Jul 20 19:15:34.905891 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.905869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" Jul 20 19:15:34.927110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.924161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.927110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.924365 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6wgrx\"" Jul 20 19:15:34.927110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.924560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.927110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.924589 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j"] Jul 20 19:15:34.927110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.926276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 19:15:34.928630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.928605 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-7v9v8"] Jul 20 19:15:34.928754 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.928731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:34.931774 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.931739 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j"] Jul 20 19:15:34.932289 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.931947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:34.933226 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.933200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 19:15:34.933333 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.933249 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.933583 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.933561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gl96l\"" Jul 20 19:15:34.933670 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.933590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.935054 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.935034 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 19:15:34.935340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.935313 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-nbklj"] Jul 20 19:15:34.935570 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.935554 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:34.938805 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.938778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4"] Jul 20 19:15:34.939002 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.938901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:34.940954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.940936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m78hk\"" Jul 20 19:15:34.941772 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.941345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.941772 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.941372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.941772 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.941626 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 19:15:34.941772 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.941770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 19:15:34.942351 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.942208 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw"] Jul 20 19:15:34.942351 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.942242 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.942515 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.942404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 19:15:34.942581 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.942525 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 19:15:34.943366 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.942736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.943366 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.942766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nzscg\"" Jul 20 19:15:34.943366 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.943040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:34.946554 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.946512 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67666785d-tmfb4"] Jul 20 19:15:34.946684 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.946663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:34.947820 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.947798 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 19:15:34.948055 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.948031 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 19:15:34.948232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.948212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.949768 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.949747 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 19:15:34.950040 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950021 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.950117 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950062 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cm6sk\"" Jul 20 19:15:34.950117 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 19:15:34.950363 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950306 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.950548 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950527 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv"] Jul 20 19:15:34.950659 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950557 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.950659 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-skgs6\"" Jul 20 19:15:34.950770 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.950662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:34.951477 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.951453 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 19:15:34.951583 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.951531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 19:15:34.951644 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.951617 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fr4c8\"" Jul 20 19:15:34.951699 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.951678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.952015 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.951996 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954268 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-855ff7bd88-rlqr7"] Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j"] Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954352 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw"] Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954386 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-7v9v8"] Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8"] Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j"] Jul 20 19:15:34.955561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.954709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:34.955896 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.955829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 19:15:34.956319 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.956286 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 19:15:34.956432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.956414 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.957720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.957701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 19:15:34.960159 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.960294 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960158 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f2h7h\"" Jul 20 19:15:34.960369 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k7dt9\"" Jul 20 19:15:34.960425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960371 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 19:15:34.960425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960388 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 19:15:34.960561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 19:15:34.960660 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.960638 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 19:15:34.972037 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.972014 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4pklv"] Jul 20 19:15:34.976576 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.976551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:34.976936 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.976912 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86"] Jul 20 19:15:34.981861 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.981834 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67666785d-tmfb4"] Jul 20 19:15:34.982328 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.981879 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9x2jc"] Jul 20 19:15:34.982328 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.982000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" Jul 20 19:15:34.983509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.983472 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 19:15:34.985399 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.985374 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv"] Jul 20 19:15:34.985598 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.985583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4"] Jul 20 19:15:34.985824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.985808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-nbklj"] Jul 20 19:15:34.985911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.985593 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 19:15:34.986077 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.985664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:34.987158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.987141 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bcdr2\"" Jul 20 19:15:34.987400 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.987379 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.988785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.988764 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.988892 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.988816 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-b58qt\"" Jul 20 19:15:34.990745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.990728 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 19:15:34.995704 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.995686 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 19:15:34.995969 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.995947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 19:15:34.996163 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.996140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tf5d7\"" Jul 20 19:15:34.999039 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:34.999016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86"] Jul 20 19:15:35.021979 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.021957 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9x2jc"] Jul 20 19:15:35.025140 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-certificates\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.025365 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-974wt\" (UniqueName: \"kubernetes.io/projected/46bac223-834d-4105-a8e3-6995bf22f54a-kube-api-access-974wt\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.025526 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.025646 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.025753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94e73046-a9fb-41b6-9fbe-ec99a835d9de-config\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.025753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:35.025753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-tmp\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.025920 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46bac223-834d-4105-a8e3-6995bf22f54a-trusted-ca\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.025920 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/801b5600-1508-4ce9-a43e-14782c1d9816-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.025920 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-ca-trust-extracted\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.026063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hzl\" (UniqueName: \"kubernetes.io/projected/67508af8-bfeb-4a8b-a310-41b9a699c485-kube-api-access-99hzl\") pod \"volume-data-source-validator-78cf4c6f6-vlck8\" (UID: \"67508af8-bfeb-4a8b-a310-41b9a699c485\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" Jul 20 19:15:35.026063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46bac223-834d-4105-a8e3-6995bf22f54a-serving-cert\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.026063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.025996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6x8\" (UniqueName: \"kubernetes.io/projected/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-kube-api-access-pb6x8\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.026063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-trusted-ca\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.026249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9gv\" (UniqueName: \"kubernetes.io/projected/a6a2be6c-ef39-4768-9268-baa9f975d399-kube-api-access-tv9gv\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:35.026249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99xwr\" (UniqueName: \"kubernetes.io/projected/801b5600-1508-4ce9-a43e-14782c1d9816-kube-api-access-99xwr\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.026249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab796ac5-7859-498b-8d63-77b7d22ef77b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.026249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46bac223-834d-4105-a8e3-6995bf22f54a-config\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.026249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/801b5600-1508-4ce9-a43e-14782c1d9816-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.026516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-installation-pull-secrets\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.026516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5vqm\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-kube-api-access-w5vqm\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.026516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-service-ca-bundle\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.026516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-serving-cert\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.026516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.026516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8z5p\" (UniqueName: \"kubernetes.io/projected/ab796ac5-7859-498b-8d63-77b7d22ef77b-kube-api-access-k8z5p\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.026807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94e73046-a9fb-41b6-9fbe-ec99a835d9de-serving-cert\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.026807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9trh\" (UniqueName: \"kubernetes.io/projected/94e73046-a9fb-41b6-9fbe-ec99a835d9de-kube-api-access-h9trh\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.026807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-image-registry-private-configuration\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.026807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-bound-sa-token\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.026960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.026843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-snapshots\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.027102 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.027082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4pklv"] Jul 20 19:15:35.036162 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.036141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:15:35.036290 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.036161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:15:35.036395 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.036360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:15:35.039224 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.039194 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:15:35.041222 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.041203 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:15:35.041477 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.041452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nkhbx\"" Jul 20 19:15:35.041603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.041566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxxp2\"" Jul 20 19:15:35.127259 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxdp\" (UniqueName: \"kubernetes.io/projected/bb1599ee-7c95-4b17-8f06-126ae0a6794c-kube-api-access-dnxdp\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.127443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8mn7\" (UniqueName: \"kubernetes.io/projected/63cc0837-109f-4521-a91f-a795796bc8ab-kube-api-access-x8mn7\") pod \"ingress-canary-9x2jc\" (UID: \"63cc0837-109f-4521-a91f-a795796bc8ab\") " pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.127443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46bac223-834d-4105-a8e3-6995bf22f54a-trusted-ca\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.127443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.127443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/801b5600-1508-4ce9-a43e-14782c1d9816-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.127443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqqxj\" (UniqueName: \"kubernetes.io/projected/8218dc0c-366a-408a-8f03-e8ba65854acd-kube-api-access-mqqxj\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.127712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-ca-trust-extracted\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.127712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99hzl\" (UniqueName: \"kubernetes.io/projected/67508af8-bfeb-4a8b-a310-41b9a699c485-kube-api-access-99hzl\") pod \"volume-data-source-validator-78cf4c6f6-vlck8\" (UID: \"67508af8-bfeb-4a8b-a310-41b9a699c485\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" Jul 20 19:15:35.127712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46bac223-834d-4105-a8e3-6995bf22f54a-serving-cert\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.127712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6x8\" (UniqueName: \"kubernetes.io/projected/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-kube-api-access-pb6x8\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.127712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-trusted-ca\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.127712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-stats-auth\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.128056 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9gv\" (UniqueName: \"kubernetes.io/projected/a6a2be6c-ef39-4768-9268-baa9f975d399-kube-api-access-tv9gv\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:35.128056 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99xwr\" (UniqueName: \"kubernetes.io/projected/801b5600-1508-4ce9-a43e-14782c1d9816-kube-api-access-99xwr\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.128056 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.127904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-ca-trust-extracted\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.128299 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab796ac5-7859-498b-8d63-77b7d22ef77b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.128374 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.128374 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46bac223-834d-4105-a8e3-6995bf22f54a-config\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.128438 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/801b5600-1508-4ce9-a43e-14782c1d9816-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.128438 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-installation-pull-secrets\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.128556 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5vqm\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-kube-api-access-w5vqm\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.128556 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-service-ca-bundle\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.128556 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-serving-cert\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.128706 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46bac223-834d-4105-a8e3-6995bf22f54a-trusted-ca\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.128852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-trusted-ca\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129187 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46bac223-834d-4105-a8e3-6995bf22f54a-config\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8218dc0c-366a-408a-8f03-e8ba65854acd-tmp-dir\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-default-certificate\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129314 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab796ac5-7859-498b-8d63-77b7d22ef77b-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8z5p\" (UniqueName: \"kubernetes.io/projected/ab796ac5-7859-498b-8d63-77b7d22ef77b-kube-api-access-k8z5p\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-service-ca-bundle\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94e73046-a9fb-41b6-9fbe-ec99a835d9de-serving-cert\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.129451 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129406 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/801b5600-1508-4ce9-a43e-14782c1d9816-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.129461 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9trh\" (UniqueName: \"kubernetes.io/projected/94e73046-a9fb-41b6-9fbe-ec99a835d9de-kube-api-access-h9trh\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.129610 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls podName:ab796ac5-7859-498b-8d63-77b7d22ef77b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.629589452 +0000 UTC m=+37.022328979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kj92j" (UID: "ab796ac5-7859-498b-8d63-77b7d22ef77b") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-image-registry-private-configuration\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-bound-sa-token\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-snapshots\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-certificates\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.129962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-974wt\" (UniqueName: \"kubernetes.io/projected/46bac223-834d-4105-a8e3-6995bf22f54a-kube-api-access-974wt\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.130010 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2497bd4-1c12-43c7-bc13-fde3b53402ce-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94e73046-a9fb-41b6-9fbe-ec99a835d9de-config\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63cc0837-109f-4521-a91f-a795796bc8ab-cert\") pod \"ingress-canary-9x2jc\" (UID: \"63cc0837-109f-4521-a91f-a795796bc8ab\") " pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-tmp\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54s5q\" (UniqueName: \"kubernetes.io/projected/1c627091-ad1f-4028-80a7-99f53e14e663-kube-api-access-54s5q\") pod \"network-check-source-7bc5b6bf85-46n86\" (UID: \"1c627091-ad1f-4028-80a7-99f53e14e663\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" Jul 20 19:15:35.130436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.130377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8218dc0c-366a-408a-8f03-e8ba65854acd-config-volume\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.130951 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.130856 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:15:35.130951 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.130871 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855ff7bd88-rlqr7: secret "image-registry-tls" not found Jul 20 19:15:35.130951 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.130927 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls podName:a91a2559-0a1e-449b-bf8f-a5ba0e5310d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.630911426 +0000 UTC m=+37.023650938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls") pod "image-registry-855ff7bd88-rlqr7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7") : secret "image-registry-tls" not found Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.131414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-snapshots\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.131415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94e73046-a9fb-41b6-9fbe-ec99a835d9de-config\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.131743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-tmp\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.131760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.131841 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.131907 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls podName:a6a2be6c-ef39-4768-9268-baa9f975d399 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.631890967 +0000 UTC m=+37.024630479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fwlc4" (UID: "a6a2be6c-ef39-4768-9268-baa9f975d399") : secret "samples-operator-tls" not found Jul 20 19:15:35.131939 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.131915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-certificates\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.133102 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.133065 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46bac223-834d-4105-a8e3-6995bf22f54a-serving-cert\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.133102 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.133085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-serving-cert\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.133759 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.133713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/801b5600-1508-4ce9-a43e-14782c1d9816-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.133915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.133895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94e73046-a9fb-41b6-9fbe-ec99a835d9de-serving-cert\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.134176 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.134155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-image-registry-private-configuration\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.134374 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.134358 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-installation-pull-secrets\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.142752 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.142703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6x8\" (UniqueName: \"kubernetes.io/projected/4b5f0e17-cd8d-4010-9fd8-dc332e2f7096-kube-api-access-pb6x8\") pod \"insights-operator-555d9d7885-nbklj\" (UID: \"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096\") " pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.145519 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.145479 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9gv\" (UniqueName: \"kubernetes.io/projected/a6a2be6c-ef39-4768-9268-baa9f975d399-kube-api-access-tv9gv\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:35.145759 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.145710 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9trh\" (UniqueName: \"kubernetes.io/projected/94e73046-a9fb-41b6-9fbe-ec99a835d9de-kube-api-access-h9trh\") pod \"service-ca-operator-5bcbc94c78-htm7j\" (UID: \"94e73046-a9fb-41b6-9fbe-ec99a835d9de\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.147064 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.147037 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-974wt\" (UniqueName: \"kubernetes.io/projected/46bac223-834d-4105-a8e3-6995bf22f54a-kube-api-access-974wt\") pod \"console-operator-565b7b569d-7v9v8\" (UID: \"46bac223-834d-4105-a8e3-6995bf22f54a\") " pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.147487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.147446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5vqm\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-kube-api-access-w5vqm\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.148103 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.148056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8z5p\" (UniqueName: \"kubernetes.io/projected/ab796ac5-7859-498b-8d63-77b7d22ef77b-kube-api-access-k8z5p\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.148415 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.148394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99xwr\" (UniqueName: \"kubernetes.io/projected/801b5600-1508-4ce9-a43e-14782c1d9816-kube-api-access-99xwr\") pod \"kube-storage-version-migrator-operator-7658d9b749-pr9rw\" (UID: \"801b5600-1508-4ce9-a43e-14782c1d9816\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.148618 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.148591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hzl\" (UniqueName: \"kubernetes.io/projected/67508af8-bfeb-4a8b-a310-41b9a699c485-kube-api-access-99hzl\") pod \"volume-data-source-validator-78cf4c6f6-vlck8\" (UID: \"67508af8-bfeb-4a8b-a310-41b9a699c485\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" Jul 20 19:15:35.148883 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.148857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-bound-sa-token\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.202559 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.202463 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lsjgw_766a7aaf-d001-4c0b-ab1c-a1107f5921ec/konnectivity-agent/0.log" limit=1024 Jul 20 19:15:35.216137 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.216106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" Jul 20 19:15:35.231313 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8218dc0c-366a-408a-8f03-e8ba65854acd-tmp-dir\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.231509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-default-certificate\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.231509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2497bd4-1c12-43c7-bc13-fde3b53402ce-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:35.231509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.231681 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.231558 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:15:35.231681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:35.231681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63cc0837-109f-4521-a91f-a795796bc8ab-cert\") pod \"ingress-canary-9x2jc\" (UID: \"63cc0837-109f-4521-a91f-a795796bc8ab\") " pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.231681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54s5q\" (UniqueName: \"kubernetes.io/projected/1c627091-ad1f-4028-80a7-99f53e14e663-kube-api-access-54s5q\") pod \"network-check-source-7bc5b6bf85-46n86\" (UID: \"1c627091-ad1f-4028-80a7-99f53e14e663\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" Jul 20 19:15:35.231681 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.231680 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.731661409 +0000 UTC m=+37.124400937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : secret "router-metrics-certs-default" not found Jul 20 19:15:35.231910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8218dc0c-366a-408a-8f03-e8ba65854acd-tmp-dir\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.231910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8218dc0c-366a-408a-8f03-e8ba65854acd-config-volume\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.231910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxdp\" (UniqueName: \"kubernetes.io/projected/bb1599ee-7c95-4b17-8f06-126ae0a6794c-kube-api-access-dnxdp\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.231910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mn7\" (UniqueName: \"kubernetes.io/projected/63cc0837-109f-4521-a91f-a795796bc8ab-kube-api-access-x8mn7\") pod \"ingress-canary-9x2jc\" (UID: \"63cc0837-109f-4521-a91f-a795796bc8ab\") " pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.231910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.231910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqqxj\" (UniqueName: \"kubernetes.io/projected/8218dc0c-366a-408a-8f03-e8ba65854acd-kube-api-access-mqqxj\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.231939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-stats-auth\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.231949 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.232028 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert podName:d2497bd4-1c12-43c7-bc13-fde3b53402ce nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.732008741 +0000 UTC m=+37.124748269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zl2fv" (UID: "d2497bd4-1c12-43c7-bc13-fde3b53402ce") : secret "networking-console-plugin-cert" not found Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.232032 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.232076 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls podName:8218dc0c-366a-408a-8f03-e8ba65854acd nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.732062062 +0000 UTC m=+37.124801591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls") pod "dns-default-4pklv" (UID: "8218dc0c-366a-408a-8f03-e8ba65854acd") : secret "dns-default-metrics-tls" not found Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.232169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.232204 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.232189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2497bd4-1c12-43c7-bc13-fde3b53402ce-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:35.232562 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.232333 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:35.732318439 +0000 UTC m=+37.125057949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : configmap references non-existent config key: service-ca.crt Jul 20 19:15:35.232562 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.232349 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8218dc0c-366a-408a-8f03-e8ba65854acd-config-volume\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.234424 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.234400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-default-certificate\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.234569 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.234401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63cc0837-109f-4521-a91f-a795796bc8ab-cert\") pod \"ingress-canary-9x2jc\" (UID: \"63cc0837-109f-4521-a91f-a795796bc8ab\") " pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.234629 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.234612 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-stats-auth\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.245376 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.245348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxdp\" (UniqueName: \"kubernetes.io/projected/bb1599ee-7c95-4b17-8f06-126ae0a6794c-kube-api-access-dnxdp\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.245572 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.245550 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqqxj\" (UniqueName: \"kubernetes.io/projected/8218dc0c-366a-408a-8f03-e8ba65854acd-kube-api-access-mqqxj\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.245634 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.245577 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8mn7\" (UniqueName: \"kubernetes.io/projected/63cc0837-109f-4521-a91f-a795796bc8ab-kube-api-access-x8mn7\") pod \"ingress-canary-9x2jc\" (UID: \"63cc0837-109f-4521-a91f-a795796bc8ab\") " pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.245923 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.245902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54s5q\" (UniqueName: \"kubernetes.io/projected/1c627091-ad1f-4028-80a7-99f53e14e663-kube-api-access-54s5q\") pod \"network-check-source-7bc5b6bf85-46n86\" (UID: \"1c627091-ad1f-4028-80a7-99f53e14e663\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" Jul 20 19:15:35.253878 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.253848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:35.262131 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.262108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" Jul 20 19:15:35.270596 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.270570 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-nbklj" Jul 20 19:15:35.289183 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.289151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" Jul 20 19:15:35.290949 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.290915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lsjgw_766a7aaf-d001-4c0b-ab1c-a1107f5921ec/konnectivity-agent/0.log" limit=1024 Jul 20 19:15:35.317907 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.317870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" Jul 20 19:15:35.324504 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.324463 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9x2jc" Jul 20 19:15:35.646169 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.646129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:35.646349 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.646199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:35.646349 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.646299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:35.646453 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.646436 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:35.646542 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.646525 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls podName:ab796ac5-7859-498b-8d63-77b7d22ef77b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.646506892 +0000 UTC m=+38.039246418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kj92j" (UID: "ab796ac5-7859-498b-8d63-77b7d22ef77b") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:35.646958 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.646940 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:15:35.647022 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.646962 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855ff7bd88-rlqr7: secret "image-registry-tls" not found Jul 20 19:15:35.647022 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.647007 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls podName:a91a2559-0a1e-449b-bf8f-a5ba0e5310d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.646990531 +0000 UTC m=+38.039730056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls") pod "image-registry-855ff7bd88-rlqr7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7") : secret "image-registry-tls" not found Jul 20 19:15:35.647123 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.647063 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:15:35.647123 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.647093 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls podName:a6a2be6c-ef39-4768-9268-baa9f975d399 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.647084135 +0000 UTC m=+38.039823648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fwlc4" (UID: "a6a2be6c-ef39-4768-9268-baa9f975d399") : secret "samples-operator-tls" not found Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.747175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.747673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.747752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.747823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.747556 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.748013 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.747990639 +0000 UTC m=+38.140730153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : configmap references non-existent config key: service-ca.crt Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.748582 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.748566309 +0000 UTC m=+38.141305821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : secret "router-metrics-certs-default" not found Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.748466 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.748618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls podName:8218dc0c-366a-408a-8f03-e8ba65854acd nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.74860834 +0000 UTC m=+38.141347852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls") pod "dns-default-4pklv" (UID: "8218dc0c-366a-408a-8f03-e8ba65854acd") : secret "dns-default-metrics-tls" not found Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.748704 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:15:35.748835 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:35.748784 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert podName:d2497bd4-1c12-43c7-bc13-fde3b53402ce nodeName:}" failed. No retries permitted until 2026-07-20 19:15:36.748770764 +0000 UTC m=+38.141510276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zl2fv" (UID: "d2497bd4-1c12-43c7-bc13-fde3b53402ce") : secret "networking-console-plugin-cert" not found Jul 20 19:15:35.776030 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.775824 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-7v9v8"] Jul 20 19:15:35.779222 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.779119 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bac223_834d_4105_a8e3_6995bf22f54a.slice/crio-7f9139d1b94430a32d874d989928c2a9a80a7d65403bcc7f240b5080ef6f6f0e WatchSource:0}: Error finding container 7f9139d1b94430a32d874d989928c2a9a80a7d65403bcc7f240b5080ef6f6f0e: Status 404 returned error can't find the container with id 7f9139d1b94430a32d874d989928c2a9a80a7d65403bcc7f240b5080ef6f6f0e Jul 20 19:15:35.782415 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.782349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9x2jc"] Jul 20 19:15:35.789632 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.789608 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-nbklj"] Jul 20 19:15:35.790822 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.790798 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cc0837_109f_4521_a91f_a795796bc8ab.slice/crio-fd9cb1c8dbbabb1671bc84f0de2310b0bd540382a1b26451b93f345e9ef90457 WatchSource:0}: Error finding container fd9cb1c8dbbabb1671bc84f0de2310b0bd540382a1b26451b93f345e9ef90457: Status 404 returned error can't find the container with id fd9cb1c8dbbabb1671bc84f0de2310b0bd540382a1b26451b93f345e9ef90457 Jul 20 19:15:35.791987 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.791956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5f0e17_cd8d_4010_9fd8_dc332e2f7096.slice/crio-b7ffd82f8e86cf7f5904ebbc7986640f73646dbb3fbb6cc2a0c2663711e2e573 WatchSource:0}: Error finding container b7ffd82f8e86cf7f5904ebbc7986640f73646dbb3fbb6cc2a0c2663711e2e573: Status 404 returned error can't find the container with id b7ffd82f8e86cf7f5904ebbc7986640f73646dbb3fbb6cc2a0c2663711e2e573 Jul 20 19:15:35.800813 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.800791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw"] Jul 20 19:15:35.803511 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.803474 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801b5600_1508_4ce9_a43e_14782c1d9816.slice/crio-ebe2cbe54b27d6a4a4d613af56f02b32df48897a32174c3468e8f8eb9564a8cf WatchSource:0}: Error finding container ebe2cbe54b27d6a4a4d613af56f02b32df48897a32174c3468e8f8eb9564a8cf: Status 404 returned error can't find the container with id ebe2cbe54b27d6a4a4d613af56f02b32df48897a32174c3468e8f8eb9564a8cf Jul 20 19:15:35.806634 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.806420 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86"] Jul 20 19:15:35.808445 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.808421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c627091_ad1f_4028_80a7_99f53e14e663.slice/crio-583eb5895ab0fa5a08a461ac0f874bf4a6a6b8f31c54fab6c083c571efd03560 WatchSource:0}: Error finding container 583eb5895ab0fa5a08a461ac0f874bf4a6a6b8f31c54fab6c083c571efd03560: Status 404 returned error can't find the container with id 583eb5895ab0fa5a08a461ac0f874bf4a6a6b8f31c54fab6c083c571efd03560 Jul 20 19:15:35.815317 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.815280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8"] Jul 20 19:15:35.816233 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:35.816093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j"] Jul 20 19:15:35.821297 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.821249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e73046_a9fb_41b6_9fbe_ec99a835d9de.slice/crio-d96a23d5000ee41e87eb5fd08fa604e6424e444a5f38dfb5fdeca3e210003762 WatchSource:0}: Error finding container d96a23d5000ee41e87eb5fd08fa604e6424e444a5f38dfb5fdeca3e210003762: Status 404 returned error can't find the container with id d96a23d5000ee41e87eb5fd08fa604e6424e444a5f38dfb5fdeca3e210003762 Jul 20 19:15:35.822403 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:35.822268 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67508af8_bfeb_4a8b_a310_41b9a699c485.slice/crio-b056e87f2b45bc937106a2d69be81d3c1bef3049fc2e3a05cedc994076cac635 WatchSource:0}: Error finding container b056e87f2b45bc937106a2d69be81d3c1bef3049fc2e3a05cedc994076cac635: Status 404 returned error can't find the container with id b056e87f2b45bc937106a2d69be81d3c1bef3049fc2e3a05cedc994076cac635 Jul 20 19:15:36.233989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.233943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9x2jc" event={"ID":"63cc0837-109f-4521-a91f-a795796bc8ab","Type":"ContainerStarted","Data":"fd9cb1c8dbbabb1671bc84f0de2310b0bd540382a1b26451b93f345e9ef90457"} Jul 20 19:15:36.235062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.235038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" event={"ID":"94e73046-a9fb-41b6-9fbe-ec99a835d9de","Type":"ContainerStarted","Data":"d96a23d5000ee41e87eb5fd08fa604e6424e444a5f38dfb5fdeca3e210003762"} Jul 20 19:15:36.236062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.236042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" event={"ID":"46bac223-834d-4105-a8e3-6995bf22f54a","Type":"ContainerStarted","Data":"7f9139d1b94430a32d874d989928c2a9a80a7d65403bcc7f240b5080ef6f6f0e"} Jul 20 19:15:36.237029 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.237011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" event={"ID":"67508af8-bfeb-4a8b-a310-41b9a699c485","Type":"ContainerStarted","Data":"b056e87f2b45bc937106a2d69be81d3c1bef3049fc2e3a05cedc994076cac635"} Jul 20 19:15:36.237930 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.237912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" event={"ID":"1c627091-ad1f-4028-80a7-99f53e14e663","Type":"ContainerStarted","Data":"583eb5895ab0fa5a08a461ac0f874bf4a6a6b8f31c54fab6c083c571efd03560"} Jul 20 19:15:36.238822 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.238805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-nbklj" event={"ID":"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096","Type":"ContainerStarted","Data":"b7ffd82f8e86cf7f5904ebbc7986640f73646dbb3fbb6cc2a0c2663711e2e573"} Jul 20 19:15:36.239767 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.239749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" event={"ID":"801b5600-1508-4ce9-a43e-14782c1d9816","Type":"ContainerStarted","Data":"ebe2cbe54b27d6a4a4d613af56f02b32df48897a32174c3468e8f8eb9564a8cf"} Jul 20 19:15:36.242181 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.242161 2576 generic.go:356] "Generic (PLEG): container finished" podID="11200e60-7310-49fd-9bce-bd093517d357" containerID="1608be919177f5e7de140dbb3e181a2cbb70bbc0cbeefa1f842b0ba12b520cac" exitCode=0 Jul 20 19:15:36.242250 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.242192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerDied","Data":"1608be919177f5e7de140dbb3e181a2cbb70bbc0cbeefa1f842b0ba12b520cac"} Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.656514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.656609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.656666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656707 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656791 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls podName:ab796ac5-7859-498b-8d63-77b7d22ef77b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.656768237 +0000 UTC m=+40.049507760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kj92j" (UID: "ab796ac5-7859-498b-8d63-77b7d22ef77b") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656833 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656887 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls podName:a6a2be6c-ef39-4768-9268-baa9f975d399 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.656870592 +0000 UTC m=+40.049610106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fwlc4" (UID: "a6a2be6c-ef39-4768-9268-baa9f975d399") : secret "samples-operator-tls" not found Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656952 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656963 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855ff7bd88-rlqr7: secret "image-registry-tls" not found Jul 20 19:15:36.657021 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.656993 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls podName:a91a2559-0a1e-449b-bf8f-a5ba0e5310d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.656983279 +0000 UTC m=+40.049722817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls") pod "image-registry-855ff7bd88-rlqr7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7") : secret "image-registry-tls" not found Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.757571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.757646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.757721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:36.757785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.757971 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.757951955 +0000 UTC m=+40.150691469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : configmap references non-existent config key: service-ca.crt Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.758387 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.758438 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.758422594 +0000 UTC m=+40.151162114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : secret "router-metrics-certs-default" not found Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.758515 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.758552 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert podName:d2497bd4-1c12-43c7-bc13-fde3b53402ce nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.758539741 +0000 UTC m=+40.151279256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zl2fv" (UID: "d2497bd4-1c12-43c7-bc13-fde3b53402ce") : secret "networking-console-plugin-cert" not found Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.758604 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:15:36.758667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:36.758635 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls podName:8218dc0c-366a-408a-8f03-e8ba65854acd nodeName:}" failed. No retries permitted until 2026-07-20 19:15:38.758624598 +0000 UTC m=+40.151364112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls") pod "dns-default-4pklv" (UID: "8218dc0c-366a-408a-8f03-e8ba65854acd") : secret "dns-default-metrics-tls" not found Jul 20 19:15:37.258948 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:37.257904 2576 generic.go:356] "Generic (PLEG): container finished" podID="11200e60-7310-49fd-9bce-bd093517d357" containerID="13f235b5d5369399b8519f589682385fe4390fdd500e30ba71d4b26ae4dd266d" exitCode=0 Jul 20 19:15:37.258948 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:37.257991 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerDied","Data":"13f235b5d5369399b8519f589682385fe4390fdd500e30ba71d4b26ae4dd266d"} Jul 20 19:15:38.281577 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.281529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" event={"ID":"11200e60-7310-49fd-9bce-bd093517d357","Type":"ContainerStarted","Data":"0d67c3e1cc47aed328d1900ced27588a0a3c16a58126d9547ee1ae02c2f84bad"} Jul 20 19:15:38.314130 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.314036 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwvvx" podStartSLOduration=8.791249122 podStartE2EDuration="39.314014437s" totalImagesPullingTime="30.522765315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:38.313232097 +0000 UTC m=+39.705971631" watchObservedRunningTime="2026-07-20 19:15:38.314014437 +0000 UTC m=+39.706753973" Jul 20 19:15:38.679689 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.679436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:38.679856 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.679604 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:15:38.679856 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.679804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:38.679856 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.679820 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls podName:a6a2be6c-ef39-4768-9268-baa9f975d399 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.679797298 +0000 UTC m=+44.072536826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fwlc4" (UID: "a6a2be6c-ef39-4768-9268-baa9f975d399") : secret "samples-operator-tls" not found Jul 20 19:15:38.679999 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.679878 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:38.679999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.679906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:38.679999 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.679916 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls podName:ab796ac5-7859-498b-8d63-77b7d22ef77b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.679903095 +0000 UTC m=+44.072642620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kj92j" (UID: "ab796ac5-7859-498b-8d63-77b7d22ef77b") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:38.679999 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.679981 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:15:38.679999 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.679994 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855ff7bd88-rlqr7: secret "image-registry-tls" not found Jul 20 19:15:38.680203 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.680025 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls podName:a91a2559-0a1e-449b-bf8f-a5ba0e5310d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.680014635 +0000 UTC m=+44.072754148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls") pod "image-registry-855ff7bd88-rlqr7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7") : secret "image-registry-tls" not found Jul 20 19:15:38.780662 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.780623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:38.780823 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.780700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:38.780823 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.780766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:38.780823 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:38.780813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:38.780981 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.780814 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:15:38.780981 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.780885 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls podName:8218dc0c-366a-408a-8f03-e8ba65854acd nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.780865181 +0000 UTC m=+44.173604693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls") pod "dns-default-4pklv" (UID: "8218dc0c-366a-408a-8f03-e8ba65854acd") : secret "dns-default-metrics-tls" not found Jul 20 19:15:38.780981 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.780908 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.780898799 +0000 UTC m=+44.173638316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : configmap references non-existent config key: service-ca.crt Jul 20 19:15:38.780981 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.780918 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:15:38.780981 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.780958 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:15:38.780981 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.780971 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.780955872 +0000 UTC m=+44.173695395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : secret "router-metrics-certs-default" not found Jul 20 19:15:38.781255 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:38.781006 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert podName:d2497bd4-1c12-43c7-bc13-fde3b53402ce nodeName:}" failed. No retries permitted until 2026-07-20 19:15:42.78099093 +0000 UTC m=+44.173730442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zl2fv" (UID: "d2497bd4-1c12-43c7-bc13-fde3b53402ce") : secret "networking-console-plugin-cert" not found Jul 20 19:15:42.717938 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.717837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:42.717938 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.717937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:42.718436 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.717988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:42.718436 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718215 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 19:15:42.718436 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718281 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls podName:a6a2be6c-ef39-4768-9268-baa9f975d399 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.718261938 +0000 UTC m=+52.111001450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fwlc4" (UID: "a6a2be6c-ef39-4768-9268-baa9f975d399") : secret "samples-operator-tls" not found Jul 20 19:15:42.718616 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718450 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:15:42.718616 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718477 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855ff7bd88-rlqr7: secret "image-registry-tls" not found Jul 20 19:15:42.718616 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718459 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:42.718616 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718551 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls podName:a91a2559-0a1e-449b-bf8f-a5ba0e5310d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.718532102 +0000 UTC m=+52.111271634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls") pod "image-registry-855ff7bd88-rlqr7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7") : secret "image-registry-tls" not found Jul 20 19:15:42.718616 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.718615 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls podName:ab796ac5-7859-498b-8d63-77b7d22ef77b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.718599039 +0000 UTC m=+52.111338553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kj92j" (UID: "ab796ac5-7859-498b-8d63-77b7d22ef77b") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:42.819140 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.819095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:42.819310 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.819205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:42.819310 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.819260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:42.819396 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.81927915 +0000 UTC m=+52.212018675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : configmap references non-existent config key: service-ca.crt Jul 20 19:15:42.819396 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819360 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:15:42.819396 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:42.819377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:42.819531 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819361 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:15:42.819531 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819408 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert podName:d2497bd4-1c12-43c7-bc13-fde3b53402ce nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.819400201 +0000 UTC m=+52.212139712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zl2fv" (UID: "d2497bd4-1c12-43c7-bc13-fde3b53402ce") : secret "networking-console-plugin-cert" not found Jul 20 19:15:42.819531 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819453 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.819436603 +0000 UTC m=+52.212176124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : secret "router-metrics-certs-default" not found Jul 20 19:15:42.819652 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819554 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:15:42.819652 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:42.819613 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls podName:8218dc0c-366a-408a-8f03-e8ba65854acd nodeName:}" failed. No retries permitted until 2026-07-20 19:15:50.819600515 +0000 UTC m=+52.212340030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls") pod "dns-default-4pklv" (UID: "8218dc0c-366a-408a-8f03-e8ba65854acd") : secret "dns-default-metrics-tls" not found Jul 20 19:15:44.300508 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.300457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" event={"ID":"801b5600-1508-4ce9-a43e-14782c1d9816","Type":"ContainerStarted","Data":"94155aa7763317ae46da97606a63aec02a5418e6702dc05ea01548f21b4f3372"} Jul 20 19:15:44.302308 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.302284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9x2jc" event={"ID":"63cc0837-109f-4521-a91f-a795796bc8ab","Type":"ContainerStarted","Data":"0012e05baafe839a5c018b669c53344c91bf0c81e467fa5f0912e179cc9726cf"} Jul 20 19:15:44.304154 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.303835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" event={"ID":"94e73046-a9fb-41b6-9fbe-ec99a835d9de","Type":"ContainerStarted","Data":"0a2f7d25ce465fb7db42a0080cfa6f2f8997e3c57740713d59042e347179f129"} Jul 20 19:15:44.305439 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.305420 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/0.log" Jul 20 19:15:44.305563 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.305460 2576 generic.go:356] "Generic (PLEG): container finished" podID="46bac223-834d-4105-a8e3-6995bf22f54a" containerID="a0e5a98198c64daabd3baf4b968da453708248b52354d4d30fcd4c6fd6c3ae17" exitCode=255 Jul 20 19:15:44.305563 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.305521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" event={"ID":"46bac223-834d-4105-a8e3-6995bf22f54a","Type":"ContainerDied","Data":"a0e5a98198c64daabd3baf4b968da453708248b52354d4d30fcd4c6fd6c3ae17"} Jul 20 19:15:44.305718 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.305700 2576 scope.go:117] "RemoveContainer" containerID="a0e5a98198c64daabd3baf4b968da453708248b52354d4d30fcd4c6fd6c3ae17" Jul 20 19:15:44.307302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.307272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" event={"ID":"67508af8-bfeb-4a8b-a310-41b9a699c485","Type":"ContainerStarted","Data":"3995d3a5276910f9b4421bf9474cd8525e8e3c0df9696ebf609a3aeedafabdef"} Jul 20 19:15:44.308877 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.308856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" event={"ID":"1c627091-ad1f-4028-80a7-99f53e14e663","Type":"ContainerStarted","Data":"df9b8ba908b9d8b442bab6156904564a9928ee44c6164421fd0895cf9e8bd150"} Jul 20 19:15:44.310299 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.310281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-nbklj" event={"ID":"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096","Type":"ContainerStarted","Data":"6c68f9c6770f08b26ed2796ab655c90098d4f56c1502d97dd2bbce5aaa2f7814"} Jul 20 19:15:44.319256 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.319192 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" podStartSLOduration=11.434610462 podStartE2EDuration="19.319179592s" totalImagesPullingTime="7.88456913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:44.318360788 +0000 UTC m=+45.711100321" watchObservedRunningTime="2026-07-20 19:15:44.319179592 +0000 UTC m=+45.711919103" Jul 20 19:15:44.339337 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.339290 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9x2jc" podStartSLOduration=2.441087905 podStartE2EDuration="10.339271929s" totalImagesPullingTime="7.898184024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:44.33879228 +0000 UTC m=+45.731531814" watchObservedRunningTime="2026-07-20 19:15:44.339271929 +0000 UTC m=+45.732011465" Jul 20 19:15:44.378028 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.377970 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vlck8" podStartSLOduration=11.549278549 podStartE2EDuration="19.377951243s" totalImagesPullingTime="7.828672694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:44.376698385 +0000 UTC m=+45.769437921" watchObservedRunningTime="2026-07-20 19:15:44.377951243 +0000 UTC m=+45.770690778" Jul 20 19:15:44.395034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.394980 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-46n86" podStartSLOduration=11.505328125 podStartE2EDuration="19.394963566s" totalImagesPullingTime="7.889635441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:44.39409889 +0000 UTC m=+45.786838422" watchObservedRunningTime="2026-07-20 19:15:44.394963566 +0000 UTC m=+45.787703098" Jul 20 19:15:44.435456 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.435363 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" podStartSLOduration=11.569501627 podStartE2EDuration="19.435340327s" totalImagesPullingTime="7.8658387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:44.41101238 +0000 UTC m=+45.803751914" watchObservedRunningTime="2026-07-20 19:15:44.435340327 +0000 UTC m=+45.828079879" Jul 20 19:15:44.436464 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.436425 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-nbklj" podStartSLOduration=11.540096912 podStartE2EDuration="19.436411853s" totalImagesPullingTime="7.896314941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:44.435037249 +0000 UTC m=+45.827776783" watchObservedRunningTime="2026-07-20 19:15:44.436411853 +0000 UTC m=+45.829151387" Jul 20 19:15:44.917597 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.917556 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d"] Jul 20 19:15:44.938688 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.938651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d"] Jul 20 19:15:44.938867 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.938779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" Jul 20 19:15:44.941908 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.941880 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 19:15:44.943327 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.943299 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 19:15:44.943670 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.943647 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j2wrj\"" Jul 20 19:15:44.994879 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:44.994780 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nxpxm"] Jul 20 19:15:45.014937 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.014894 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxpxm"] Jul 20 19:15:45.015133 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.015120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.018182 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.018155 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 19:15:45.018319 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.018287 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtng\"" Jul 20 19:15:45.018414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.018394 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 19:15:45.041508 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.041462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa050036-bcb4-4f50-878b-9ad569a72d36-crio-socket\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.041700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.041595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x44d\" (UniqueName: \"kubernetes.io/projected/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-api-access-9x44d\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.041700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.041626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t8kx\" (UniqueName: \"kubernetes.io/projected/59ace50a-f75a-498e-aef6-f85b71b1ee77-kube-api-access-9t8kx\") pod \"migrator-7cc9c7ffd7-5jt4d\" (UID: \"59ace50a-f75a-498e-aef6-f85b71b1ee77\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" Jul 20 19:15:45.041700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.041665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.041863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.041798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.041863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.041838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa050036-bcb4-4f50-878b-9ad569a72d36-data-volume\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.142842 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.142804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x44d\" (UniqueName: \"kubernetes.io/projected/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-api-access-9x44d\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.142842 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.142844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t8kx\" (UniqueName: \"kubernetes.io/projected/59ace50a-f75a-498e-aef6-f85b71b1ee77-kube-api-access-9t8kx\") pod \"migrator-7cc9c7ffd7-5jt4d\" (UID: \"59ace50a-f75a-498e-aef6-f85b71b1ee77\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" Jul 20 19:15:45.143105 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.142873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.143105 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.142969 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:15:45.143105 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.143036 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:45.643016094 +0000 UTC m=+47.035755605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : secret "insights-runtime-extractor-tls" not found Jul 20 19:15:45.143105 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.143093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.143269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.143123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa050036-bcb4-4f50-878b-9ad569a72d36-data-volume\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.143269 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.143165 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:15:45.143269 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.143205 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:45.643194038 +0000 UTC m=+47.035933555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : configmap "kube-rbac-proxy" not found Jul 20 19:15:45.143269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.143248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa050036-bcb4-4f50-878b-9ad569a72d36-crio-socket\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.143478 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.143458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa050036-bcb4-4f50-878b-9ad569a72d36-crio-socket\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.143553 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.143464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa050036-bcb4-4f50-878b-9ad569a72d36-data-volume\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.155271 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.155242 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t8kx\" (UniqueName: \"kubernetes.io/projected/59ace50a-f75a-498e-aef6-f85b71b1ee77-kube-api-access-9t8kx\") pod \"migrator-7cc9c7ffd7-5jt4d\" (UID: \"59ace50a-f75a-498e-aef6-f85b71b1ee77\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" Jul 20 19:15:45.155405 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.155242 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x44d\" (UniqueName: \"kubernetes.io/projected/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-api-access-9x44d\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.251453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.251360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" Jul 20 19:15:45.254518 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.254477 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:45.254650 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.254560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:45.316951 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.316923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:15:45.317383 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.317368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/0.log" Jul 20 19:15:45.317675 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.317405 2576 generic.go:356] "Generic (PLEG): container finished" podID="46bac223-834d-4105-a8e3-6995bf22f54a" containerID="8b3faadb6a4c7f2b5787f9ab930f96ea33aa864c2e68833b32ac622dbef90abf" exitCode=255 Jul 20 19:15:45.317675 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.317531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" event={"ID":"46bac223-834d-4105-a8e3-6995bf22f54a","Type":"ContainerDied","Data":"8b3faadb6a4c7f2b5787f9ab930f96ea33aa864c2e68833b32ac622dbef90abf"} Jul 20 19:15:45.317675 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.317608 2576 scope.go:117] "RemoveContainer" containerID="a0e5a98198c64daabd3baf4b968da453708248b52354d4d30fcd4c6fd6c3ae17" Jul 20 19:15:45.318152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.318132 2576 scope.go:117] "RemoveContainer" containerID="8b3faadb6a4c7f2b5787f9ab930f96ea33aa864c2e68833b32ac622dbef90abf" Jul 20 19:15:45.319824 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.319656 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-7v9v8_openshift-console-operator(46bac223-834d-4105-a8e3-6995bf22f54a)\"" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" podUID="46bac223-834d-4105-a8e3-6995bf22f54a" Jul 20 19:15:45.407584 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.407473 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d"] Jul 20 19:15:45.413082 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:45.413044 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ace50a_f75a_498e_aef6_f85b71b1ee77.slice/crio-2f677f1c5bc3cd93c0607b2526d1b5e4a95d93951118eb91de8d097279342551 WatchSource:0}: Error finding container 2f677f1c5bc3cd93c0607b2526d1b5e4a95d93951118eb91de8d097279342551: Status 404 returned error can't find the container with id 2f677f1c5bc3cd93c0607b2526d1b5e4a95d93951118eb91de8d097279342551 Jul 20 19:15:45.648622 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.648577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.648806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:45.648670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:45.648806 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.648728 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:15:45.648806 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.648776 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:15:45.648806 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.648805 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:46.648787613 +0000 UTC m=+48.041527124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : secret "insights-runtime-extractor-tls" not found Jul 20 19:15:45.648978 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:45.648827 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:46.648819967 +0000 UTC m=+48.041559477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : configmap "kube-rbac-proxy" not found Jul 20 19:15:46.324568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:46.324534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:15:46.325036 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:46.324962 2576 scope.go:117] "RemoveContainer" containerID="8b3faadb6a4c7f2b5787f9ab930f96ea33aa864c2e68833b32ac622dbef90abf" Jul 20 19:15:46.325186 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:46.325155 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-7v9v8_openshift-console-operator(46bac223-834d-4105-a8e3-6995bf22f54a)\"" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" podUID="46bac223-834d-4105-a8e3-6995bf22f54a" Jul 20 19:15:46.326021 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:46.325992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" event={"ID":"59ace50a-f75a-498e-aef6-f85b71b1ee77","Type":"ContainerStarted","Data":"2f677f1c5bc3cd93c0607b2526d1b5e4a95d93951118eb91de8d097279342551"} Jul 20 19:15:46.659100 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:46.659012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:46.659263 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:46.659158 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:15:46.659263 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:46.659156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:46.659263 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:46.659233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:48.659214701 +0000 UTC m=+50.051954212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : secret "insights-runtime-extractor-tls" not found Jul 20 19:15:46.659263 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:46.659236 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:15:46.659435 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:46.659305 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:48.659287297 +0000 UTC m=+50.052026812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : configmap "kube-rbac-proxy" not found Jul 20 19:15:47.186311 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.186285 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vt6nr_c19cada6-cfc9-4684-aaa7-d6d3aef3fc60/dns-node-resolver/0.log" Jul 20 19:15:47.330999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.330964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" event={"ID":"59ace50a-f75a-498e-aef6-f85b71b1ee77","Type":"ContainerStarted","Data":"d479dbabeffd2bb5d1d25b3d6118c8ac27462ee4ec5839696d2e3e861cea59ee"} Jul 20 19:15:47.872898 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.872859 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9l6lp"] Jul 20 19:15:47.897877 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.897849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:47.901801 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.901777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 20 19:15:47.901928 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.901809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ljpq8\"" Jul 20 19:15:47.902753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.902728 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 20 19:15:47.902848 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.902757 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 20 19:15:47.903087 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.903066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 20 19:15:47.906939 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.906917 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9l6lp"] Jul 20 19:15:47.974386 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.974343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a76981a3-57c6-4ccc-a344-cda99a07e51f-signing-key\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:47.974386 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.974394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a76981a3-57c6-4ccc-a344-cda99a07e51f-signing-cabundle\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:47.974630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.974412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxdvq\" (UniqueName: \"kubernetes.io/projected/a76981a3-57c6-4ccc-a344-cda99a07e51f-kube-api-access-bxdvq\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:47.985956 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:47.985933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9fhj_0e401ed6-b6f5-444d-b724-532d696079c1/node-ca/0.log" Jul 20 19:15:48.075746 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.075708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a76981a3-57c6-4ccc-a344-cda99a07e51f-signing-key\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.075975 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.075750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a76981a3-57c6-4ccc-a344-cda99a07e51f-signing-cabundle\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.075975 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.075783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxdvq\" (UniqueName: \"kubernetes.io/projected/a76981a3-57c6-4ccc-a344-cda99a07e51f-kube-api-access-bxdvq\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.076469 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.076446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a76981a3-57c6-4ccc-a344-cda99a07e51f-signing-cabundle\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.078296 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.078273 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a76981a3-57c6-4ccc-a344-cda99a07e51f-signing-key\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.084990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.084961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxdvq\" (UniqueName: \"kubernetes.io/projected/a76981a3-57c6-4ccc-a344-cda99a07e51f-kube-api-access-bxdvq\") pod \"service-ca-58598695f7-9l6lp\" (UID: \"a76981a3-57c6-4ccc-a344-cda99a07e51f\") " pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.207410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.207326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9l6lp" Jul 20 19:15:48.336074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.336042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" event={"ID":"59ace50a-f75a-498e-aef6-f85b71b1ee77","Type":"ContainerStarted","Data":"a126d11db45da49758ae45e4b86289b67568c6f97cdd4dc22674fa2aad901e87"} Jul 20 19:15:48.344816 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.344788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9l6lp"] Jul 20 19:15:48.347773 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:15:48.347745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76981a3_57c6_4ccc_a344_cda99a07e51f.slice/crio-85de490bd27983348affdd9d4e96c90f3719e08b3e22540d1b0d0f1bf3fbfbc1 WatchSource:0}: Error finding container 85de490bd27983348affdd9d4e96c90f3719e08b3e22540d1b0d0f1bf3fbfbc1: Status 404 returned error can't find the container with id 85de490bd27983348affdd9d4e96c90f3719e08b3e22540d1b0d0f1bf3fbfbc1 Jul 20 19:15:48.356426 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.356375 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5jt4d" podStartSLOduration=2.564515082 podStartE2EDuration="4.356356331s" totalImagesPullingTime="1.791841249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:48.35589629 +0000 UTC m=+49.748635825" watchObservedRunningTime="2026-07-20 19:15:48.356356331 +0000 UTC m=+49.749095865" Jul 20 19:15:48.588253 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.588223 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9x2jc_63cc0837-109f-4521-a91f-a795796bc8ab/serve-healthcheck-canary/0.log" Jul 20 19:15:48.682872 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.682826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:48.683071 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:48.682984 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:15:48.683071 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.682988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:48.683071 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:48.683049 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:52.683032816 +0000 UTC m=+54.075772328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : secret "insights-runtime-extractor-tls" not found Jul 20 19:15:48.683194 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:48.683053 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:15:48.683194 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:48.683150 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:52.683128016 +0000 UTC m=+54.075867533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : configmap "kube-rbac-proxy" not found Jul 20 19:15:48.789025 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:48.788997 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-5jt4d_59ace50a-f75a-498e-aef6-f85b71b1ee77/migrator/0.log" Jul 20 19:15:49.001006 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:49.000919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-5jt4d_59ace50a-f75a-498e-aef6-f85b71b1ee77/graceful-termination/0.log" Jul 20 19:15:49.203765 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:49.203733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-pr9rw_801b5600-1508-4ce9-a43e-14782c1d9816/kube-storage-version-migrator-operator/0.log" Jul 20 19:15:49.341780 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:49.341737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9l6lp" event={"ID":"a76981a3-57c6-4ccc-a344-cda99a07e51f","Type":"ContainerStarted","Data":"627a5b3dafe504a483c121c8d827b5ef8acf8be1b0cc9492dcdf318b6901ef90"} Jul 20 19:15:49.342277 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:49.341810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9l6lp" event={"ID":"a76981a3-57c6-4ccc-a344-cda99a07e51f","Type":"ContainerStarted","Data":"85de490bd27983348affdd9d4e96c90f3719e08b3e22540d1b0d0f1bf3fbfbc1"} Jul 20 19:15:49.372000 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:49.371926 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-9l6lp" podStartSLOduration=2.371903234 podStartE2EDuration="2.371903234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:49.370778969 +0000 UTC m=+50.763518502" watchObservedRunningTime="2026-07-20 19:15:49.371903234 +0000 UTC m=+50.764642769" Jul 20 19:15:50.807351 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.807316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.807368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.807448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.807514 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.807540 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.807590 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls podName:ab796ac5-7859-498b-8d63-77b7d22ef77b nodeName:}" failed. No retries permitted until 2026-07-20 19:16:06.807576066 +0000 UTC m=+68.200315577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kj92j" (UID: "ab796ac5-7859-498b-8d63-77b7d22ef77b") : secret "cluster-monitoring-operator-tls" not found Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.807541 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855ff7bd88-rlqr7: secret "image-registry-tls" not found Jul 20 19:15:50.807815 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.807693 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls podName:a91a2559-0a1e-449b-bf8f-a5ba0e5310d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:06.807673552 +0000 UTC m=+68.200413077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls") pod "image-registry-855ff7bd88-rlqr7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7") : secret "image-registry-tls" not found Jul 20 19:15:50.809905 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.809886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2be6c-ef39-4768-9268-baa9f975d399-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fwlc4\" (UID: \"a6a2be6c-ef39-4768-9268-baa9f975d399\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:50.883606 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.883563 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" Jul 20 19:15:50.908251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.908213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:50.908399 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.908273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:15:50.908399 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.908343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:15:50.908399 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908369 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 19:15:50.908582 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908419 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 19:15:50.908582 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908434 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:16:06.908414311 +0000 UTC m=+68.301153834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : secret "router-metrics-certs-default" not found Jul 20 19:15:50.908582 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908452 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls podName:8218dc0c-366a-408a-8f03-e8ba65854acd nodeName:}" failed. No retries permitted until 2026-07-20 19:16:06.908442714 +0000 UTC m=+68.301182230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls") pod "dns-default-4pklv" (UID: "8218dc0c-366a-408a-8f03-e8ba65854acd") : secret "dns-default-metrics-tls" not found Jul 20 19:15:50.908582 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908455 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 19:15:50.908582 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert podName:d2497bd4-1c12-43c7-bc13-fde3b53402ce nodeName:}" failed. No retries permitted until 2026-07-20 19:16:06.908528744 +0000 UTC m=+68.301268269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zl2fv" (UID: "d2497bd4-1c12-43c7-bc13-fde3b53402ce") : secret "networking-console-plugin-cert" not found Jul 20 19:15:50.908582 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:50.908574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:15:50.908827 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:50.908706 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle podName:bb1599ee-7c95-4b17-8f06-126ae0a6794c nodeName:}" failed. No retries permitted until 2026-07-20 19:16:06.908694352 +0000 UTC m=+68.301433872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle") pod "router-default-67666785d-tmfb4" (UID: "bb1599ee-7c95-4b17-8f06-126ae0a6794c") : configmap references non-existent config key: service-ca.crt Jul 20 19:15:51.044359 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:51.043086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4"] Jul 20 19:15:51.349453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:51.349369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" event={"ID":"a6a2be6c-ef39-4768-9268-baa9f975d399","Type":"ContainerStarted","Data":"8d4154a2017caf89039ffe1851b8bd18076a65571002a3bc6d26b3db6acf1600"} Jul 20 19:15:52.725016 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:52.724982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:52.725560 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:52.725091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:15:52.725560 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:52.725169 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 19:15:52.725560 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:52.725190 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 19:15:52.725560 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:52.725265 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:00.725244599 +0000 UTC m=+62.117984112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : configmap "kube-rbac-proxy" not found Jul 20 19:15:52.725560 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:15:52.725286 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls podName:fa050036-bcb4-4f50-878b-9ad569a72d36 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:00.72527625 +0000 UTC m=+62.118015767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxpxm" (UID: "fa050036-bcb4-4f50-878b-9ad569a72d36") : secret "insights-runtime-extractor-tls" not found Jul 20 19:15:54.366086 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:54.366049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" event={"ID":"a6a2be6c-ef39-4768-9268-baa9f975d399","Type":"ContainerStarted","Data":"2a71c4f15409ff5eebc7a4263b84ba3b4ade5f75897efefeab57fd12db3a5231"} Jul 20 19:15:54.366630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:54.366113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" event={"ID":"a6a2be6c-ef39-4768-9268-baa9f975d399","Type":"ContainerStarted","Data":"35589d9128253d8a9746a65c70387b7f56f9b91a4c1f95adddece11cb5aeae2a"} Jul 20 19:15:55.254575 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.254532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:55.254753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.254605 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:55.254975 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.254962 2576 scope.go:117] "RemoveContainer" containerID="8b3faadb6a4c7f2b5787f9ab930f96ea33aa864c2e68833b32ac622dbef90abf" Jul 20 19:15:55.371007 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.370980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:15:55.371416 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.371047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" event={"ID":"46bac223-834d-4105-a8e3-6995bf22f54a","Type":"ContainerStarted","Data":"242208a4651c3133d7d5cb42b8257a05f53620f4fd5282d673e5849fab429875"} Jul 20 19:15:55.371568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.371520 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:15:55.372415 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.372391 2576 patch_prober.go:28] interesting pod/console-operator-565b7b569d-7v9v8 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Jul 20 19:15:55.372569 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.372431 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" podUID="46bac223-834d-4105-a8e3-6995bf22f54a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Jul 20 19:15:55.391337 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.391279 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" podStartSLOduration=22.485056809 podStartE2EDuration="30.391261372s" totalImagesPullingTime="7.906204563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:55.390813168 +0000 UTC m=+56.783552718" watchObservedRunningTime="2026-07-20 19:15:55.391261372 +0000 UTC m=+56.784000909" Jul 20 19:15:55.391902 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:55.391869 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fwlc4" podStartSLOduration=28.16774659 podStartE2EDuration="30.391860021s" totalImagesPullingTime="2.224113431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:54.39615631 +0000 UTC m=+55.788895843" watchObservedRunningTime="2026-07-20 19:15:55.391860021 +0000 UTC m=+56.784599555" Jul 20 19:15:56.378549 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:15:56.378520 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-7v9v8" Jul 20 19:16:00.229295 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.229269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4kvq" Jul 20 19:16:00.798711 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.798668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:16:00.798892 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.798753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:16:00.799223 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.799206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa050036-bcb4-4f50-878b-9ad569a72d36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:16:00.801057 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.801032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa050036-bcb4-4f50-878b-9ad569a72d36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxpxm\" (UID: \"fa050036-bcb4-4f50-878b-9ad569a72d36\") " pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:16:00.929195 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.929166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtng\"" Jul 20 19:16:00.936766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:00.936735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxpxm" Jul 20 19:16:01.067704 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:01.067620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxpxm"] Jul 20 19:16:01.073685 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:01.073648 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa050036_bcb4_4f50_878b_9ad569a72d36.slice/crio-9102f0888f19a8d2e800a3e986bb6795f676d93455ed4a3d74a7197860f50c37 WatchSource:0}: Error finding container 9102f0888f19a8d2e800a3e986bb6795f676d93455ed4a3d74a7197860f50c37: Status 404 returned error can't find the container with id 9102f0888f19a8d2e800a3e986bb6795f676d93455ed4a3d74a7197860f50c37 Jul 20 19:16:01.391814 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:01.391725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxpxm" event={"ID":"fa050036-bcb4-4f50-878b-9ad569a72d36","Type":"ContainerStarted","Data":"9102f0888f19a8d2e800a3e986bb6795f676d93455ed4a3d74a7197860f50c37"} Jul 20 19:16:04.737596 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.737558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:16:04.740890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.740859 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:16:04.751139 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.751109 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e93309-65de-4877-8a56-6eaa173f2fd5-metrics-certs\") pod \"network-metrics-daemon-hzv2j\" (UID: \"64e93309-65de-4877-8a56-6eaa173f2fd5\") " pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:16:04.763808 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.763776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nkhbx\"" Jul 20 19:16:04.771207 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.771182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzv2j" Jul 20 19:16:04.838508 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.838450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:16:04.841991 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.841962 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:16:04.852467 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.852434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfdecac6-161c-4f42-8d9e-b42a74bfa964-original-pull-secret\") pod \"global-pull-secret-syncer-f42sp\" (UID: \"cfdecac6-161c-4f42-8d9e-b42a74bfa964\") " pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:16:04.940038 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.939981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:16:04.942992 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:04.942962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdtd\" (UniqueName: \"kubernetes.io/projected/91f80156-61b9-49dc-aa0d-2378fbdb7b4b-kube-api-access-rtdtd\") pod \"network-check-target-5mn9d\" (UID: \"91f80156-61b9-49dc-aa0d-2378fbdb7b4b\") " pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:16:05.047617 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:05.047591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f42sp" Jul 20 19:16:05.058600 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:05.058561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxxp2\"" Jul 20 19:16:05.065480 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:05.065457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:16:06.276095 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.276063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzv2j"] Jul 20 19:16:06.279256 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:06.279225 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e93309_65de_4877_8a56_6eaa173f2fd5.slice/crio-1285bec1b550e90feb9f47e8eb0fe1a6e656ff877de6cf701c666da33062c2dd WatchSource:0}: Error finding container 1285bec1b550e90feb9f47e8eb0fe1a6e656ff877de6cf701c666da33062c2dd: Status 404 returned error can't find the container with id 1285bec1b550e90feb9f47e8eb0fe1a6e656ff877de6cf701c666da33062c2dd Jul 20 19:16:06.412087 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.411992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzv2j" event={"ID":"64e93309-65de-4877-8a56-6eaa173f2fd5","Type":"ContainerStarted","Data":"1285bec1b550e90feb9f47e8eb0fe1a6e656ff877de6cf701c666da33062c2dd"} Jul 20 19:16:06.498034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.498006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5mn9d"] Jul 20 19:16:06.499695 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.499665 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f42sp"] Jul 20 19:16:06.501608 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:06.501583 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f80156_61b9_49dc_aa0d_2378fbdb7b4b.slice/crio-ce6911a372ddc101750afc8886391244e3acc1f897b5ae9f9bd38db5cbb67d94 WatchSource:0}: Error finding container ce6911a372ddc101750afc8886391244e3acc1f897b5ae9f9bd38db5cbb67d94: Status 404 returned error can't find the container with id ce6911a372ddc101750afc8886391244e3acc1f897b5ae9f9bd38db5cbb67d94 Jul 20 19:16:06.503789 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:06.503765 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdecac6_161c_4f42_8d9e_b42a74bfa964.slice/crio-c89ef43db34d07ba4483a4493d58ee1df7aca3d775f9249cb7c1f3412513e944 WatchSource:0}: Error finding container c89ef43db34d07ba4483a4493d58ee1df7aca3d775f9249cb7c1f3412513e944: Status 404 returned error can't find the container with id c89ef43db34d07ba4483a4493d58ee1df7aca3d775f9249cb7c1f3412513e944 Jul 20 19:16:06.859461 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.859422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:16:06.859666 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.859522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:06.862162 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.862126 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab796ac5-7859-498b-8d63-77b7d22ef77b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kj92j\" (UID: \"ab796ac5-7859-498b-8d63-77b7d22ef77b\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:16:06.862162 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.862148 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"image-registry-855ff7bd88-rlqr7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:06.960705 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.960666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:16:06.960911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.960738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:06.960911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.960784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:06.960911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.960805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:16:06.961616 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.961588 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1599ee-7c95-4b17-8f06-126ae0a6794c-service-ca-bundle\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:06.963432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.963408 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8218dc0c-366a-408a-8f03-e8ba65854acd-metrics-tls\") pod \"dns-default-4pklv\" (UID: \"8218dc0c-366a-408a-8f03-e8ba65854acd\") " pod="openshift-dns/dns-default-4pklv" Jul 20 19:16:06.963561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.963532 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2497bd4-1c12-43c7-bc13-fde3b53402ce-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zl2fv\" (UID: \"d2497bd4-1c12-43c7-bc13-fde3b53402ce\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:16:06.963561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:06.963541 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb1599ee-7c95-4b17-8f06-126ae0a6794c-metrics-certs\") pod \"router-default-67666785d-tmfb4\" (UID: \"bb1599ee-7c95-4b17-8f06-126ae0a6794c\") " pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:07.007223 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.007189 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f54s5\"" Jul 20 19:16:07.014735 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.014708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:07.045009 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.044979 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gl96l\"" Jul 20 19:16:07.052555 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.052523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" Jul 20 19:16:07.100628 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.100377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f2h7h\"" Jul 20 19:16:07.109589 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.109293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:07.110340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.110048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k7dt9\"" Jul 20 19:16:07.114231 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.114034 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bcdr2\"" Jul 20 19:16:07.118072 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.117855 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" Jul 20 19:16:07.122604 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.122364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4pklv" Jul 20 19:16:07.241638 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.238570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-855ff7bd88-rlqr7"] Jul 20 19:16:07.255890 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:07.243454 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91a2559_0a1e_449b_bf8f_a5ba0e5310d7.slice/crio-3b49fdb13a30cdc0ad349629dd60e1ef9231da682073a6e7d6763cde60b29f29 WatchSource:0}: Error finding container 3b49fdb13a30cdc0ad349629dd60e1ef9231da682073a6e7d6763cde60b29f29: Status 404 returned error can't find the container with id 3b49fdb13a30cdc0ad349629dd60e1ef9231da682073a6e7d6763cde60b29f29 Jul 20 19:16:07.334612 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.334528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j"] Jul 20 19:16:07.349433 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:07.349389 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab796ac5_7859_498b_8d63_77b7d22ef77b.slice/crio-e6cd31f22d9abcdadf4daae0d918a7376ab9fa21940eba438c172be04807cf2f WatchSource:0}: Error finding container e6cd31f22d9abcdadf4daae0d918a7376ab9fa21940eba438c172be04807cf2f: Status 404 returned error can't find the container with id e6cd31f22d9abcdadf4daae0d918a7376ab9fa21940eba438c172be04807cf2f Jul 20 19:16:07.378741 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.378620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67666785d-tmfb4"] Jul 20 19:16:07.390732 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:07.390696 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1599ee_7c95_4b17_8f06_126ae0a6794c.slice/crio-0504fc2ba3e08e5c817bbf5685106f8fbe1d478c30d203f14b00d6bd62bc3968 WatchSource:0}: Error finding container 0504fc2ba3e08e5c817bbf5685106f8fbe1d478c30d203f14b00d6bd62bc3968: Status 404 returned error can't find the container with id 0504fc2ba3e08e5c817bbf5685106f8fbe1d478c30d203f14b00d6bd62bc3968 Jul 20 19:16:07.417269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.417235 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4pklv"] Jul 20 19:16:07.423335 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.422754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxpxm" event={"ID":"fa050036-bcb4-4f50-878b-9ad569a72d36","Type":"ContainerStarted","Data":"c90042b203897074fbcb80d80e0105c03e13c889d2852e9bdc206871cc6dda50"} Jul 20 19:16:07.424728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.424700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67666785d-tmfb4" event={"ID":"bb1599ee-7c95-4b17-8f06-126ae0a6794c","Type":"ContainerStarted","Data":"0504fc2ba3e08e5c817bbf5685106f8fbe1d478c30d203f14b00d6bd62bc3968"} Jul 20 19:16:07.425765 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:07.425349 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8218dc0c_366a_408a_8f03_e8ba65854acd.slice/crio-c82fc1680faca37ae76adb2747c6d495b56aee11998cd9571c65cc28a2d3514f WatchSource:0}: Error finding container c82fc1680faca37ae76adb2747c6d495b56aee11998cd9571c65cc28a2d3514f: Status 404 returned error can't find the container with id c82fc1680faca37ae76adb2747c6d495b56aee11998cd9571c65cc28a2d3514f Jul 20 19:16:07.428551 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.428401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" event={"ID":"ab796ac5-7859-498b-8d63-77b7d22ef77b","Type":"ContainerStarted","Data":"e6cd31f22d9abcdadf4daae0d918a7376ab9fa21940eba438c172be04807cf2f"} Jul 20 19:16:07.431192 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.431123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f42sp" event={"ID":"cfdecac6-161c-4f42-8d9e-b42a74bfa964","Type":"ContainerStarted","Data":"c89ef43db34d07ba4483a4493d58ee1df7aca3d775f9249cb7c1f3412513e944"} Jul 20 19:16:07.436239 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.436168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" event={"ID":"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7","Type":"ContainerStarted","Data":"3b49fdb13a30cdc0ad349629dd60e1ef9231da682073a6e7d6763cde60b29f29"} Jul 20 19:16:07.440097 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.439356 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv"] Jul 20 19:16:07.443784 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.443403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5mn9d" event={"ID":"91f80156-61b9-49dc-aa0d-2378fbdb7b4b","Type":"ContainerStarted","Data":"c93679de9fe55a6ee23670cf03e4566583ed20025c8aa211cfa40edf717974f8"} Jul 20 19:16:07.443784 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.443443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5mn9d" event={"ID":"91f80156-61b9-49dc-aa0d-2378fbdb7b4b","Type":"ContainerStarted","Data":"ce6911a372ddc101750afc8886391244e3acc1f897b5ae9f9bd38db5cbb67d94"} Jul 20 19:16:07.444726 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.444671 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:16:07.446015 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:07.445992 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2497bd4_1c12_43c7_bc13_fde3b53402ce.slice/crio-8524f61884fc2b9a46fbf70f38f7fb4eef86dc9ef90da912a0de3b5ac3beca1b WatchSource:0}: Error finding container 8524f61884fc2b9a46fbf70f38f7fb4eef86dc9ef90da912a0de3b5ac3beca1b: Status 404 returned error can't find the container with id 8524f61884fc2b9a46fbf70f38f7fb4eef86dc9ef90da912a0de3b5ac3beca1b Jul 20 19:16:07.462448 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:07.461988 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5mn9d" podStartSLOduration=68.46196988 podStartE2EDuration="1m8.46196988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:07.461815048 +0000 UTC m=+68.854554586" watchObservedRunningTime="2026-07-20 19:16:07.46196988 +0000 UTC m=+68.854709419" Jul 20 19:16:08.453411 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.453322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" event={"ID":"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7","Type":"ContainerStarted","Data":"a23f26225b1a3b78df7ca0e350fb50c051dde336c593ea58ce91377ddbdb9c1d"} Jul 20 19:16:08.454239 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.454167 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:08.457613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.457442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67666785d-tmfb4" event={"ID":"bb1599ee-7c95-4b17-8f06-126ae0a6794c","Type":"ContainerStarted","Data":"f0d0d782677166b6ea2a8e4116a930a29630f78ca109ed2d0045f1461d6e8da0"} Jul 20 19:16:08.461044 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.461019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzv2j" event={"ID":"64e93309-65de-4877-8a56-6eaa173f2fd5","Type":"ContainerStarted","Data":"39da565ff40b3e0001333dffcebffcf24821e8a63a7557993a60af279080f177"} Jul 20 19:16:08.461150 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.461073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzv2j" event={"ID":"64e93309-65de-4877-8a56-6eaa173f2fd5","Type":"ContainerStarted","Data":"fc46402d03ee800b455283e1d81cc73c308d0fe48947944f7ed3117fe821c44b"} Jul 20 19:16:08.463183 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.463105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" event={"ID":"d2497bd4-1c12-43c7-bc13-fde3b53402ce","Type":"ContainerStarted","Data":"8524f61884fc2b9a46fbf70f38f7fb4eef86dc9ef90da912a0de3b5ac3beca1b"} Jul 20 19:16:08.466476 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.466416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4pklv" event={"ID":"8218dc0c-366a-408a-8f03-e8ba65854acd","Type":"ContainerStarted","Data":"c82fc1680faca37ae76adb2747c6d495b56aee11998cd9571c65cc28a2d3514f"} Jul 20 19:16:08.478266 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.476923 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" podStartSLOduration=68.476907104 podStartE2EDuration="1m8.476907104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:08.474004623 +0000 UTC m=+69.866744158" watchObservedRunningTime="2026-07-20 19:16:08.476907104 +0000 UTC m=+69.869646642" Jul 20 19:16:08.516525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.514853 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hzv2j" podStartSLOduration=67.874961032 podStartE2EDuration="1m9.514828471s" totalImagesPullingTime="1.639867439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:08.492864524 +0000 UTC m=+69.885604059" watchObservedRunningTime="2026-07-20 19:16:08.514828471 +0000 UTC m=+69.907568005" Jul 20 19:16:08.516525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:08.516040 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67666785d-tmfb4" podStartSLOduration=43.516026705 podStartE2EDuration="43.516026705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:08.515203162 +0000 UTC m=+69.907942698" watchObservedRunningTime="2026-07-20 19:16:08.516026705 +0000 UTC m=+69.908766240" Jul 20 19:16:09.111244 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.111208 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:09.114141 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.114116 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:09.345587 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.345536 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6"] Jul 20 19:16:09.362455 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.362356 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5"] Jul 20 19:16:09.362625 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.362545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.367219 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.367323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.367920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.367992 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq"] Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.368177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.368303 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 19:16:09.368633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.368636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 20 19:16:09.369074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.368724 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 19:16:09.369074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.368798 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 20 19:16:09.370966 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.370940 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 20 19:16:09.371338 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.371317 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xqz7p\"" Jul 20 19:16:09.372306 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.371626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5"] Jul 20 19:16:09.372306 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.371659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6"] Jul 20 19:16:09.372306 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.371722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.375327 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.375301 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq"] Jul 20 19:16:09.376340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.376291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 20 19:16:09.469775 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.469742 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:09.471200 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.471179 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67666785d-tmfb4" Jul 20 19:16:09.485584 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-ca\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.485736 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxzdc\" (UniqueName: \"kubernetes.io/projected/4306d268-403d-4c9d-8b8c-230554456d9e-kube-api-access-pxzdc\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.485736 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-hub\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.485736 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfr74\" (UniqueName: \"kubernetes.io/projected/e9c3a306-d6ec-4a23-a906-7da079db2a91-kube-api-access-pfr74\") pod \"managed-serviceaccount-addon-agent-7d55fb867d-zt9z5\" (UID: \"e9c3a306-d6ec-4a23-a906-7da079db2a91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.485915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.485915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqls\" (UniqueName: \"kubernetes.io/projected/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-kube-api-access-swqls\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.485915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.485915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4306d268-403d-4c9d-8b8c-230554456d9e-tmp\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.486083 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4306d268-403d-4c9d-8b8c-230554456d9e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.486083 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.486083 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.485991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c3a306-d6ec-4a23-a906-7da079db2a91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d55fb867d-zt9z5\" (UID: \"e9c3a306-d6ec-4a23-a906-7da079db2a91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.586463 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.586427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.586463 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.586478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c3a306-d6ec-4a23-a906-7da079db2a91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d55fb867d-zt9z5\" (UID: \"e9c3a306-d6ec-4a23-a906-7da079db2a91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-ca\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxzdc\" (UniqueName: \"kubernetes.io/projected/4306d268-403d-4c9d-8b8c-230554456d9e-kube-api-access-pxzdc\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-hub\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfr74\" (UniqueName: \"kubernetes.io/projected/e9c3a306-d6ec-4a23-a906-7da079db2a91-kube-api-access-pfr74\") pod \"managed-serviceaccount-addon-agent-7d55fb867d-zt9z5\" (UID: \"e9c3a306-d6ec-4a23-a906-7da079db2a91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqls\" (UniqueName: \"kubernetes.io/projected/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-kube-api-access-swqls\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4306d268-403d-4c9d-8b8c-230554456d9e-tmp\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.588060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.587619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4306d268-403d-4c9d-8b8c-230554456d9e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.588739 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.588290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4306d268-403d-4c9d-8b8c-230554456d9e-tmp\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.590752 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.590708 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-ca\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.590851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.590755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4306d268-403d-4c9d-8b8c-230554456d9e-klusterlet-config\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.591997 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.591953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c3a306-d6ec-4a23-a906-7da079db2a91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d55fb867d-zt9z5\" (UID: \"e9c3a306-d6ec-4a23-a906-7da079db2a91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.592265 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.592239 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.592410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.592391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.592921 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.592897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-hub\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.623948 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.623828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfr74\" (UniqueName: \"kubernetes.io/projected/e9c3a306-d6ec-4a23-a906-7da079db2a91-kube-api-access-pfr74\") pod \"managed-serviceaccount-addon-agent-7d55fb867d-zt9z5\" (UID: \"e9c3a306-d6ec-4a23-a906-7da079db2a91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.628654 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.628620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxzdc\" (UniqueName: \"kubernetes.io/projected/4306d268-403d-4c9d-8b8c-230554456d9e-kube-api-access-pxzdc\") pod \"klusterlet-addon-workmgr-7bcd48dcc6-7b4vq\" (UID: \"4306d268-403d-4c9d-8b8c-230554456d9e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:09.629202 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.629177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqls\" (UniqueName: \"kubernetes.io/projected/04bc66fe-90c8-4114-aae2-b57e44cb2c8a-kube-api-access-swqls\") pod \"cluster-proxy-proxy-agent-779c9899f-v49v6\" (UID: \"04bc66fe-90c8-4114-aae2-b57e44cb2c8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.691518 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.691230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" Jul 20 19:16:09.699703 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.699666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" Jul 20 19:16:09.717144 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:09.716912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:14.541250 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:14.540116 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5"] Jul 20 19:16:14.569186 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:14.569156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq"] Jul 20 19:16:14.572928 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:14.572905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6"] Jul 20 19:16:14.641173 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:14.641104 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9c3a306_d6ec_4a23_a906_7da079db2a91.slice/crio-14231bfbc75a2be2f5d5593540a0e47758352967bcfb1b990e6a9e2b13e61796 WatchSource:0}: Error finding container 14231bfbc75a2be2f5d5593540a0e47758352967bcfb1b990e6a9e2b13e61796: Status 404 returned error can't find the container with id 14231bfbc75a2be2f5d5593540a0e47758352967bcfb1b990e6a9e2b13e61796 Jul 20 19:16:14.641654 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:14.641630 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4306d268_403d_4c9d_8b8c_230554456d9e.slice/crio-c7f19bb7705509bd7d5f75c9a88dcb1488ff4c2c06722acc760f8008195beaf9 WatchSource:0}: Error finding container c7f19bb7705509bd7d5f75c9a88dcb1488ff4c2c06722acc760f8008195beaf9: Status 404 returned error can't find the container with id c7f19bb7705509bd7d5f75c9a88dcb1488ff4c2c06722acc760f8008195beaf9 Jul 20 19:16:15.503056 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.503019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4pklv" event={"ID":"8218dc0c-366a-408a-8f03-e8ba65854acd","Type":"ContainerStarted","Data":"386a436c93a8894b718f536b4dc14a24376de7383529c915cf81ef8ce7ae2bd9"} Jul 20 19:16:15.503243 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.503084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4pklv" event={"ID":"8218dc0c-366a-408a-8f03-e8ba65854acd","Type":"ContainerStarted","Data":"ac06f5242c13e26c8789db9b0b81388f1bd5220a312ee79bfdc061301ad1750e"} Jul 20 19:16:15.503243 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.503135 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4pklv" Jul 20 19:16:15.505642 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.505607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxpxm" event={"ID":"fa050036-bcb4-4f50-878b-9ad569a72d36","Type":"ContainerStarted","Data":"b65030cb0916591da9983e8734db0ea799d30ec9f9e2e3386047d8bd847030da"} Jul 20 19:16:15.507402 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.507350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" event={"ID":"4306d268-403d-4c9d-8b8c-230554456d9e","Type":"ContainerStarted","Data":"c7f19bb7705509bd7d5f75c9a88dcb1488ff4c2c06722acc760f8008195beaf9"} Jul 20 19:16:15.509656 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.509633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f42sp" event={"ID":"cfdecac6-161c-4f42-8d9e-b42a74bfa964","Type":"ContainerStarted","Data":"8ac26f8ce4b431ac1033227cdb47df32b7549636e55272801b3b4b9258588d0c"} Jul 20 19:16:15.512161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.512103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" event={"ID":"d2497bd4-1c12-43c7-bc13-fde3b53402ce","Type":"ContainerStarted","Data":"2d2a43ac415da3fa2e4702cb28530e22318addc24e81e4c74aeab25a4e52a1c2"} Jul 20 19:16:15.514191 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.513835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" event={"ID":"ab796ac5-7859-498b-8d63-77b7d22ef77b","Type":"ContainerStarted","Data":"b0d76614a55c5b2d48e04b78de73f57681f3eab096c8e62c3fd67811449d78c9"} Jul 20 19:16:15.515247 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.515221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" event={"ID":"e9c3a306-d6ec-4a23-a906-7da079db2a91","Type":"ContainerStarted","Data":"14231bfbc75a2be2f5d5593540a0e47758352967bcfb1b990e6a9e2b13e61796"} Jul 20 19:16:15.516663 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.516625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" event={"ID":"04bc66fe-90c8-4114-aae2-b57e44cb2c8a","Type":"ContainerStarted","Data":"08988a5a62879f60544048419dd7f368edb5ed1faf33c63ac455f4287bc80851"} Jul 20 19:16:15.524165 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.524111 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4pklv" podStartSLOduration=34.586379448 podStartE2EDuration="41.524092107s" totalImagesPullingTime="6.937712659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:15.521712626 +0000 UTC m=+76.914452161" watchObservedRunningTime="2026-07-20 19:16:15.524092107 +0000 UTC m=+76.916831643" Jul 20 19:16:15.543472 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.542708 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zl2fv" podStartSLOduration=43.665068466 podStartE2EDuration="50.542688145s" totalImagesPullingTime="6.877619679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:15.541802792 +0000 UTC m=+76.934542327" watchObservedRunningTime="2026-07-20 19:16:15.542688145 +0000 UTC m=+76.935427681" Jul 20 19:16:15.583426 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.582438 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f42sp" podStartSLOduration=68.705798315 podStartE2EDuration="1m16.582412119s" totalImagesPullingTime="7.876613804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:15.560755343 +0000 UTC m=+76.953494876" watchObservedRunningTime="2026-07-20 19:16:15.582412119 +0000 UTC m=+76.975151655" Jul 20 19:16:15.583426 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:15.583223 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kj92j" podStartSLOduration=43.578323685 podStartE2EDuration="50.58321072s" totalImagesPullingTime="7.004887035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:15.581177299 +0000 UTC m=+76.973916832" watchObservedRunningTime="2026-07-20 19:16:15.58321072 +0000 UTC m=+76.975950256" Jul 20 19:16:23.560928 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.560893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" event={"ID":"e9c3a306-d6ec-4a23-a906-7da079db2a91","Type":"ContainerStarted","Data":"99128d719ff89033100e8f6c14c0335d27606cd6dff51eafc3ba814e6819431e"} Jul 20 19:16:23.563062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.563030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" event={"ID":"04bc66fe-90c8-4114-aae2-b57e44cb2c8a","Type":"ContainerStarted","Data":"ea6481dbfe5a251c7b15738270753917ffa2ef1aca4c21c9a9035e47cdedb331"} Jul 20 19:16:23.563187 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.563073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" event={"ID":"04bc66fe-90c8-4114-aae2-b57e44cb2c8a","Type":"ContainerStarted","Data":"5571b9d86aa060e91e7fa15291d8aa349b3167d0e1d7e2ac6df04df8fe86efd7"} Jul 20 19:16:23.563187 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.563087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" event={"ID":"04bc66fe-90c8-4114-aae2-b57e44cb2c8a","Type":"ContainerStarted","Data":"03cc974a88ea29d557e72bb2e8e6a1f049fb9c159a82b834d2b6ea9223c0289a"} Jul 20 19:16:23.565099 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.565076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxpxm" event={"ID":"fa050036-bcb4-4f50-878b-9ad569a72d36","Type":"ContainerStarted","Data":"c7f50042a4aa3916a37f966ca9de0adb4c3fb83ec9cfec6bdc38aa686c114b67"} Jul 20 19:16:23.566507 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.566467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" event={"ID":"4306d268-403d-4c9d-8b8c-230554456d9e","Type":"ContainerStarted","Data":"3aaaeac4b1d294f98a135fee60f4348493b068d3a9d6f422c86b8a21660b7ab7"} Jul 20 19:16:23.566692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.566677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:23.568485 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.568468 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" Jul 20 19:16:23.577148 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.576973 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d55fb867d-zt9z5" podStartSLOduration=6.632693475 podStartE2EDuration="14.576957951s" totalImagesPullingTime="7.944264476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:23.576191558 +0000 UTC m=+84.968931131" watchObservedRunningTime="2026-07-20 19:16:23.576957951 +0000 UTC m=+84.969697487" Jul 20 19:16:23.598152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.598104 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779c9899f-v49v6" podStartSLOduration=6.636304275 podStartE2EDuration="14.598089265s" totalImagesPullingTime="7.96178499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:23.596968805 +0000 UTC m=+84.989708338" watchObservedRunningTime="2026-07-20 19:16:23.598089265 +0000 UTC m=+84.990828865" Jul 20 19:16:23.623835 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:23.623785 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nxpxm" podStartSLOduration=18.363653771 podStartE2EDuration="39.623768086s" totalImagesPullingTime="21.260114315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:23.623369443 +0000 UTC m=+85.016108976" watchObservedRunningTime="2026-07-20 19:16:23.623768086 +0000 UTC m=+85.016507619" Jul 20 19:16:25.529184 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:25.529155 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4pklv" Jul 20 19:16:25.547209 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:25.547155 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7bcd48dcc6-7b4vq" podStartSLOduration=8.588420766 podStartE2EDuration="16.54713764s" totalImagesPullingTime="7.958716874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:23.645887363 +0000 UTC m=+85.038626894" watchObservedRunningTime="2026-07-20 19:16:25.54713764 +0000 UTC m=+86.939877223" Jul 20 19:16:26.481317 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.481283 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v2tgn"] Jul 20 19:16:26.488455 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.488427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.491273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.491250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 19:16:26.491470 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.491448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 19:16:26.491636 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.491618 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 19:16:26.491701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.491683 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 19:16:26.492314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.492297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4x4qd\"" Jul 20 19:16:26.525539 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-tls\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-sys\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-root\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-wtmp\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fg8l\" (UniqueName: \"kubernetes.io/projected/3eb80656-555e-4cb2-b5ab-45e701f0cdba-kube-api-access-6fg8l\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eb80656-555e-4cb2-b5ab-45e701f0cdba-metrics-client-ca\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-textfile\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.525996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.525893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.626769 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.626733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-root\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.626792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-wtmp\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.626822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fg8l\" (UniqueName: \"kubernetes.io/projected/3eb80656-555e-4cb2-b5ab-45e701f0cdba-kube-api-access-6fg8l\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.626851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eb80656-555e-4cb2-b5ab-45e701f0cdba-metrics-client-ca\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.626860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-root\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-wtmp\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-textfile\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-tls\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-sys\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eb80656-555e-4cb2-b5ab-45e701f0cdba-sys\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-textfile\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3eb80656-555e-4cb2-b5ab-45e701f0cdba-metrics-client-ca\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.627806 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:16:26.627725 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 19:16:26.628008 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:16:26.627849 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-tls podName:3eb80656-555e-4cb2-b5ab-45e701f0cdba nodeName:}" failed. No retries permitted until 2026-07-20 19:16:27.127827946 +0000 UTC m=+88.520567475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-tls") pod "node-exporter-v2tgn" (UID: "3eb80656-555e-4cb2-b5ab-45e701f0cdba") : secret "node-exporter-tls" not found Jul 20 19:16:26.628008 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.627968 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-accelerators-collector-config\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.629737 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.629717 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:26.639129 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:26.639088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fg8l\" (UniqueName: \"kubernetes.io/projected/3eb80656-555e-4cb2-b5ab-45e701f0cdba-kube-api-access-6fg8l\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:27.019869 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:27.019835 2576 patch_prober.go:28] interesting pod/image-registry-855ff7bd88-rlqr7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 19:16:27.020044 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:27.019887 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" podUID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:16:27.132257 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:27.132220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-tls\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:27.134452 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:27.134422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3eb80656-555e-4cb2-b5ab-45e701f0cdba-node-exporter-tls\") pod \"node-exporter-v2tgn\" (UID: \"3eb80656-555e-4cb2-b5ab-45e701f0cdba\") " pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:27.400241 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:27.400208 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v2tgn" Jul 20 19:16:27.415239 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:16:27.415192 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb80656_555e_4cb2_b5ab_45e701f0cdba.slice/crio-f1ff1cd24e1e21d8ba6e027e0037113e5c2c6b12c79034954019e6d80c45446b WatchSource:0}: Error finding container f1ff1cd24e1e21d8ba6e027e0037113e5c2c6b12c79034954019e6d80c45446b: Status 404 returned error can't find the container with id f1ff1cd24e1e21d8ba6e027e0037113e5c2c6b12c79034954019e6d80c45446b Jul 20 19:16:27.587753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:27.587718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2tgn" event={"ID":"3eb80656-555e-4cb2-b5ab-45e701f0cdba","Type":"ContainerStarted","Data":"f1ff1cd24e1e21d8ba6e027e0037113e5c2c6b12c79034954019e6d80c45446b"} Jul 20 19:16:28.598953 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:28.598916 2576 generic.go:356] "Generic (PLEG): container finished" podID="3eb80656-555e-4cb2-b5ab-45e701f0cdba" containerID="f92dd32fbc2e0c7e65046d6de0a103bcbe0b9a341040fb9a19d566dfc712fb5f" exitCode=0 Jul 20 19:16:28.599373 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:28.599005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2tgn" event={"ID":"3eb80656-555e-4cb2-b5ab-45e701f0cdba","Type":"ContainerDied","Data":"f92dd32fbc2e0c7e65046d6de0a103bcbe0b9a341040fb9a19d566dfc712fb5f"} Jul 20 19:16:29.605581 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:29.605548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2tgn" event={"ID":"3eb80656-555e-4cb2-b5ab-45e701f0cdba","Type":"ContainerStarted","Data":"29d8631c34a66d58f602d310a6e0fdfda9e245f3bc4d87b0137ba39763f036ce"} Jul 20 19:16:29.605941 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:29.605600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v2tgn" event={"ID":"3eb80656-555e-4cb2-b5ab-45e701f0cdba","Type":"ContainerStarted","Data":"26e327ef8b050d1d4e8717db5abd4a01c700192a0c20ff4a7b3cc83224a2fdc8"} Jul 20 19:16:29.630376 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:29.630328 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v2tgn" podStartSLOduration=2.6227952820000002 podStartE2EDuration="3.630311476s" totalImagesPullingTime="944.767303ms" totalInitContainerRuntime="62.748891ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:29.628797332 +0000 UTC m=+91.021536906" watchObservedRunningTime="2026-07-20 19:16:29.630311476 +0000 UTC m=+91.023051009" Jul 20 19:16:30.478432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:30.478397 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:32.577844 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:32.577809 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-855ff7bd88-rlqr7"] Jul 20 19:16:39.472372 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:39.472338 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5mn9d" Jul 20 19:16:55.707838 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:55.707800 2576 generic.go:356] "Generic (PLEG): container finished" podID="94e73046-a9fb-41b6-9fbe-ec99a835d9de" containerID="0a2f7d25ce465fb7db42a0080cfa6f2f8997e3c57740713d59042e347179f129" exitCode=0 Jul 20 19:16:55.708275 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:55.707870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" event={"ID":"94e73046-a9fb-41b6-9fbe-ec99a835d9de","Type":"ContainerDied","Data":"0a2f7d25ce465fb7db42a0080cfa6f2f8997e3c57740713d59042e347179f129"} Jul 20 19:16:55.708275 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:55.708199 2576 scope.go:117] "RemoveContainer" containerID="0a2f7d25ce465fb7db42a0080cfa6f2f8997e3c57740713d59042e347179f129" Jul 20 19:16:56.713072 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:56.713037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-htm7j" event={"ID":"94e73046-a9fb-41b6-9fbe-ec99a835d9de","Type":"ContainerStarted","Data":"3fea059afd7bddab516e979b107bd1bc7e5b3f9bdb3ebc3bbcda9270aec83306"} Jul 20 19:16:57.601649 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.601602 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" podUID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" containerName="registry" containerID="cri-o://a23f26225b1a3b78df7ca0e350fb50c051dde336c593ea58ce91377ddbdb9c1d" gracePeriod=30 Jul 20 19:16:57.718415 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.718384 2576 generic.go:356] "Generic (PLEG): container finished" podID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" containerID="a23f26225b1a3b78df7ca0e350fb50c051dde336c593ea58ce91377ddbdb9c1d" exitCode=0 Jul 20 19:16:57.718739 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.718412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" event={"ID":"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7","Type":"ContainerDied","Data":"a23f26225b1a3b78df7ca0e350fb50c051dde336c593ea58ce91377ddbdb9c1d"} Jul 20 19:16:57.852679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.852620 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:57.997602 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997565 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-certificates\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.997602 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997610 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5vqm\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-kube-api-access-w5vqm\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.997832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997642 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-trusted-ca\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.997832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997675 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-bound-sa-token\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.997832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997708 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-ca-trust-extracted\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.997832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997766 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-image-registry-private-configuration\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.997832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997795 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.998063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.997853 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-installation-pull-secrets\") pod \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\" (UID: \"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7\") " Jul 20 19:16:57.998407 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.998184 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:16:57.998407 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:57.998201 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:16:58.000408 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.000348 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:16:58.000588 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.000557 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:16:58.000666 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.000635 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:16:58.000725 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.000668 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:16:58.000725 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.000706 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-kube-api-access-w5vqm" (OuterVolumeSpecName: "kube-api-access-w5vqm") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "kube-api-access-w5vqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:16:58.006283 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.006251 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" (UID: "a91a2559-0a1e-449b-bf8f-a5ba0e5310d7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:16:58.099418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099378 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-installation-pull-secrets\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099410 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-certificates\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099420 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5vqm\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-kube-api-access-w5vqm\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099429 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-trusted-ca\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099438 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-bound-sa-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099446 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-ca-trust-extracted\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099454 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-image-registry-private-configuration\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.099707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.099465 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7-registry-tls\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:16:58.727829 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.727794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" event={"ID":"a91a2559-0a1e-449b-bf8f-a5ba0e5310d7","Type":"ContainerDied","Data":"3b49fdb13a30cdc0ad349629dd60e1ef9231da682073a6e7d6763cde60b29f29"} Jul 20 19:16:58.728286 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.727835 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855ff7bd88-rlqr7" Jul 20 19:16:58.728286 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.727881 2576 scope.go:117] "RemoveContainer" containerID="a23f26225b1a3b78df7ca0e350fb50c051dde336c593ea58ce91377ddbdb9c1d" Jul 20 19:16:58.751604 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.751569 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-855ff7bd88-rlqr7"] Jul 20 19:16:58.756193 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:58.756167 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-855ff7bd88-rlqr7"] Jul 20 19:16:59.041545 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:16:59.041513 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" path="/var/lib/kubelet/pods/a91a2559-0a1e-449b-bf8f-a5ba0e5310d7/volumes" Jul 20 19:17:09.770711 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:09.770671 2576 generic.go:356] "Generic (PLEG): container finished" podID="4b5f0e17-cd8d-4010-9fd8-dc332e2f7096" containerID="6c68f9c6770f08b26ed2796ab655c90098d4f56c1502d97dd2bbce5aaa2f7814" exitCode=0 Jul 20 19:17:09.771123 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:09.770734 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-nbklj" event={"ID":"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096","Type":"ContainerDied","Data":"6c68f9c6770f08b26ed2796ab655c90098d4f56c1502d97dd2bbce5aaa2f7814"} Jul 20 19:17:09.771168 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:09.771150 2576 scope.go:117] "RemoveContainer" containerID="6c68f9c6770f08b26ed2796ab655c90098d4f56c1502d97dd2bbce5aaa2f7814" Jul 20 19:17:10.675465 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:10.675432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67666785d-tmfb4_bb1599ee-7c95-4b17-8f06-126ae0a6794c/router/0.log" Jul 20 19:17:10.695935 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:10.695913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9x2jc_63cc0837-109f-4521-a91f-a795796bc8ab/serve-healthcheck-canary/0.log" Jul 20 19:17:10.776637 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:10.776596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-nbklj" event={"ID":"4b5f0e17-cd8d-4010-9fd8-dc332e2f7096","Type":"ContainerStarted","Data":"996fa9597a2ad58c5d1c3476955e19fb0e0579c0da95ceef82102ebc32680ff0"} Jul 20 19:17:19.817552 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:19.817485 2576 generic.go:356] "Generic (PLEG): container finished" podID="801b5600-1508-4ce9-a43e-14782c1d9816" containerID="94155aa7763317ae46da97606a63aec02a5418e6702dc05ea01548f21b4f3372" exitCode=0 Jul 20 19:17:19.817963 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:19.817567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" event={"ID":"801b5600-1508-4ce9-a43e-14782c1d9816","Type":"ContainerDied","Data":"94155aa7763317ae46da97606a63aec02a5418e6702dc05ea01548f21b4f3372"} Jul 20 19:17:19.817963 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:19.817917 2576 scope.go:117] "RemoveContainer" containerID="94155aa7763317ae46da97606a63aec02a5418e6702dc05ea01548f21b4f3372" Jul 20 19:17:20.823561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:17:20.823524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-pr9rw" event={"ID":"801b5600-1508-4ce9-a43e-14782c1d9816","Type":"ContainerStarted","Data":"80bf6a2cf8a7bd4fc2a09bb4154ddf223df6f729c86b700f5e6b9608c203849e"} Jul 20 19:19:58.945675 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:19:58.945644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:19:58.949310 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:19:58.949287 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:19:58.950264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:19:58.950244 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:19:58.953766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:19:58.953746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:19:58.956511 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:19:58.956475 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 19:20:00.480235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.480199 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4"] Jul 20 19:20:00.482592 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.480528 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" containerName="registry" Jul 20 19:20:00.482592 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.480540 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" containerName="registry" Jul 20 19:20:00.482592 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.480611 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91a2559-0a1e-449b-bf8f-a5ba0e5310d7" containerName="registry" Jul 20 19:20:00.483545 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.483529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.487178 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.487156 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 19:20:00.487302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.487184 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 19:20:00.487302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.487244 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 19:20:00.487797 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.487782 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6dd72\"" Jul 20 19:20:00.488011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.487997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 19:20:00.519839 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.519804 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4"] Jul 20 19:20:00.550109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.550071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgm5\" (UniqueName: \"kubernetes.io/projected/4e3e945c-48b8-487b-839a-ded4d71102e7-kube-api-access-kbgm5\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.550296 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.550122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e3e945c-48b8-487b-839a-ded4d71102e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.550296 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.550147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e3e945c-48b8-487b-839a-ded4d71102e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.550296 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.550208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e3e945c-48b8-487b-839a-ded4d71102e7-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.550296 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.550283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4e3e945c-48b8-487b-839a-ded4d71102e7-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.651109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.651063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e3e945c-48b8-487b-839a-ded4d71102e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.651109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.651115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e3e945c-48b8-487b-839a-ded4d71102e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.651363 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.651139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e3e945c-48b8-487b-839a-ded4d71102e7-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.651363 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.651161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4e3e945c-48b8-487b-839a-ded4d71102e7-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.651363 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.651202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgm5\" (UniqueName: \"kubernetes.io/projected/4e3e945c-48b8-487b-839a-ded4d71102e7-kube-api-access-kbgm5\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.651739 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.651708 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4e3e945c-48b8-487b-839a-ded4d71102e7-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.653580 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.653556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e3e945c-48b8-487b-839a-ded4d71102e7-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.653747 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.653729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e3e945c-48b8-487b-839a-ded4d71102e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.653835 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.653816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e3e945c-48b8-487b-839a-ded4d71102e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.663243 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.663212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgm5\" (UniqueName: \"kubernetes.io/projected/4e3e945c-48b8-487b-839a-ded4d71102e7-kube-api-access-kbgm5\") pod \"opendatahub-operator-controller-manager-8569dc75f9-8lpr4\" (UID: \"4e3e945c-48b8-487b-839a-ded4d71102e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.794153 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.794114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:00.950051 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.950025 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4"] Jul 20 19:20:00.953105 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:00.953067 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3e945c_48b8_487b_839a_ded4d71102e7.slice/crio-139cdc856668311b2d3a8e69c6929f62d1e5d9218c687b4f18656cdad8eef6a3 WatchSource:0}: Error finding container 139cdc856668311b2d3a8e69c6929f62d1e5d9218c687b4f18656cdad8eef6a3: Status 404 returned error can't find the container with id 139cdc856668311b2d3a8e69c6929f62d1e5d9218c687b4f18656cdad8eef6a3 Jul 20 19:20:00.954834 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:00.954814 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:20:01.449897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:01.449863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" event={"ID":"4e3e945c-48b8-487b-839a-ded4d71102e7","Type":"ContainerStarted","Data":"139cdc856668311b2d3a8e69c6929f62d1e5d9218c687b4f18656cdad8eef6a3"} Jul 20 19:20:04.466435 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:04.466390 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" event={"ID":"4e3e945c-48b8-487b-839a-ded4d71102e7","Type":"ContainerStarted","Data":"ac45a48bdd23bd99d0c055d7e78312eb28323df7b6f3dc5a317ace748771e909"} Jul 20 19:20:05.472317 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:05.472225 2576 generic.go:356] "Generic (PLEG): container finished" podID="4e3e945c-48b8-487b-839a-ded4d71102e7" containerID="ac45a48bdd23bd99d0c055d7e78312eb28323df7b6f3dc5a317ace748771e909" exitCode=0 Jul 20 19:20:05.472708 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:05.472312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" event={"ID":"4e3e945c-48b8-487b-839a-ded4d71102e7","Type":"ContainerDied","Data":"ac45a48bdd23bd99d0c055d7e78312eb28323df7b6f3dc5a317ace748771e909"} Jul 20 19:20:06.478870 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:06.478838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" event={"ID":"4e3e945c-48b8-487b-839a-ded4d71102e7","Type":"ContainerStarted","Data":"950029b96b4f20fe113893e8570468abb01686e2184711aaf10b5f921d51070a"} Jul 20 19:20:06.479256 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:06.478992 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:17.486155 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:17.486123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" Jul 20 19:20:17.526397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:17.526342 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-8lpr4" podStartSLOduration=13.029290456 podStartE2EDuration="17.526326784s" totalImagesPullingTime="3.453573019s" totalInitContainerRuntime="1.043463309s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:06.507597177 +0000 UTC m=+307.900336711" watchObservedRunningTime="2026-07-20 19:20:17.526326784 +0000 UTC m=+318.919066316" Jul 20 19:20:20.491201 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.491162 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks"] Jul 20 19:20:20.494621 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.494596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.498151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.498128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m2vql\"" Jul 20 19:20:20.498151 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.498141 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 20 19:20:20.498313 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.498134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 20 19:20:20.517445 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.517409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks"] Jul 20 19:20:20.632744 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.632702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-tmp\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.632935 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.632759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzqs\" (UniqueName: \"kubernetes.io/projected/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-kube-api-access-6vzqs\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.632935 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.632886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-tls-certs\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.734023 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.733980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzqs\" (UniqueName: \"kubernetes.io/projected/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-kube-api-access-6vzqs\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.734231 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.734077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-tls-certs\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.734231 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.734114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-tmp\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.736585 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.736558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-tmp\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.736690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.736670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-tls-certs\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.754079 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.754016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzqs\" (UniqueName: \"kubernetes.io/projected/9ff2ecee-451e-4cc7-8f80-3213faeeb76c-kube-api-access-6vzqs\") pod \"kube-auth-proxy-6469fb7d96-rwlks\" (UID: \"9ff2ecee-451e-4cc7-8f80-3213faeeb76c\") " pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.792742 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.792700 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zpl5s"] Jul 20 19:20:20.796161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.796143 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:20.798900 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.798876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4qmv7\"" Jul 20 19:20:20.798989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.798971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 20 19:20:20.804430 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.804409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" Jul 20 19:20:20.808014 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.807987 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zpl5s"] Jul 20 19:20:20.936263 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.936225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1334545e-9b62-4e6b-a003-9ea573d87c69-cert\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:20.936420 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.936282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czxh4\" (UniqueName: \"kubernetes.io/projected/1334545e-9b62-4e6b-a003-9ea573d87c69-kube-api-access-czxh4\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:20.946643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:20.946566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks"] Jul 20 19:20:20.951478 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:20.951447 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff2ecee_451e_4cc7_8f80_3213faeeb76c.slice/crio-31783c3646a8c7935a257ccadda63121b47393205e71287760b51be16521f447 WatchSource:0}: Error finding container 31783c3646a8c7935a257ccadda63121b47393205e71287760b51be16521f447: Status 404 returned error can't find the container with id 31783c3646a8c7935a257ccadda63121b47393205e71287760b51be16521f447 Jul 20 19:20:21.036700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.036666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1334545e-9b62-4e6b-a003-9ea573d87c69-cert\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:21.036887 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.036721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czxh4\" (UniqueName: \"kubernetes.io/projected/1334545e-9b62-4e6b-a003-9ea573d87c69-kube-api-access-czxh4\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:21.036887 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:20:21.036803 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 20 19:20:21.036887 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:20:21.036882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1334545e-9b62-4e6b-a003-9ea573d87c69-cert podName:1334545e-9b62-4e6b-a003-9ea573d87c69 nodeName:}" failed. No retries permitted until 2026-07-20 19:20:21.536860137 +0000 UTC m=+322.929599661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1334545e-9b62-4e6b-a003-9ea573d87c69-cert") pod "odh-model-controller-7998c67dc4-zpl5s" (UID: "1334545e-9b62-4e6b-a003-9ea573d87c69") : secret "odh-model-controller-webhook-cert" not found Jul 20 19:20:21.049902 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.049876 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czxh4\" (UniqueName: \"kubernetes.io/projected/1334545e-9b62-4e6b-a003-9ea573d87c69-kube-api-access-czxh4\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:21.540643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.540610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" event={"ID":"9ff2ecee-451e-4cc7-8f80-3213faeeb76c","Type":"ContainerStarted","Data":"31783c3646a8c7935a257ccadda63121b47393205e71287760b51be16521f447"} Jul 20 19:20:21.541964 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.541947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1334545e-9b62-4e6b-a003-9ea573d87c69-cert\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:21.544263 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.544246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1334545e-9b62-4e6b-a003-9ea573d87c69-cert\") pod \"odh-model-controller-7998c67dc4-zpl5s\" (UID: \"1334545e-9b62-4e6b-a003-9ea573d87c69\") " pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:21.706391 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.706357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:21.871112 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.871068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zpl5s"] Jul 20 19:20:21.876735 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:21.876703 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1334545e_9b62_4e6b_a003_9ea573d87c69.slice/crio-f09e86cade3e60f72f495783f00a468601cf5c5ce12cea73e88dd2ff111cd3c4 WatchSource:0}: Error finding container f09e86cade3e60f72f495783f00a468601cf5c5ce12cea73e88dd2ff111cd3c4: Status 404 returned error can't find the container with id f09e86cade3e60f72f495783f00a468601cf5c5ce12cea73e88dd2ff111cd3c4 Jul 20 19:20:21.955984 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.955947 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lvbxg"] Jul 20 19:20:21.960926 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.960897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:21.966274 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.966233 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 19:20:21.966786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.966762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hk9kf\"" Jul 20 19:20:21.985014 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:21.984980 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lvbxg"] Jul 20 19:20:22.147133 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.147043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59e4485-5a66-4738-b598-28351918fe0e-tls-certs\") pod \"model-serving-api-54d89bd5fc-lvbxg\" (UID: \"f59e4485-5a66-4738-b598-28351918fe0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.147133 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.147114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn27w\" (UniqueName: \"kubernetes.io/projected/f59e4485-5a66-4738-b598-28351918fe0e-kube-api-access-tn27w\") pod \"model-serving-api-54d89bd5fc-lvbxg\" (UID: \"f59e4485-5a66-4738-b598-28351918fe0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.207875 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.207845 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-flp2h"] Jul 20 19:20:22.211843 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.211819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.216184 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.216159 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 19:20:22.216310 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.216159 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 19:20:22.216310 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.216161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 19:20:22.216691 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.216639 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8xt92\"" Jul 20 19:20:22.216691 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.216665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 19:20:22.237509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.237455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-flp2h"] Jul 20 19:20:22.247730 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.247701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn27w\" (UniqueName: \"kubernetes.io/projected/f59e4485-5a66-4738-b598-28351918fe0e-kube-api-access-tn27w\") pod \"model-serving-api-54d89bd5fc-lvbxg\" (UID: \"f59e4485-5a66-4738-b598-28351918fe0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.247894 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.247797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59e4485-5a66-4738-b598-28351918fe0e-tls-certs\") pod \"model-serving-api-54d89bd5fc-lvbxg\" (UID: \"f59e4485-5a66-4738-b598-28351918fe0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.250867 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.250843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59e4485-5a66-4738-b598-28351918fe0e-tls-certs\") pod \"model-serving-api-54d89bd5fc-lvbxg\" (UID: \"f59e4485-5a66-4738-b598-28351918fe0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.258543 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.258520 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn27w\" (UniqueName: \"kubernetes.io/projected/f59e4485-5a66-4738-b598-28351918fe0e-kube-api-access-tn27w\") pod \"model-serving-api-54d89bd5fc-lvbxg\" (UID: \"f59e4485-5a66-4738-b598-28351918fe0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.275262 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.275231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:22.349319 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.349515 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbg7\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-kube-api-access-jhbg7\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.349515 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-local-certs\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.349515 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.349679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-token\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.349679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.349679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.349569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-cacerts\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.430154 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.430029 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lvbxg"] Jul 20 19:20:22.432752 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:22.432711 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59e4485_5a66_4738_b598_28351918fe0e.slice/crio-c6483a13c2df4e15572862311361da77409dbf3841b90901c6a07d1723580f62 WatchSource:0}: Error finding container c6483a13c2df4e15572862311361da77409dbf3841b90901c6a07d1723580f62: Status 404 returned error can't find the container with id c6483a13c2df4e15572862311361da77409dbf3841b90901c6a07d1723580f62 Jul 20 19:20:22.450166 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.450273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-token\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.450273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.450273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-cacerts\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.450435 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.450506 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbg7\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-kube-api-access-jhbg7\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.450565 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.450544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-local-certs\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.451033 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.451012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.452690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.452661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.452690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.452675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.453011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.452992 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-local-certs\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.453102 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.453084 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-cacerts\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.458648 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.458625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbg7\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-kube-api-access-jhbg7\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.458728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.458663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-token\") pod \"istiod-openshift-gateway-7574459656-flp2h\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.524175 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.524142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:22.546101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.546068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" event={"ID":"f59e4485-5a66-4738-b598-28351918fe0e","Type":"ContainerStarted","Data":"c6483a13c2df4e15572862311361da77409dbf3841b90901c6a07d1723580f62"} Jul 20 19:20:22.547250 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.547223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" event={"ID":"1334545e-9b62-4e6b-a003-9ea573d87c69","Type":"ContainerStarted","Data":"f09e86cade3e60f72f495783f00a468601cf5c5ce12cea73e88dd2ff111cd3c4"} Jul 20 19:20:22.668648 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:22.668506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-flp2h"] Jul 20 19:20:22.671098 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:22.671067 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0522abd_d52e_4e6b_94fd_9c79b90f9fb7.slice/crio-e7e24a381f3b109cb3c77b537c19fc6063d243145cbeb80c2fa9a85c75d10186 WatchSource:0}: Error finding container e7e24a381f3b109cb3c77b537c19fc6063d243145cbeb80c2fa9a85c75d10186: Status 404 returned error can't find the container with id e7e24a381f3b109cb3c77b537c19fc6063d243145cbeb80c2fa9a85c75d10186 Jul 20 19:20:23.554547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:23.554484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" event={"ID":"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7","Type":"ContainerStarted","Data":"e7e24a381f3b109cb3c77b537c19fc6063d243145cbeb80c2fa9a85c75d10186"} Jul 20 19:20:27.018681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.018630 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:20:27.018972 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.018731 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:20:27.576626 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.576590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" event={"ID":"f59e4485-5a66-4738-b598-28351918fe0e","Type":"ContainerStarted","Data":"daaafcb4b3ec2b117d4ab7c806de261e6ad1749e9e85c15dbbd7ee64dfc867c7"} Jul 20 19:20:27.576832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.576702 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:20:27.578309 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.578282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" event={"ID":"1334545e-9b62-4e6b-a003-9ea573d87c69","Type":"ContainerStarted","Data":"767291f82d29848e9f6744cc36391c779b9e674778c66e60ee1d4a96399af182"} Jul 20 19:20:27.578430 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.578335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:27.579862 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.579839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" event={"ID":"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7","Type":"ContainerStarted","Data":"c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66"} Jul 20 19:20:27.579982 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.579909 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:27.581331 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.581313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" event={"ID":"9ff2ecee-451e-4cc7-8f80-3213faeeb76c","Type":"ContainerStarted","Data":"13d61dc1fb32f4516714cb1b3140cccdaf7a9daa46e7feaa0b371b57c8a145b4"} Jul 20 19:20:27.609120 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.609065 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" podStartSLOduration=2.088146899 podStartE2EDuration="6.609051121s" totalImagesPullingTime="4.520904222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:27.608734611 +0000 UTC m=+329.001474146" watchObservedRunningTime="2026-07-20 19:20:27.609051121 +0000 UTC m=+329.001790653" Jul 20 19:20:27.664849 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.664792 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6469fb7d96-rwlks" podStartSLOduration=3.164535326 podStartE2EDuration="7.664773556s" totalImagesPullingTime="4.50023823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:27.664107086 +0000 UTC m=+329.056846624" watchObservedRunningTime="2026-07-20 19:20:27.664773556 +0000 UTC m=+329.057513089" Jul 20 19:20:27.665593 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.665565 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" podStartSLOduration=2.58770315 podStartE2EDuration="7.665555279s" totalImagesPullingTime="5.077852129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:27.642656429 +0000 UTC m=+329.035395965" watchObservedRunningTime="2026-07-20 19:20:27.665555279 +0000 UTC m=+329.058294811" Jul 20 19:20:27.688512 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:27.688425 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" podStartSLOduration=1.343301867 podStartE2EDuration="5.688402679s" totalImagesPullingTime="4.345100812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:27.688001193 +0000 UTC m=+329.080740723" watchObservedRunningTime="2026-07-20 19:20:27.688402679 +0000 UTC m=+329.081142213" Jul 20 19:20:28.587699 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.587668 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-flp2h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 19:20:28.588059 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.587719 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" podUID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:20:28.733387 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.733342 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb"] Jul 20 19:20:28.737045 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.737016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.740855 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.740833 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5tjkj\"" Jul 20 19:20:28.761215 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.761179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb"] Jul 20 19:20:28.804651 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.804651 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.804889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.804889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6832cf-bb34-4165-9c2c-05836cb905c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.804889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.804889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.804889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2pg\" (UniqueName: \"kubernetes.io/projected/9b6832cf-bb34-4165-9c2c-05836cb905c2-kube-api-access-ql2pg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.805112 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.805112 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.804924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2pg\" (UniqueName: \"kubernetes.io/projected/9b6832cf-bb34-4165-9c2c-05836cb905c2-kube-api-access-ql2pg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6832cf-bb34-4165-9c2c-05836cb905c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.905806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.906043 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.906043 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.905934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.906144 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.906084 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.906206 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.906153 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.906463 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.906441 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6832cf-bb34-4165-9c2c-05836cb905c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.907850 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.907829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.908169 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.908151 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.934848 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.934816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6832cf-bb34-4165-9c2c-05836cb905c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:28.940072 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:28.940046 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2pg\" (UniqueName: \"kubernetes.io/projected/9b6832cf-bb34-4165-9c2c-05836cb905c2-kube-api-access-ql2pg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xg6cb\" (UID: \"9b6832cf-bb34-4165-9c2c-05836cb905c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:29.048420 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:29.048188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:29.229676 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:29.229647 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb"] Jul 20 19:20:29.231244 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:29.231216 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6832cf_bb34_4165_9c2c_05836cb905c2.slice/crio-e265a2301697a374bbce1a111457343ae42886c7fad4f4faa4ce8e0a13ab8bb6 WatchSource:0}: Error finding container e265a2301697a374bbce1a111457343ae42886c7fad4f4faa4ce8e0a13ab8bb6: Status 404 returned error can't find the container with id e265a2301697a374bbce1a111457343ae42886c7fad4f4faa4ce8e0a13ab8bb6 Jul 20 19:20:29.591645 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:29.591606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" event={"ID":"9b6832cf-bb34-4165-9c2c-05836cb905c2","Type":"ContainerStarted","Data":"e265a2301697a374bbce1a111457343ae42886c7fad4f4faa4ce8e0a13ab8bb6"} Jul 20 19:20:31.586756 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:31.586723 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:31.758555 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:31.758517 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:20:31.758688 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:31.758610 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:20:31.758688 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:31.758654 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:20:32.469099 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.469057 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6"] Jul 20 19:20:32.473103 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.473075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.477192 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.477138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 20 19:20:32.477579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.477559 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-27kk8\"" Jul 20 19:20:32.512715 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.512676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6"] Jul 20 19:20:32.529260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.529222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwnv\" (UniqueName: \"kubernetes.io/projected/a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da-kube-api-access-jbwnv\") pod \"llmisvc-controller-manager-777c6bd7d5-qslw6\" (UID: \"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.529260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.529263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qslw6\" (UID: \"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.608602 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.608556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" event={"ID":"9b6832cf-bb34-4165-9c2c-05836cb905c2","Type":"ContainerStarted","Data":"9f7217fdffc1049a27bb3c35f5cd0ef6528d1049ed1798bd941131ebafca6d03"} Jul 20 19:20:32.630063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.630019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwnv\" (UniqueName: \"kubernetes.io/projected/a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da-kube-api-access-jbwnv\") pod \"llmisvc-controller-manager-777c6bd7d5-qslw6\" (UID: \"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.630063 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.630064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qslw6\" (UID: \"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.632705 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.632676 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qslw6\" (UID: \"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.644113 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.644087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwnv\" (UniqueName: \"kubernetes.io/projected/a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da-kube-api-access-jbwnv\") pod \"llmisvc-controller-manager-777c6bd7d5-qslw6\" (UID: \"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.665012 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.664952 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" podStartSLOduration=2.140028638 podStartE2EDuration="4.664933941s" totalImagesPullingTime="2.524905303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:32.662598212 +0000 UTC m=+334.055337745" watchObservedRunningTime="2026-07-20 19:20:32.664933941 +0000 UTC m=+334.057673474" Jul 20 19:20:32.782969 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.782932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:32.848019 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.847971 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-flp2h"] Jul 20 19:20:32.848225 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.848195 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" podUID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" containerName="discovery" containerID="cri-o://c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66" gracePeriod=30 Jul 20 19:20:32.985031 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:32.984996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6"] Jul 20 19:20:32.988940 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:20:32.988909 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda86050fe_ffc2_4f0d_9f5e_9aa471bbc4da.slice/crio-a92ec70881d338f2e3ac09796d23c5c242dfcf65f06f51d6f0a0d71368ff5e6f WatchSource:0}: Error finding container a92ec70881d338f2e3ac09796d23c5c242dfcf65f06f51d6f0a0d71368ff5e6f: Status 404 returned error can't find the container with id a92ec70881d338f2e3ac09796d23c5c242dfcf65f06f51d6f0a0d71368ff5e6f Jul 20 19:20:33.048940 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.048861 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:33.054110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.054082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:33.100824 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.100797 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:33.135524 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135467 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-ca-configmap\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-cacerts\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135557 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-kubeconfig\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135619 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-local-certs\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135802 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135730 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-dns-cert\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135802 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135773 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhbg7\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-kube-api-access-jhbg7\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135876 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135819 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-token\") pod \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\" (UID: \"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7\") " Jul 20 19:20:33.135936 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.135894 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:20:33.136181 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.136150 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-ca-configmap\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.137969 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.137923 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-local-certs" (OuterVolumeSpecName: "local-certs") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:20:33.138061 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.137969 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:20:33.138269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.138240 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-cacerts" (OuterVolumeSpecName: "cacerts") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:20:33.138269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.138266 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-kube-api-access-jhbg7" (OuterVolumeSpecName: "kube-api-access-jhbg7") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "kube-api-access-jhbg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:20:33.138409 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.138293 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:20:33.138409 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.138319 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" (UID: "a0522abd-d52e-4e6b-94fd-9c79b90f9fb7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:20:33.237414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.237372 2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-local-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.237414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.237406 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-csr-dns-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.237414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.237421 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhbg7\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-kube-api-access-jhbg7\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.237707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.237436 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.237707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.237447 2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-cacerts\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.237707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.237460 2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7-istio-kubeconfig\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:20:33.617036 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.617002 2576 generic.go:356] "Generic (PLEG): container finished" podID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" containerID="c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66" exitCode=0 Jul 20 19:20:33.617487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.617049 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" Jul 20 19:20:33.617487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.617080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" event={"ID":"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7","Type":"ContainerDied","Data":"c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66"} Jul 20 19:20:33.617487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.617132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-flp2h" event={"ID":"a0522abd-d52e-4e6b-94fd-9c79b90f9fb7","Type":"ContainerDied","Data":"e7e24a381f3b109cb3c77b537c19fc6063d243145cbeb80c2fa9a85c75d10186"} Jul 20 19:20:33.617487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.617156 2576 scope.go:117] "RemoveContainer" containerID="c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66" Jul 20 19:20:33.618547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.618524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" event={"ID":"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da","Type":"ContainerStarted","Data":"a92ec70881d338f2e3ac09796d23c5c242dfcf65f06f51d6f0a0d71368ff5e6f"} Jul 20 19:20:33.618782 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.618762 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:33.619953 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.619933 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xg6cb" Jul 20 19:20:33.650252 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.650232 2576 scope.go:117] "RemoveContainer" containerID="c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66" Jul 20 19:20:33.650755 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:20:33.650727 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66\": container with ID starting with c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66 not found: ID does not exist" containerID="c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66" Jul 20 19:20:33.650904 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.650768 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66"} err="failed to get container status \"c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66\": rpc error: code = NotFound desc = could not find container \"c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66\": container with ID starting with c4c9c92ca62c0bec6f9ed9d5bd2839317edbe170654efd8e503d6fa93865ed66 not found: ID does not exist" Jul 20 19:20:33.696748 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.696712 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-flp2h"] Jul 20 19:20:33.712350 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:33.712308 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-flp2h"] Jul 20 19:20:35.042461 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:35.042423 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" path="/var/lib/kubelet/pods/a0522abd-d52e-4e6b-94fd-9c79b90f9fb7/volumes" Jul 20 19:20:36.640273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:36.640234 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" event={"ID":"a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da","Type":"ContainerStarted","Data":"28575a65d357fc848ead77674cb580269e0cbf64ca300ad39943538368bd71d0"} Jul 20 19:20:36.640780 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:36.640355 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:20:36.668558 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:36.668484 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" podStartSLOduration=1.440367006 podStartE2EDuration="4.668468982s" totalImagesPullingTime="3.228101976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:36.666453248 +0000 UTC m=+338.059192781" watchObservedRunningTime="2026-07-20 19:20:36.668468982 +0000 UTC m=+338.061208515" Jul 20 19:20:38.588181 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:38.588153 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zpl5s" Jul 20 19:20:38.590076 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:20:38.590058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lvbxg" Jul 20 19:21:07.646174 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:07.646140 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qslw6" Jul 20 19:21:21.122429 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.122395 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntd9w"] Jul 20 19:21:21.122817 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.122736 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" containerName="discovery" Jul 20 19:21:21.122817 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.122747 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" containerName="discovery" Jul 20 19:21:21.122817 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.122815 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0522abd-d52e-4e6b-94fd-9c79b90f9fb7" containerName="discovery" Jul 20 19:21:21.126213 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.126187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:21.129051 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.129018 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 19:21:21.129051 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.129035 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mhkbs\"" Jul 20 19:21:21.130144 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.130123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 19:21:21.141323 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.141299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntd9w"] Jul 20 19:21:21.255840 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.255806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv5b8\" (UniqueName: \"kubernetes.io/projected/49cb5e79-7a4a-406c-a86a-6446bfb4aadf-kube-api-access-vv5b8\") pod \"kuadrant-operator-catalog-ntd9w\" (UID: \"49cb5e79-7a4a-406c-a86a-6446bfb4aadf\") " pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:21.357244 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.357206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5b8\" (UniqueName: \"kubernetes.io/projected/49cb5e79-7a4a-406c-a86a-6446bfb4aadf-kube-api-access-vv5b8\") pod \"kuadrant-operator-catalog-ntd9w\" (UID: \"49cb5e79-7a4a-406c-a86a-6446bfb4aadf\") " pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:21.367786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.367755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv5b8\" (UniqueName: \"kubernetes.io/projected/49cb5e79-7a4a-406c-a86a-6446bfb4aadf-kube-api-access-vv5b8\") pod \"kuadrant-operator-catalog-ntd9w\" (UID: \"49cb5e79-7a4a-406c-a86a-6446bfb4aadf\") " pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:21.436791 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.436707 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:21.487696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.487640 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntd9w"] Jul 20 19:21:21.576428 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.576402 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntd9w"] Jul 20 19:21:21.579292 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:21:21.579261 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49cb5e79_7a4a_406c_a86a_6446bfb4aadf.slice/crio-4b6b29ca83050338ee514fb05a694db86e7e8bd9e2bc216e5831e24809fec8d8 WatchSource:0}: Error finding container 4b6b29ca83050338ee514fb05a694db86e7e8bd9e2bc216e5831e24809fec8d8: Status 404 returned error can't find the container with id 4b6b29ca83050338ee514fb05a694db86e7e8bd9e2bc216e5831e24809fec8d8 Jul 20 19:21:21.695539 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.695448 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7c8rv"] Jul 20 19:21:21.699977 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.699958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:21.711322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.711287 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7c8rv"] Jul 20 19:21:21.844713 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.844678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" event={"ID":"49cb5e79-7a4a-406c-a86a-6446bfb4aadf","Type":"ContainerStarted","Data":"4b6b29ca83050338ee514fb05a694db86e7e8bd9e2bc216e5831e24809fec8d8"} Jul 20 19:21:21.861600 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.861568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7pzv\" (UniqueName: \"kubernetes.io/projected/6e29bf11-751f-4c86-b4a2-bc74a92e5b99-kube-api-access-n7pzv\") pod \"kuadrant-operator-catalog-7c8rv\" (UID: \"6e29bf11-751f-4c86-b4a2-bc74a92e5b99\") " pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:21.962279 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.962178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7pzv\" (UniqueName: \"kubernetes.io/projected/6e29bf11-751f-4c86-b4a2-bc74a92e5b99-kube-api-access-n7pzv\") pod \"kuadrant-operator-catalog-7c8rv\" (UID: \"6e29bf11-751f-4c86-b4a2-bc74a92e5b99\") " pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:21.970954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:21.970923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7pzv\" (UniqueName: \"kubernetes.io/projected/6e29bf11-751f-4c86-b4a2-bc74a92e5b99-kube-api-access-n7pzv\") pod \"kuadrant-operator-catalog-7c8rv\" (UID: \"6e29bf11-751f-4c86-b4a2-bc74a92e5b99\") " pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:22.009770 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:22.009733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:22.147812 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:22.147787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7c8rv"] Jul 20 19:21:22.150432 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:21:22.150401 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e29bf11_751f_4c86_b4a2_bc74a92e5b99.slice/crio-6ef21e84f36dd7a24ad774f2a35238218e21e74242dd4a849966aa883c6be529 WatchSource:0}: Error finding container 6ef21e84f36dd7a24ad774f2a35238218e21e74242dd4a849966aa883c6be529: Status 404 returned error can't find the container with id 6ef21e84f36dd7a24ad774f2a35238218e21e74242dd4a849966aa883c6be529 Jul 20 19:21:22.851577 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:22.851534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" event={"ID":"6e29bf11-751f-4c86-b4a2-bc74a92e5b99","Type":"ContainerStarted","Data":"6ef21e84f36dd7a24ad774f2a35238218e21e74242dd4a849966aa883c6be529"} Jul 20 19:21:24.863192 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:24.863152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" event={"ID":"6e29bf11-751f-4c86-b4a2-bc74a92e5b99","Type":"ContainerStarted","Data":"689736f91c48971f602c382667674fd49454cb556bac54fdb69cec0c4b9e2fed"} Jul 20 19:21:24.864648 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:24.864625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" event={"ID":"49cb5e79-7a4a-406c-a86a-6446bfb4aadf","Type":"ContainerStarted","Data":"a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1"} Jul 20 19:21:24.864745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:24.864659 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" podUID="49cb5e79-7a4a-406c-a86a-6446bfb4aadf" containerName="registry-server" containerID="cri-o://a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1" gracePeriod=2 Jul 20 19:21:24.879209 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:24.879156 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" podStartSLOduration=2.105006332 podStartE2EDuration="3.879135633s" totalImagesPullingTime="1.774129301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:21:24.878378077 +0000 UTC m=+386.271117607" watchObservedRunningTime="2026-07-20 19:21:24.879135633 +0000 UTC m=+386.271875167" Jul 20 19:21:24.925743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:24.925690 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" podStartSLOduration=1.5834671569999998 podStartE2EDuration="3.925671856s" totalImagesPullingTime="2.342204699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:21:24.923772324 +0000 UTC m=+386.316511858" watchObservedRunningTime="2026-07-20 19:21:24.925671856 +0000 UTC m=+386.318411400" Jul 20 19:21:25.115212 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.115133 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:25.294021 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.293983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv5b8\" (UniqueName: \"kubernetes.io/projected/49cb5e79-7a4a-406c-a86a-6446bfb4aadf-kube-api-access-vv5b8\") pod \"49cb5e79-7a4a-406c-a86a-6446bfb4aadf\" (UID: \"49cb5e79-7a4a-406c-a86a-6446bfb4aadf\") " Jul 20 19:21:25.296282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.296246 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49cb5e79-7a4a-406c-a86a-6446bfb4aadf-kube-api-access-vv5b8" (OuterVolumeSpecName: "kube-api-access-vv5b8") pod "49cb5e79-7a4a-406c-a86a-6446bfb4aadf" (UID: "49cb5e79-7a4a-406c-a86a-6446bfb4aadf"). InnerVolumeSpecName "kube-api-access-vv5b8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:21:25.395074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.394987 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv5b8\" (UniqueName: \"kubernetes.io/projected/49cb5e79-7a4a-406c-a86a-6446bfb4aadf-kube-api-access-vv5b8\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:21:25.870105 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.870072 2576 generic.go:356] "Generic (PLEG): container finished" podID="49cb5e79-7a4a-406c-a86a-6446bfb4aadf" containerID="a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1" exitCode=0 Jul 20 19:21:25.870609 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.870126 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" Jul 20 19:21:25.870609 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.870151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" event={"ID":"49cb5e79-7a4a-406c-a86a-6446bfb4aadf","Type":"ContainerDied","Data":"a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1"} Jul 20 19:21:25.870609 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.870198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ntd9w" event={"ID":"49cb5e79-7a4a-406c-a86a-6446bfb4aadf","Type":"ContainerDied","Data":"4b6b29ca83050338ee514fb05a694db86e7e8bd9e2bc216e5831e24809fec8d8"} Jul 20 19:21:25.870609 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.870219 2576 scope.go:117] "RemoveContainer" containerID="a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1" Jul 20 19:21:25.879649 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.879632 2576 scope.go:117] "RemoveContainer" containerID="a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1" Jul 20 19:21:25.879968 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:21:25.879949 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1\": container with ID starting with a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1 not found: ID does not exist" containerID="a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1" Jul 20 19:21:25.880020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.879976 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1"} err="failed to get container status \"a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1\": rpc error: code = NotFound desc = could not find container \"a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1\": container with ID starting with a9f66fea401fae61cdf8941121ddfee88d021696418b8e72bc5f3796cef215a1 not found: ID does not exist" Jul 20 19:21:25.893277 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.893249 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntd9w"] Jul 20 19:21:25.898745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:25.898711 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ntd9w"] Jul 20 19:21:27.042062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:27.042030 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49cb5e79-7a4a-406c-a86a-6446bfb4aadf" path="/var/lib/kubelet/pods/49cb5e79-7a4a-406c-a86a-6446bfb4aadf/volumes" Jul 20 19:21:32.010123 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:32.010071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:32.010652 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:32.010158 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:32.033231 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:32.033204 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:32.925258 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:32.925230 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7c8rv" Jul 20 19:21:55.007706 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.007671 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq"] Jul 20 19:21:55.008096 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.008037 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49cb5e79-7a4a-406c-a86a-6446bfb4aadf" containerName="registry-server" Jul 20 19:21:55.008096 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.008049 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49cb5e79-7a4a-406c-a86a-6446bfb4aadf" containerName="registry-server" Jul 20 19:21:55.008171 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.008101 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="49cb5e79-7a4a-406c-a86a-6446bfb4aadf" containerName="registry-server" Jul 20 19:21:55.016469 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.016445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.019537 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.019518 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xhgnr\"" Jul 20 19:21:55.035729 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.035701 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq"] Jul 20 19:21:55.046863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.046831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.047011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.046871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsc2t\" (UniqueName: \"kubernetes.io/projected/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-kube-api-access-zsc2t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.148211 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.148165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.148211 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.148210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsc2t\" (UniqueName: \"kubernetes.io/projected/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-kube-api-access-zsc2t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.148608 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.148587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.165160 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.165135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsc2t\" (UniqueName: \"kubernetes.io/projected/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-kube-api-access-zsc2t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.326628 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.326586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:21:55.485474 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:55.485447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq"] Jul 20 19:21:55.487756 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:21:55.487725 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de47ddd_0eb0_4b3c_acff_eec0ac6aa9bb.slice/crio-e7548734df06cc2016c07454b297088be46bca1caf2f7e5d04ba3bfa51156a02 WatchSource:0}: Error finding container e7548734df06cc2016c07454b297088be46bca1caf2f7e5d04ba3bfa51156a02: Status 404 returned error can't find the container with id e7548734df06cc2016c07454b297088be46bca1caf2f7e5d04ba3bfa51156a02 Jul 20 19:21:56.011139 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:56.011107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" event={"ID":"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb","Type":"ContainerStarted","Data":"e7548734df06cc2016c07454b297088be46bca1caf2f7e5d04ba3bfa51156a02"} Jul 20 19:21:57.156095 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.156054 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf"] Jul 20 19:21:57.159976 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.159951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:21:57.166095 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.166070 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jcdgt\"" Jul 20 19:21:57.167654 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.167632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 19:21:57.197267 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.197232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf"] Jul 20 19:21:57.266419 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.266380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-289x2\" (UniqueName: \"kubernetes.io/projected/7f6125ef-af01-443c-99b0-ea72b386bd84-kube-api-access-289x2\") pod \"dns-operator-controller-manager-864dd78c4c-2sthf\" (UID: \"7f6125ef-af01-443c-99b0-ea72b386bd84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:21:57.367363 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.367328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-289x2\" (UniqueName: \"kubernetes.io/projected/7f6125ef-af01-443c-99b0-ea72b386bd84-kube-api-access-289x2\") pod \"dns-operator-controller-manager-864dd78c4c-2sthf\" (UID: \"7f6125ef-af01-443c-99b0-ea72b386bd84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:21:57.381537 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.381469 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-289x2\" (UniqueName: \"kubernetes.io/projected/7f6125ef-af01-443c-99b0-ea72b386bd84-kube-api-access-289x2\") pod \"dns-operator-controller-manager-864dd78c4c-2sthf\" (UID: \"7f6125ef-af01-443c-99b0-ea72b386bd84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:21:57.470784 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.470701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:21:57.614799 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:57.614772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf"] Jul 20 19:21:57.617688 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:21:57.617644 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6125ef_af01_443c_99b0_ea72b386bd84.slice/crio-05d39621f5660517c0103e150b36d6e3b3788d537462feff2d503078c0d16ca8 WatchSource:0}: Error finding container 05d39621f5660517c0103e150b36d6e3b3788d537462feff2d503078c0d16ca8: Status 404 returned error can't find the container with id 05d39621f5660517c0103e150b36d6e3b3788d537462feff2d503078c0d16ca8 Jul 20 19:21:58.023951 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:58.023908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" event={"ID":"7f6125ef-af01-443c-99b0-ea72b386bd84","Type":"ContainerStarted","Data":"05d39621f5660517c0103e150b36d6e3b3788d537462feff2d503078c0d16ca8"} Jul 20 19:21:59.642752 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.642725 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 19:21:59.793601 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.793560 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn"] Jul 20 19:21:59.797171 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.797137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:21:59.800616 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.800587 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xcw75\"" Jul 20 19:21:59.811409 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.811381 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn"] Jul 20 19:21:59.892029 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.891937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4rj\" (UniqueName: \"kubernetes.io/projected/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9-kube-api-access-ks4rj\") pod \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" (UID: \"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:21:59.992959 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:21:59.992916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4rj\" (UniqueName: \"kubernetes.io/projected/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9-kube-api-access-ks4rj\") pod \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" (UID: \"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:00.010225 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:00.010188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4rj\" (UniqueName: \"kubernetes.io/projected/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9-kube-api-access-ks4rj\") pod \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" (UID: \"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:00.035511 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:00.035466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" event={"ID":"7f6125ef-af01-443c-99b0-ea72b386bd84","Type":"ContainerStarted","Data":"03d2b5a9b5981f8cd7ed3c19fed181055546a78a93c30c8fe3366c0a6993f041"} Jul 20 19:22:00.035666 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:00.035572 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:22:00.067467 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:00.067415 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" podStartSLOduration=1.053231877 podStartE2EDuration="3.067394084s" totalImagesPullingTime="2.014162207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:00.066423379 +0000 UTC m=+421.459162908" watchObservedRunningTime="2026-07-20 19:22:00.067394084 +0000 UTC m=+421.460133617" Jul 20 19:22:00.113702 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:00.113658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:00.307445 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:00.307409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn"] Jul 20 19:22:00.310642 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:22:00.310600 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84bf48a_a3d1_4df2_89d5_18b9d4907fa9.slice/crio-43eaeb18c5a652d6b156142bf8a9c4d7445080856b3662b154583d990607b9db WatchSource:0}: Error finding container 43eaeb18c5a652d6b156142bf8a9c4d7445080856b3662b154583d990607b9db: Status 404 returned error can't find the container with id 43eaeb18c5a652d6b156142bf8a9c4d7445080856b3662b154583d990607b9db Jul 20 19:22:01.046195 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:01.046156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" event={"ID":"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9","Type":"ContainerStarted","Data":"43eaeb18c5a652d6b156142bf8a9c4d7445080856b3662b154583d990607b9db"} Jul 20 19:22:03.057878 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.057841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" event={"ID":"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb","Type":"ContainerStarted","Data":"1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462"} Jul 20 19:22:03.058332 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.057926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:03.059487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.059461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" event={"ID":"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9","Type":"ContainerStarted","Data":"b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060"} Jul 20 19:22:03.059667 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.059590 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:03.085732 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.085671 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" podStartSLOduration=1.6112942019999998 podStartE2EDuration="9.085475144s" totalImagesPullingTime="7.474180942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:03.08491411 +0000 UTC m=+424.477653643" watchObservedRunningTime="2026-07-20 19:22:03.085475144 +0000 UTC m=+424.478214678" Jul 20 19:22:03.115067 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.114984 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" podStartSLOduration=1.469964045 podStartE2EDuration="4.114964503s" totalImagesPullingTime="2.645000458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:03.112456326 +0000 UTC m=+424.505195860" watchObservedRunningTime="2026-07-20 19:22:03.114964503 +0000 UTC m=+424.507704037" Jul 20 19:22:03.268956 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.268859 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6"] Jul 20 19:22:03.272912 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.272886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:03.278844 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.278820 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fcrlh\"" Jul 20 19:22:03.289731 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.289698 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6"] Jul 20 19:22:03.320717 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.320674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddb7\" (UniqueName: \"kubernetes.io/projected/71a258a0-06b9-420f-886c-5b75afe1a6c6-kube-api-access-xddb7\") pod \"authorino-operator-75cc8d5cb7-gg8p6\" (UID: \"71a258a0-06b9-420f-886c-5b75afe1a6c6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:03.421902 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.421865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddb7\" (UniqueName: \"kubernetes.io/projected/71a258a0-06b9-420f-886c-5b75afe1a6c6-kube-api-access-xddb7\") pod \"authorino-operator-75cc8d5cb7-gg8p6\" (UID: \"71a258a0-06b9-420f-886c-5b75afe1a6c6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:03.437783 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.437755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddb7\" (UniqueName: \"kubernetes.io/projected/71a258a0-06b9-420f-886c-5b75afe1a6c6-kube-api-access-xddb7\") pod \"authorino-operator-75cc8d5cb7-gg8p6\" (UID: \"71a258a0-06b9-420f-886c-5b75afe1a6c6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:03.582919 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.582875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:03.753302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:03.753274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6"] Jul 20 19:22:03.756155 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:22:03.756128 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a258a0_06b9_420f_886c_5b75afe1a6c6.slice/crio-71d848988b6526d18ae4168e99baa54d37635546475340120d0cf89522bafcdd WatchSource:0}: Error finding container 71d848988b6526d18ae4168e99baa54d37635546475340120d0cf89522bafcdd: Status 404 returned error can't find the container with id 71d848988b6526d18ae4168e99baa54d37635546475340120d0cf89522bafcdd Jul 20 19:22:04.065694 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:04.065648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" event={"ID":"71a258a0-06b9-420f-886c-5b75afe1a6c6","Type":"ContainerStarted","Data":"71d848988b6526d18ae4168e99baa54d37635546475340120d0cf89522bafcdd"} Jul 20 19:22:07.083900 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:07.083857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" event={"ID":"71a258a0-06b9-420f-886c-5b75afe1a6c6","Type":"ContainerStarted","Data":"60902ee7be3c37d04a99f48bdf8d80a232e7479315dfc2b307763d751b00d681"} Jul 20 19:22:07.084302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:07.084051 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:07.111777 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:07.111724 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" podStartSLOduration=1.57916253 podStartE2EDuration="4.111707015s" totalImagesPullingTime="2.532544485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:07.109678942 +0000 UTC m=+428.502418475" watchObservedRunningTime="2026-07-20 19:22:07.111707015 +0000 UTC m=+428.504446547" Jul 20 19:22:11.048302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:11.048272 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sthf" Jul 20 19:22:14.067707 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:14.067672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:14.068102 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:14.067759 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:15.795984 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.795941 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq"] Jul 20 19:22:15.796553 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.796247 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" containerName="manager" containerID="cri-o://1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462" gracePeriod=2 Jul 20 19:22:15.798718 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.798691 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq"] Jul 20 19:22:15.798844 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.798733 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:15.832565 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.832528 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn"] Jul 20 19:22:15.832774 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.832749 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" containerName="manager" containerID="cri-o://b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060" gracePeriod=2 Jul 20 19:22:15.835176 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.835136 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2"] Jul 20 19:22:15.835882 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.835858 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" containerName="manager" Jul 20 19:22:15.835882 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.835884 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" containerName="manager" Jul 20 19:22:15.836031 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.836002 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" containerName="manager" Jul 20 19:22:15.839552 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.839427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:15.842142 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.842115 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn"] Jul 20 19:22:15.846849 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.846809 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-5p7fn\": pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:15.849331 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.849300 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:15.850477 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.850449 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2"] Jul 20 19:22:15.851895 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.851866 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:15.854043 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.854015 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:15.859092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.859069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4"] Jul 20 19:22:15.859425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.859412 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" containerName="manager" Jul 20 19:22:15.859425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.859426 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" containerName="manager" Jul 20 19:22:15.859624 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.859487 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" containerName="manager" Jul 20 19:22:15.862730 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.862708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:15.875846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.875806 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4"] Jul 20 19:22:15.880881 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.880846 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:15.883516 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:15.883463 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:15.939240 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.939215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/491378bf-cf86-4a29-91d6-12673b9c7b52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-62jm2\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:15.939341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.939321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlg55\" (UniqueName: \"kubernetes.io/projected/b8f9352e-fc77-45e4-9f73-dfaa27b83c36-kube-api-access-jlg55\") pod \"limitador-operator-controller-manager-859d7b78bd-s7ws4\" (UID: \"b8f9352e-fc77-45e4-9f73-dfaa27b83c36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:15.939401 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:15.939387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jmr\" (UniqueName: \"kubernetes.io/projected/491378bf-cf86-4a29-91d6-12673b9c7b52-kube-api-access-52jmr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-62jm2\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:16.039971 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.039939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/491378bf-cf86-4a29-91d6-12673b9c7b52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-62jm2\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:16.040156 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.040024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlg55\" (UniqueName: \"kubernetes.io/projected/b8f9352e-fc77-45e4-9f73-dfaa27b83c36-kube-api-access-jlg55\") pod \"limitador-operator-controller-manager-859d7b78bd-s7ws4\" (UID: \"b8f9352e-fc77-45e4-9f73-dfaa27b83c36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:16.040156 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.040054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jmr\" (UniqueName: \"kubernetes.io/projected/491378bf-cf86-4a29-91d6-12673b9c7b52-kube-api-access-52jmr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-62jm2\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:16.040422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.040398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/491378bf-cf86-4a29-91d6-12673b9c7b52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-62jm2\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:16.051283 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.051207 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jmr\" (UniqueName: \"kubernetes.io/projected/491378bf-cf86-4a29-91d6-12673b9c7b52-kube-api-access-52jmr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-62jm2\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:16.051412 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.051353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlg55\" (UniqueName: \"kubernetes.io/projected/b8f9352e-fc77-45e4-9f73-dfaa27b83c36-kube-api-access-jlg55\") pod \"limitador-operator-controller-manager-859d7b78bd-s7ws4\" (UID: \"b8f9352e-fc77-45e4-9f73-dfaa27b83c36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:16.083892 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.083866 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.086068 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.086043 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.086667 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.086638 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.089030 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.089004 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.091394 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.091369 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.094403 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.094382 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.129274 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.129239 2576 generic.go:356] "Generic (PLEG): container finished" podID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" containerID="b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060" exitCode=0 Jul 20 19:22:16.129398 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.129285 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.129398 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.129341 2576 scope.go:117] "RemoveContainer" containerID="b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060" Jul 20 19:22:16.130833 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.130813 2576 generic.go:356] "Generic (PLEG): container finished" podID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" containerID="1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462" exitCode=0 Jul 20 19:22:16.130941 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.130851 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.131869 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.131844 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.134099 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.134074 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.136245 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.136220 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.138092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.138077 2576 scope.go:117] "RemoveContainer" containerID="b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060" Jul 20 19:22:16.138408 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.138388 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060\": container with ID starting with b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060 not found: ID does not exist" containerID="b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060" Jul 20 19:22:16.138470 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.138419 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060"} err="failed to get container status \"b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060\": rpc error: code = NotFound desc = could not find container \"b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060\": container with ID starting with b0b2cd28d20a4025022f35f3ed2a7a097ba49b0c4bd2dd2a25baabcca60b4060 not found: ID does not exist" Jul 20 19:22:16.138470 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.138441 2576 scope.go:117] "RemoveContainer" containerID="1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462" Jul 20 19:22:16.138565 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.138462 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.146742 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.146725 2576 scope.go:117] "RemoveContainer" containerID="1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462" Jul 20 19:22:16.147057 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.147037 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462\": container with ID starting with 1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462 not found: ID does not exist" containerID="1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462" Jul 20 19:22:16.147118 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.147065 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462"} err="failed to get container status \"1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462\": rpc error: code = NotFound desc = could not find container \"1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462\": container with ID starting with 1b854f9678e65bf1905e7d4aa6285290bb134d03c3e822a43a58ad8e45808462 not found: ID does not exist" Jul 20 19:22:16.217066 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.217024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:16.223294 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.223273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:16.241428 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.241401 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsc2t\" (UniqueName: \"kubernetes.io/projected/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-kube-api-access-zsc2t\") pod \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " Jul 20 19:22:16.241553 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.241459 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-extensions-socket-volume\") pod \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\" (UID: \"6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb\") " Jul 20 19:22:16.241553 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.241503 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks4rj\" (UniqueName: \"kubernetes.io/projected/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9-kube-api-access-ks4rj\") pod \"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9\" (UID: \"b84bf48a-a3d1-4df2-89d5-18b9d4907fa9\") " Jul 20 19:22:16.241976 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.241946 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" (UID: "6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:22:16.243577 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.243547 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-kube-api-access-zsc2t" (OuterVolumeSpecName: "kube-api-access-zsc2t") pod "6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" (UID: "6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb"). InnerVolumeSpecName "kube-api-access-zsc2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:22:16.244036 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.244011 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9-kube-api-access-ks4rj" (OuterVolumeSpecName: "kube-api-access-ks4rj") pod "b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" (UID: "b84bf48a-a3d1-4df2-89d5-18b9d4907fa9"). InnerVolumeSpecName "kube-api-access-ks4rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:22:16.343269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.343192 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsc2t\" (UniqueName: \"kubernetes.io/projected/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-kube-api-access-zsc2t\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:22:16.343269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.343229 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb-extensions-socket-volume\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:22:16.343269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.343244 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks4rj\" (UniqueName: \"kubernetes.io/projected/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9-kube-api-access-ks4rj\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:22:16.381127 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.381098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2"] Jul 20 19:22:16.381473 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:22:16.381451 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491378bf_cf86_4a29_91d6_12673b9c7b52.slice/crio-b29c0dad7bb79b65cb230be300a3c228fdbaa7867732c9c417ad0cf66e92c3a1 WatchSource:0}: Error finding container b29c0dad7bb79b65cb230be300a3c228fdbaa7867732c9c417ad0cf66e92c3a1: Status 404 returned error can't find the container with id b29c0dad7bb79b65cb230be300a3c228fdbaa7867732c9c417ad0cf66e92c3a1 Jul 20 19:22:16.396232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:16.396150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4"] Jul 20 19:22:16.399517 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:22:16.399475 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f9352e_fc77_45e4_9f73_dfaa27b83c36.slice/crio-0d0ddebb1b2136fb6d82d580e204e6ef52da836e72a3f3712fd799601a3ce79f WatchSource:0}: Error finding container 0d0ddebb1b2136fb6d82d580e204e6ef52da836e72a3f3712fd799601a3ce79f: Status 404 returned error can't find the container with id 0d0ddebb1b2136fb6d82d580e204e6ef52da836e72a3f3712fd799601a3ce79f Jul 20 19:22:16.444957 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.444927 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.446891 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.446866 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:16.449067 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.449044 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5p7fn\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5p7fn" Jul 20 19:22:16.451114 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:16.451083 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rczwq\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rczwq" Jul 20 19:22:17.042586 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.042557 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb" path="/var/lib/kubelet/pods/6de47ddd-0eb0-4b3c-acff-eec0ac6aa9bb/volumes" Jul 20 19:22:17.042957 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.042881 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84bf48a-a3d1-4df2-89d5-18b9d4907fa9" path="/var/lib/kubelet/pods/b84bf48a-a3d1-4df2-89d5-18b9d4907fa9/volumes" Jul 20 19:22:17.138231 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.138143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" event={"ID":"491378bf-cf86-4a29-91d6-12673b9c7b52","Type":"ContainerStarted","Data":"445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e"} Jul 20 19:22:17.138231 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.138194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" event={"ID":"491378bf-cf86-4a29-91d6-12673b9c7b52","Type":"ContainerStarted","Data":"b29c0dad7bb79b65cb230be300a3c228fdbaa7867732c9c417ad0cf66e92c3a1"} Jul 20 19:22:17.138455 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.138327 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:17.139831 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.139806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" event={"ID":"b8f9352e-fc77-45e4-9f73-dfaa27b83c36","Type":"ContainerStarted","Data":"c4fb0a017d7d15f2c81e8f0abf3562a8fadbc89bd06a3ae2f13dc78778bc78cc"} Jul 20 19:22:17.139952 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.139848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" event={"ID":"b8f9352e-fc77-45e4-9f73-dfaa27b83c36","Type":"ContainerStarted","Data":"0d0ddebb1b2136fb6d82d580e204e6ef52da836e72a3f3712fd799601a3ce79f"} Jul 20 19:22:17.139952 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.139902 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:17.184440 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.184384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" podStartSLOduration=2.184368256 podStartE2EDuration="2.184368256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:17.181838093 +0000 UTC m=+438.574577629" watchObservedRunningTime="2026-07-20 19:22:17.184368256 +0000 UTC m=+438.577107789" Jul 20 19:22:17.228373 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:17.228311 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" podStartSLOduration=2.228291744 podStartE2EDuration="2.228291744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:17.226245063 +0000 UTC m=+438.618984800" watchObservedRunningTime="2026-07-20 19:22:17.228291744 +0000 UTC m=+438.621031350" Jul 20 19:22:18.092118 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:18.092085 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg8p6" Jul 20 19:22:28.149890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:28.149798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7ws4" Jul 20 19:22:28.149890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:28.149887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:49.841644 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:49.841610 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2"] Jul 20 19:22:49.842104 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:49.841857 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" podUID="491378bf-cf86-4a29-91d6-12673b9c7b52" containerName="manager" containerID="cri-o://445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e" gracePeriod=10 Jul 20 19:22:50.096331 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.096258 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:50.142619 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.142586 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/491378bf-cf86-4a29-91d6-12673b9c7b52-extensions-socket-volume\") pod \"491378bf-cf86-4a29-91d6-12673b9c7b52\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " Jul 20 19:22:50.142832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.142643 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52jmr\" (UniqueName: \"kubernetes.io/projected/491378bf-cf86-4a29-91d6-12673b9c7b52-kube-api-access-52jmr\") pod \"491378bf-cf86-4a29-91d6-12673b9c7b52\" (UID: \"491378bf-cf86-4a29-91d6-12673b9c7b52\") " Jul 20 19:22:50.143104 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.143071 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491378bf-cf86-4a29-91d6-12673b9c7b52-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "491378bf-cf86-4a29-91d6-12673b9c7b52" (UID: "491378bf-cf86-4a29-91d6-12673b9c7b52"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:22:50.144829 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.144801 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491378bf-cf86-4a29-91d6-12673b9c7b52-kube-api-access-52jmr" (OuterVolumeSpecName: "kube-api-access-52jmr") pod "491378bf-cf86-4a29-91d6-12673b9c7b52" (UID: "491378bf-cf86-4a29-91d6-12673b9c7b52"). InnerVolumeSpecName "kube-api-access-52jmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:22:50.243529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.243455 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/491378bf-cf86-4a29-91d6-12673b9c7b52-extensions-socket-volume\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:22:50.243529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.243487 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52jmr\" (UniqueName: \"kubernetes.io/projected/491378bf-cf86-4a29-91d6-12673b9c7b52-kube-api-access-52jmr\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:22:50.307561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.307523 2576 generic.go:356] "Generic (PLEG): container finished" podID="491378bf-cf86-4a29-91d6-12673b9c7b52" containerID="445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e" exitCode=0 Jul 20 19:22:50.307760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.307567 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" Jul 20 19:22:50.307760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.307610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" event={"ID":"491378bf-cf86-4a29-91d6-12673b9c7b52","Type":"ContainerDied","Data":"445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e"} Jul 20 19:22:50.307760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.307697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2" event={"ID":"491378bf-cf86-4a29-91d6-12673b9c7b52","Type":"ContainerDied","Data":"b29c0dad7bb79b65cb230be300a3c228fdbaa7867732c9c417ad0cf66e92c3a1"} Jul 20 19:22:50.307760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.307727 2576 scope.go:117] "RemoveContainer" containerID="445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e" Jul 20 19:22:50.317215 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.317196 2576 scope.go:117] "RemoveContainer" containerID="445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e" Jul 20 19:22:50.317581 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:22:50.317560 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e\": container with ID starting with 445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e not found: ID does not exist" containerID="445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e" Jul 20 19:22:50.317646 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.317590 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e"} err="failed to get container status \"445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e\": rpc error: code = NotFound desc = could not find container \"445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e\": container with ID starting with 445b16cebe1bf4ec0249dd2b34395caced566ecddb5536c6f71871ff52ba1a7e not found: ID does not exist" Jul 20 19:22:50.342047 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.342013 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2"] Jul 20 19:22:50.345759 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:50.345729 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-62jm2"] Jul 20 19:22:51.042246 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:22:51.042215 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491378bf-cf86-4a29-91d6-12673b9c7b52" path="/var/lib/kubelet/pods/491378bf-cf86-4a29-91d6-12673b9c7b52/volumes" Jul 20 19:23:06.250969 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.250935 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp"] Jul 20 19:23:06.251422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.251355 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="491378bf-cf86-4a29-91d6-12673b9c7b52" containerName="manager" Jul 20 19:23:06.251422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.251369 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="491378bf-cf86-4a29-91d6-12673b9c7b52" containerName="manager" Jul 20 19:23:06.251548 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.251448 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="491378bf-cf86-4a29-91d6-12673b9c7b52" containerName="manager" Jul 20 19:23:06.255896 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.255877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.258776 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.258751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4xllv\"" Jul 20 19:23:06.273568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.273537 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp"] Jul 20 19:23:06.387576 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.387786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.387786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09824d4e-c75c-4a0f-be07-eed400cba7d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.387786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcdc\" (UniqueName: \"kubernetes.io/projected/09824d4e-c75c-4a0f-be07-eed400cba7d7-kube-api-access-qtcdc\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.387786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.387786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.388048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.388048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.388048 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.387925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.488745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.488745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09824d4e-c75c-4a0f-be07-eed400cba7d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcdc\" (UniqueName: \"kubernetes.io/projected/09824d4e-c75c-4a0f-be07-eed400cba7d7-kube-api-access-qtcdc\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.488913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489337 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.489165 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489389 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.489361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.489385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489544 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.489523 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.489790 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.489769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09824d4e-c75c-4a0f-be07-eed400cba7d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.491324 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.491288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.491680 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.491658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.497357 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.497327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcdc\" (UniqueName: \"kubernetes.io/projected/09824d4e-c75c-4a0f-be07-eed400cba7d7-kube-api-access-qtcdc\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.497593 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.497576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09824d4e-c75c-4a0f-be07-eed400cba7d7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kvnfp\" (UID: \"09824d4e-c75c-4a0f-be07-eed400cba7d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.572232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.572197 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:06.709975 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.709943 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp"] Jul 20 19:23:06.712177 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:06.712143 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09824d4e_c75c_4a0f_be07_eed400cba7d7.slice/crio-a10073b696cf45459c87c5103f1bdefdbf4f2b025ab9e88d2b53fbd83c11c8db WatchSource:0}: Error finding container a10073b696cf45459c87c5103f1bdefdbf4f2b025ab9e88d2b53fbd83c11c8db: Status 404 returned error can't find the container with id a10073b696cf45459c87c5103f1bdefdbf4f2b025ab9e88d2b53fbd83c11c8db Jul 20 19:23:06.714396 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.714356 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:23:06.714512 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.714454 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:23:06.714585 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:06.714541 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:23:07.397125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:07.397084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" event={"ID":"09824d4e-c75c-4a0f-be07-eed400cba7d7","Type":"ContainerStarted","Data":"b68c75ae8cceac555a11de263c355d94ebae2cb68b692773da6fa6fbc3a14e2c"} Jul 20 19:23:07.397622 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:07.397139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" event={"ID":"09824d4e-c75c-4a0f-be07-eed400cba7d7","Type":"ContainerStarted","Data":"a10073b696cf45459c87c5103f1bdefdbf4f2b025ab9e88d2b53fbd83c11c8db"} Jul 20 19:23:07.417225 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:07.417179 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" podStartSLOduration=1.417163306 podStartE2EDuration="1.417163306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:07.416272402 +0000 UTC m=+488.809011937" watchObservedRunningTime="2026-07-20 19:23:07.417163306 +0000 UTC m=+488.809902838" Jul 20 19:23:07.572410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:07.572379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:07.577547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:07.577521 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:08.402025 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.401995 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:08.403123 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.403099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:23:08.764070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.763985 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:08.767485 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.767469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:08.770082 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.770053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 19:23:08.770189 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.770094 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5xgj\"" Jul 20 19:23:08.775105 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.775013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:08.859095 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.859064 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:08.908708 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.908677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5jl\" (UniqueName: \"kubernetes.io/projected/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-kube-api-access-qm5jl\") pod \"limitador-limitador-64c94fd64f-m6cm2\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:08.908902 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:08.908750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-config-file\") pod \"limitador-limitador-64c94fd64f-m6cm2\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:09.009816 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.009777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5jl\" (UniqueName: \"kubernetes.io/projected/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-kube-api-access-qm5jl\") pod \"limitador-limitador-64c94fd64f-m6cm2\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:09.009994 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.009858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-config-file\") pod \"limitador-limitador-64c94fd64f-m6cm2\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:09.010576 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.010552 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-config-file\") pod \"limitador-limitador-64c94fd64f-m6cm2\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:09.018740 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.018684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5jl\" (UniqueName: \"kubernetes.io/projected/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-kube-api-access-qm5jl\") pod \"limitador-limitador-64c94fd64f-m6cm2\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:09.079569 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.079520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:09.217005 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.216972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:09.220242 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:09.220212 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4f6cf0_e387_41b1_81d5_1c116c5c74cf.slice/crio-d56d2e03568ece78868fbf2acd549254797f464ba681391ce492438e7561f702 WatchSource:0}: Error finding container d56d2e03568ece78868fbf2acd549254797f464ba681391ce492438e7561f702: Status 404 returned error can't find the container with id d56d2e03568ece78868fbf2acd549254797f464ba681391ce492438e7561f702 Jul 20 19:23:09.408875 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.408835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" event={"ID":"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf","Type":"ContainerStarted","Data":"d56d2e03568ece78868fbf2acd549254797f464ba681391ce492438e7561f702"} Jul 20 19:23:09.817072 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.817034 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tjzdn"] Jul 20 19:23:09.821301 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.821280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:09.825168 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.825144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-crzwk\"" Jul 20 19:23:09.862890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.862852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tjzdn"] Jul 20 19:23:09.916579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:09.916530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46lk6\" (UniqueName: \"kubernetes.io/projected/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f-kube-api-access-46lk6\") pod \"authorino-75d556bd77-tjzdn\" (UID: \"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f\") " pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:10.018194 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:10.018146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46lk6\" (UniqueName: \"kubernetes.io/projected/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f-kube-api-access-46lk6\") pod \"authorino-75d556bd77-tjzdn\" (UID: \"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f\") " pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:10.028822 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:10.028792 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46lk6\" (UniqueName: \"kubernetes.io/projected/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f-kube-api-access-46lk6\") pod \"authorino-75d556bd77-tjzdn\" (UID: \"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f\") " pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:10.131137 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:10.131047 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:10.332591 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:10.332546 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tjzdn"] Jul 20 19:23:10.340034 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:10.339999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c7f07b6_a79f_4002_8b1b_dcd5d9132b3f.slice/crio-7c2538fc8f5fe406bda1327b2589fd437b87f7b04d7a562e9cd4d1274eaf5e8a WatchSource:0}: Error finding container 7c2538fc8f5fe406bda1327b2589fd437b87f7b04d7a562e9cd4d1274eaf5e8a: Status 404 returned error can't find the container with id 7c2538fc8f5fe406bda1327b2589fd437b87f7b04d7a562e9cd4d1274eaf5e8a Jul 20 19:23:10.416195 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:10.416097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tjzdn" event={"ID":"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f","Type":"ContainerStarted","Data":"7c2538fc8f5fe406bda1327b2589fd437b87f7b04d7a562e9cd4d1274eaf5e8a"} Jul 20 19:23:14.440990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:14.440949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" event={"ID":"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf","Type":"ContainerStarted","Data":"caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b"} Jul 20 19:23:14.441440 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:14.441121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:14.442439 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:14.442421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tjzdn" event={"ID":"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f","Type":"ContainerStarted","Data":"a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069"} Jul 20 19:23:14.457992 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:14.457938 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" podStartSLOduration=1.6898045640000001 podStartE2EDuration="6.457922985s" totalImagesPullingTime="4.768118421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:14.456923833 +0000 UTC m=+495.849663378" watchObservedRunningTime="2026-07-20 19:23:14.457922985 +0000 UTC m=+495.850662517" Jul 20 19:23:14.471060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:14.471007 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tjzdn" podStartSLOduration=1.758665505 podStartE2EDuration="5.47098707s" totalImagesPullingTime="3.712321565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:14.470314053 +0000 UTC m=+495.863053597" watchObservedRunningTime="2026-07-20 19:23:14.47098707 +0000 UTC m=+495.863726602" Jul 20 19:23:23.580326 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:23.580289 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:23.580800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:23.580480 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" podUID="6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" containerName="limitador" containerID="cri-o://caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b" gracePeriod=30 Jul 20 19:23:23.581187 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:23.581168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:24.133852 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.133826 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:24.151819 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.151742 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-config-file\") pod \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " Jul 20 19:23:24.151819 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.151800 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm5jl\" (UniqueName: \"kubernetes.io/projected/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-kube-api-access-qm5jl\") pod \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\" (UID: \"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf\") " Jul 20 19:23:24.152131 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.152101 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-config-file" (OuterVolumeSpecName: "config-file") pod "6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" (UID: "6a4f6cf0-e387-41b1-81d5-1c116c5c74cf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:23:24.154199 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.154169 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-kube-api-access-qm5jl" (OuterVolumeSpecName: "kube-api-access-qm5jl") pod "6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" (UID: "6a4f6cf0-e387-41b1-81d5-1c116c5c74cf"). InnerVolumeSpecName "kube-api-access-qm5jl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:23:24.252802 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.252766 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-config-file\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:23:24.252802 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.252794 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm5jl\" (UniqueName: \"kubernetes.io/projected/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf-kube-api-access-qm5jl\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:23:24.493242 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.493139 2576 generic.go:356] "Generic (PLEG): container finished" podID="6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" containerID="caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b" exitCode=0 Jul 20 19:23:24.493242 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.493180 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" Jul 20 19:23:24.493458 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.493236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" event={"ID":"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf","Type":"ContainerDied","Data":"caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b"} Jul 20 19:23:24.493458 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.493291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m6cm2" event={"ID":"6a4f6cf0-e387-41b1-81d5-1c116c5c74cf","Type":"ContainerDied","Data":"d56d2e03568ece78868fbf2acd549254797f464ba681391ce492438e7561f702"} Jul 20 19:23:24.493458 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.493314 2576 scope.go:117] "RemoveContainer" containerID="caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b" Jul 20 19:23:24.502217 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.502199 2576 scope.go:117] "RemoveContainer" containerID="caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b" Jul 20 19:23:24.502465 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:23:24.502448 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b\": container with ID starting with caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b not found: ID does not exist" containerID="caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b" Jul 20 19:23:24.502557 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.502472 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b"} err="failed to get container status \"caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b\": rpc error: code = NotFound desc = could not find container \"caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b\": container with ID starting with caa21cdf6e21ebdf5eec72f9e235f2ba87bd0c899ba91bf1c7be12881457a53b not found: ID does not exist" Jul 20 19:23:24.514445 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.514415 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:24.518570 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:24.518548 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m6cm2"] Jul 20 19:23:25.042067 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.042030 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" path="/var/lib/kubelet/pods/6a4f6cf0-e387-41b1-81d5-1c116c5c74cf/volumes" Jul 20 19:23:25.122543 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.122509 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv"] Jul 20 19:23:25.123092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.123073 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" containerName="limitador" Jul 20 19:23:25.123135 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.123099 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" containerName="limitador" Jul 20 19:23:25.123238 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.123226 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4f6cf0-e387-41b1-81d5-1c116c5c74cf" containerName="limitador" Jul 20 19:23:25.127910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.127878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.130728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.130700 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 19:23:25.133733 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.132029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 19:23:25.133733 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.132249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 20 19:23:25.133733 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.132433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v2wzr\"" Jul 20 19:23:25.134913 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.134889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv"] Jul 20 19:23:25.160055 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.160024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73d915c3-0f35-45e3-bc95-75876e5c104d-data\") pod \"postgres-69fb4594cf-ffsqv\" (UID: \"73d915c3-0f35-45e3-bc95-75876e5c104d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.160223 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.160096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9jjl\" (UniqueName: \"kubernetes.io/projected/73d915c3-0f35-45e3-bc95-75876e5c104d-kube-api-access-x9jjl\") pod \"postgres-69fb4594cf-ffsqv\" (UID: \"73d915c3-0f35-45e3-bc95-75876e5c104d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.261209 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.261177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9jjl\" (UniqueName: \"kubernetes.io/projected/73d915c3-0f35-45e3-bc95-75876e5c104d-kube-api-access-x9jjl\") pod \"postgres-69fb4594cf-ffsqv\" (UID: \"73d915c3-0f35-45e3-bc95-75876e5c104d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.261422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.261261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73d915c3-0f35-45e3-bc95-75876e5c104d-data\") pod \"postgres-69fb4594cf-ffsqv\" (UID: \"73d915c3-0f35-45e3-bc95-75876e5c104d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.261612 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.261593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73d915c3-0f35-45e3-bc95-75876e5c104d-data\") pod \"postgres-69fb4594cf-ffsqv\" (UID: \"73d915c3-0f35-45e3-bc95-75876e5c104d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.269450 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.269426 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9jjl\" (UniqueName: \"kubernetes.io/projected/73d915c3-0f35-45e3-bc95-75876e5c104d-kube-api-access-x9jjl\") pod \"postgres-69fb4594cf-ffsqv\" (UID: \"73d915c3-0f35-45e3-bc95-75876e5c104d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.442467 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.442375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:25.600950 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:25.600919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv"] Jul 20 19:23:25.603229 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:25.603200 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d915c3_0f35_45e3_bc95_75876e5c104d.slice/crio-d6188daecd6fe273c5080561105bddd4add6f43af7d4d0a17bbc5ae92fc808f1 WatchSource:0}: Error finding container d6188daecd6fe273c5080561105bddd4add6f43af7d4d0a17bbc5ae92fc808f1: Status 404 returned error can't find the container with id d6188daecd6fe273c5080561105bddd4add6f43af7d4d0a17bbc5ae92fc808f1 Jul 20 19:23:26.520409 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:26.515362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" event={"ID":"73d915c3-0f35-45e3-bc95-75876e5c104d","Type":"ContainerStarted","Data":"d6188daecd6fe273c5080561105bddd4add6f43af7d4d0a17bbc5ae92fc808f1"} Jul 20 19:23:30.539810 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:30.539773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" event={"ID":"73d915c3-0f35-45e3-bc95-75876e5c104d","Type":"ContainerStarted","Data":"32dc18b3021873c358987ef794767e9a97fb90112c475f833da7f62bf3b04719"} Jul 20 19:23:30.540226 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:30.539874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:30.559179 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:30.559124 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" podStartSLOduration=0.742694897 podStartE2EDuration="5.559108211s" totalImagesPullingTime="4.816413314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:30.55706862 +0000 UTC m=+511.949808152" watchObservedRunningTime="2026-07-20 19:23:30.559108211 +0000 UTC m=+511.951847743" Jul 20 19:23:36.574597 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:36.574565 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ffsqv" Jul 20 19:23:37.099541 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.096076 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9v69f"] Jul 20 19:23:37.103817 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.103778 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9v69f"] Jul 20 19:23:37.104025 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.104004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:37.171290 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.171251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7vm\" (UniqueName: \"kubernetes.io/projected/ca80a27e-4703-4ad3-878f-b242c891cc1b-kube-api-access-hr7vm\") pod \"authorino-5d4b67c446-9v69f\" (UID: \"ca80a27e-4703-4ad3-878f-b242c891cc1b\") " pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:37.271938 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.271895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7vm\" (UniqueName: \"kubernetes.io/projected/ca80a27e-4703-4ad3-878f-b242c891cc1b-kube-api-access-hr7vm\") pod \"authorino-5d4b67c446-9v69f\" (UID: \"ca80a27e-4703-4ad3-878f-b242c891cc1b\") " pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:37.281530 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.281477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7vm\" (UniqueName: \"kubernetes.io/projected/ca80a27e-4703-4ad3-878f-b242c891cc1b-kube-api-access-hr7vm\") pod \"authorino-5d4b67c446-9v69f\" (UID: \"ca80a27e-4703-4ad3-878f-b242c891cc1b\") " pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:37.355169 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.355080 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9v69f"] Jul 20 19:23:37.355364 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.355351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:37.384114 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.384079 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5578cffd79-ff5k9"] Jul 20 19:23:37.390112 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.390087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.393232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.393102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 20 19:23:37.396395 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.396368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5578cffd79-ff5k9"] Jul 20 19:23:37.473719 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.473687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2w45\" (UniqueName: \"kubernetes.io/projected/b167a5b1-daa5-4b57-ad46-6e39353e1b24-kube-api-access-k2w45\") pod \"authorino-5578cffd79-ff5k9\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.473864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.473783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b167a5b1-daa5-4b57-ad46-6e39353e1b24-tls-cert\") pod \"authorino-5578cffd79-ff5k9\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.526947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.526910 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9v69f"] Jul 20 19:23:37.531081 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:37.531054 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca80a27e_4703_4ad3_878f_b242c891cc1b.slice/crio-33a5321a4ff81e1fb53615de1770a2e761e7fb66c6ade98416eec18d90b43b2f WatchSource:0}: Error finding container 33a5321a4ff81e1fb53615de1770a2e761e7fb66c6ade98416eec18d90b43b2f: Status 404 returned error can't find the container with id 33a5321a4ff81e1fb53615de1770a2e761e7fb66c6ade98416eec18d90b43b2f Jul 20 19:23:37.574317 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.574283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2w45\" (UniqueName: \"kubernetes.io/projected/b167a5b1-daa5-4b57-ad46-6e39353e1b24-kube-api-access-k2w45\") pod \"authorino-5578cffd79-ff5k9\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.574517 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.574373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b167a5b1-daa5-4b57-ad46-6e39353e1b24-tls-cert\") pod \"authorino-5578cffd79-ff5k9\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.575181 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.575153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9v69f" event={"ID":"ca80a27e-4703-4ad3-878f-b242c891cc1b","Type":"ContainerStarted","Data":"33a5321a4ff81e1fb53615de1770a2e761e7fb66c6ade98416eec18d90b43b2f"} Jul 20 19:23:37.576940 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.576921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b167a5b1-daa5-4b57-ad46-6e39353e1b24-tls-cert\") pod \"authorino-5578cffd79-ff5k9\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.583942 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.583879 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2w45\" (UniqueName: \"kubernetes.io/projected/b167a5b1-daa5-4b57-ad46-6e39353e1b24-kube-api-access-k2w45\") pod \"authorino-5578cffd79-ff5k9\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.701429 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.701331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:23:37.836126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:37.836101 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5578cffd79-ff5k9"] Jul 20 19:23:37.838038 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:37.838013 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb167a5b1_daa5_4b57_ad46_6e39353e1b24.slice/crio-226c7ed34dde7aeb1195924729473e1285f005e48f22f51a9db8d2dedc75f815 WatchSource:0}: Error finding container 226c7ed34dde7aeb1195924729473e1285f005e48f22f51a9db8d2dedc75f815: Status 404 returned error can't find the container with id 226c7ed34dde7aeb1195924729473e1285f005e48f22f51a9db8d2dedc75f815 Jul 20 19:23:38.581886 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.581850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5578cffd79-ff5k9" event={"ID":"b167a5b1-daa5-4b57-ad46-6e39353e1b24","Type":"ContainerStarted","Data":"31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771"} Jul 20 19:23:38.582269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.581895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5578cffd79-ff5k9" event={"ID":"b167a5b1-daa5-4b57-ad46-6e39353e1b24","Type":"ContainerStarted","Data":"226c7ed34dde7aeb1195924729473e1285f005e48f22f51a9db8d2dedc75f815"} Jul 20 19:23:38.583464 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.583442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9v69f" event={"ID":"ca80a27e-4703-4ad3-878f-b242c891cc1b","Type":"ContainerStarted","Data":"937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722"} Jul 20 19:23:38.583573 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.583519 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9v69f" podUID="ca80a27e-4703-4ad3-878f-b242c891cc1b" containerName="authorino" containerID="cri-o://937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722" gracePeriod=30 Jul 20 19:23:38.599865 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.599820 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5578cffd79-ff5k9" podStartSLOduration=1.26982799 podStartE2EDuration="1.599804148s" totalImagesPullingTime="329.976158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:38.597466171 +0000 UTC m=+519.990205704" watchObservedRunningTime="2026-07-20 19:23:38.599804148 +0000 UTC m=+519.992543731" Jul 20 19:23:38.612927 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.612863 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9v69f" podStartSLOduration=1.201033694 podStartE2EDuration="1.612843229s" totalImagesPullingTime="411.809535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:38.612298431 +0000 UTC m=+520.005038292" watchObservedRunningTime="2026-07-20 19:23:38.612843229 +0000 UTC m=+520.005582761" Jul 20 19:23:38.631242 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.631204 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tjzdn"] Jul 20 19:23:38.631466 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.631433 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tjzdn" podUID="9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" containerName="authorino" containerID="cri-o://a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069" gracePeriod=30 Jul 20 19:23:38.894617 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.894596 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:38.897657 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.897640 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:38.987225 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.987192 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr7vm\" (UniqueName: \"kubernetes.io/projected/ca80a27e-4703-4ad3-878f-b242c891cc1b-kube-api-access-hr7vm\") pod \"ca80a27e-4703-4ad3-878f-b242c891cc1b\" (UID: \"ca80a27e-4703-4ad3-878f-b242c891cc1b\") " Jul 20 19:23:38.987397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.987307 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46lk6\" (UniqueName: \"kubernetes.io/projected/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f-kube-api-access-46lk6\") pod \"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f\" (UID: \"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f\") " Jul 20 19:23:38.989308 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.989280 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca80a27e-4703-4ad3-878f-b242c891cc1b-kube-api-access-hr7vm" (OuterVolumeSpecName: "kube-api-access-hr7vm") pod "ca80a27e-4703-4ad3-878f-b242c891cc1b" (UID: "ca80a27e-4703-4ad3-878f-b242c891cc1b"). InnerVolumeSpecName "kube-api-access-hr7vm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:23:38.989413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:38.989385 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f-kube-api-access-46lk6" (OuterVolumeSpecName: "kube-api-access-46lk6") pod "9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" (UID: "9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f"). InnerVolumeSpecName "kube-api-access-46lk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:23:39.088466 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.088384 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46lk6\" (UniqueName: \"kubernetes.io/projected/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f-kube-api-access-46lk6\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:23:39.088466 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.088414 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr7vm\" (UniqueName: \"kubernetes.io/projected/ca80a27e-4703-4ad3-878f-b242c891cc1b-kube-api-access-hr7vm\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:23:39.589903 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.589872 2576 generic.go:356] "Generic (PLEG): container finished" podID="ca80a27e-4703-4ad3-878f-b242c891cc1b" containerID="937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722" exitCode=0 Jul 20 19:23:39.590340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.589919 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9v69f" Jul 20 19:23:39.590340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.589954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9v69f" event={"ID":"ca80a27e-4703-4ad3-878f-b242c891cc1b","Type":"ContainerDied","Data":"937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722"} Jul 20 19:23:39.590340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.589995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9v69f" event={"ID":"ca80a27e-4703-4ad3-878f-b242c891cc1b","Type":"ContainerDied","Data":"33a5321a4ff81e1fb53615de1770a2e761e7fb66c6ade98416eec18d90b43b2f"} Jul 20 19:23:39.590340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.590016 2576 scope.go:117] "RemoveContainer" containerID="937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722" Jul 20 19:23:39.591429 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.591409 2576 generic.go:356] "Generic (PLEG): container finished" podID="9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" containerID="a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069" exitCode=0 Jul 20 19:23:39.591558 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.591444 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tjzdn" Jul 20 19:23:39.591558 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.591486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tjzdn" event={"ID":"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f","Type":"ContainerDied","Data":"a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069"} Jul 20 19:23:39.591558 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.591542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tjzdn" event={"ID":"9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f","Type":"ContainerDied","Data":"7c2538fc8f5fe406bda1327b2589fd437b87f7b04d7a562e9cd4d1274eaf5e8a"} Jul 20 19:23:39.604775 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.604741 2576 scope.go:117] "RemoveContainer" containerID="937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722" Jul 20 19:23:39.605224 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:23:39.605189 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722\": container with ID starting with 937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722 not found: ID does not exist" containerID="937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722" Jul 20 19:23:39.605324 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.605237 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722"} err="failed to get container status \"937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722\": rpc error: code = NotFound desc = could not find container \"937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722\": container with ID starting with 937ea87890ff1280bc4733cd985e800acf4c563674ab02e1ad624e3ff4476722 not found: ID does not exist" Jul 20 19:23:39.605324 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.605272 2576 scope.go:117] "RemoveContainer" containerID="a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069" Jul 20 19:23:39.611180 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.611151 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tjzdn"] Jul 20 19:23:39.614308 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.614286 2576 scope.go:117] "RemoveContainer" containerID="a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069" Jul 20 19:23:39.614671 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:23:39.614649 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069\": container with ID starting with a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069 not found: ID does not exist" containerID="a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069" Jul 20 19:23:39.614730 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.614679 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069"} err="failed to get container status \"a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069\": rpc error: code = NotFound desc = could not find container \"a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069\": container with ID starting with a91144f4505aacea3d797d99ba2db26509cfc7c0fe90c4ceb29a50e58c85d069 not found: ID does not exist" Jul 20 19:23:39.614845 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.614827 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tjzdn"] Jul 20 19:23:39.624976 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.624948 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9v69f"] Jul 20 19:23:39.628388 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:39.628364 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9v69f"] Jul 20 19:23:41.043091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:41.043049 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" path="/var/lib/kubelet/pods/9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f/volumes" Jul 20 19:23:41.043714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:41.043528 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca80a27e-4703-4ad3-878f-b242c891cc1b" path="/var/lib/kubelet/pods/ca80a27e-4703-4ad3-878f-b242c891cc1b/volumes" Jul 20 19:23:43.583252 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.583212 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c84466777-6z8km"] Jul 20 19:23:43.584658 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.584632 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca80a27e-4703-4ad3-878f-b242c891cc1b" containerName="authorino" Jul 20 19:23:43.584819 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.584808 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca80a27e-4703-4ad3-878f-b242c891cc1b" containerName="authorino" Jul 20 19:23:43.584920 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.584911 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" containerName="authorino" Jul 20 19:23:43.584999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.584991 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" containerName="authorino" Jul 20 19:23:43.585243 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.585232 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca80a27e-4703-4ad3-878f-b242c891cc1b" containerName="authorino" Jul 20 19:23:43.585332 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.585322 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c7f07b6-a79f-4002-8b1b-dcd5d9132b3f" containerName="authorino" Jul 20 19:23:43.629564 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.629528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c84466777-6z8km"] Jul 20 19:23:43.629728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.629620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.632475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.632448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 19:23:43.632652 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.632525 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5h8p\"" Jul 20 19:23:43.632765 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.632748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 19:23:43.733627 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.733587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-webhook-cert\") pod \"maas-controller-6c84466777-6z8km\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.733818 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.733667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wv7\" (UniqueName: \"kubernetes.io/projected/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-kube-api-access-r2wv7\") pod \"maas-controller-6c84466777-6z8km\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.834852 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.834762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wv7\" (UniqueName: \"kubernetes.io/projected/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-kube-api-access-r2wv7\") pod \"maas-controller-6c84466777-6z8km\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.834852 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.834834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-webhook-cert\") pod \"maas-controller-6c84466777-6z8km\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.837443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.837409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-webhook-cert\") pod \"maas-controller-6c84466777-6z8km\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.843264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.843235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wv7\" (UniqueName: \"kubernetes.io/projected/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-kube-api-access-r2wv7\") pod \"maas-controller-6c84466777-6z8km\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:43.941626 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:43.941588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:44.122890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:44.122849 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c84466777-6z8km"] Jul 20 19:23:44.125352 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:23:44.125322 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ddedec_0eeb_48e1_a5d9_d5f4c20a6ccd.slice/crio-d3c2a475079c846234be74765798a42014bcf6ad1310972e962b7cdf1e214ef6 WatchSource:0}: Error finding container d3c2a475079c846234be74765798a42014bcf6ad1310972e962b7cdf1e214ef6: Status 404 returned error can't find the container with id d3c2a475079c846234be74765798a42014bcf6ad1310972e962b7cdf1e214ef6 Jul 20 19:23:44.622461 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:44.622427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-6z8km" event={"ID":"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd","Type":"ContainerStarted","Data":"d3c2a475079c846234be74765798a42014bcf6ad1310972e962b7cdf1e214ef6"} Jul 20 19:23:47.638687 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:47.638648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-6z8km" event={"ID":"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd","Type":"ContainerStarted","Data":"0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb"} Jul 20 19:23:47.639092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:47.638786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:58.645516 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:58.645414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:23:58.665584 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:23:58.665526 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c84466777-6z8km" podStartSLOduration=12.949694808 podStartE2EDuration="15.665478943s" totalImagesPullingTime="2.715784135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:47.671960869 +0000 UTC m=+529.064700401" watchObservedRunningTime="2026-07-20 19:23:58.665478943 +0000 UTC m=+540.058218477" Jul 20 19:24:21.162679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.162640 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt"] Jul 20 19:24:21.172133 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.172108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.175732 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.175479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\"" Jul 20 19:24:21.175732 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.175713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 20 19:24:21.178532 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.178487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt"] Jul 20 19:24:21.285466 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.285401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d72c73-0c8a-487c-b4e9-5a14826170ac-openshift-service-ca\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.285689 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.285476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdlks\" (UniqueName: \"kubernetes.io/projected/87d72c73-0c8a-487c-b4e9-5a14826170ac-kube-api-access-vdlks\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.285689 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.285563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d72c73-0c8a-487c-b4e9-5a14826170ac-maas-api-tls\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.386104 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.386065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d72c73-0c8a-487c-b4e9-5a14826170ac-maas-api-tls\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.386303 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.386167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d72c73-0c8a-487c-b4e9-5a14826170ac-openshift-service-ca\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.386303 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.386199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdlks\" (UniqueName: \"kubernetes.io/projected/87d72c73-0c8a-487c-b4e9-5a14826170ac-kube-api-access-vdlks\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.387153 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.387132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d72c73-0c8a-487c-b4e9-5a14826170ac-openshift-service-ca\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.388954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.388919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d72c73-0c8a-487c-b4e9-5a14826170ac-maas-api-tls\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.397506 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.397465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdlks\" (UniqueName: \"kubernetes.io/projected/87d72c73-0c8a-487c-b4e9-5a14826170ac-kube-api-access-vdlks\") pod \"maas-api-5ddcdf954-w47qt\" (UID: \"87d72c73-0c8a-487c-b4e9-5a14826170ac\") " pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.484909 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.484824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:21.640861 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.640826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt"] Jul 20 19:24:21.644862 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:24:21.644816 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d72c73_0c8a_487c_b4e9_5a14826170ac.slice/crio-24130208ac01ce32ded0f7fd87aa5ced739b5714d31cb83e5d19af4d8956ce2f WatchSource:0}: Error finding container 24130208ac01ce32ded0f7fd87aa5ced739b5714d31cb83e5d19af4d8956ce2f: Status 404 returned error can't find the container with id 24130208ac01ce32ded0f7fd87aa5ced739b5714d31cb83e5d19af4d8956ce2f Jul 20 19:24:21.663941 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.663910 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-95rpr"] Jul 20 19:24:21.669464 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.669442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.672087 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.672063 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 19:24:21.675530 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.675503 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-95rpr"] Jul 20 19:24:21.791294 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.791256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d51d8634-5bf8-49e0-a22c-ca78d4fb3822-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-95rpr\" (UID: \"d51d8634-5bf8-49e0-a22c-ca78d4fb3822\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.791527 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.791326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwghb\" (UniqueName: \"kubernetes.io/projected/d51d8634-5bf8-49e0-a22c-ca78d4fb3822-kube-api-access-jwghb\") pod \"payload-pre-processing-7677b774bb-95rpr\" (UID: \"d51d8634-5bf8-49e0-a22c-ca78d4fb3822\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.808314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.808267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" event={"ID":"87d72c73-0c8a-487c-b4e9-5a14826170ac","Type":"ContainerStarted","Data":"24130208ac01ce32ded0f7fd87aa5ced739b5714d31cb83e5d19af4d8956ce2f"} Jul 20 19:24:21.892222 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.892188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d51d8634-5bf8-49e0-a22c-ca78d4fb3822-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-95rpr\" (UID: \"d51d8634-5bf8-49e0-a22c-ca78d4fb3822\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.892411 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.892236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwghb\" (UniqueName: \"kubernetes.io/projected/d51d8634-5bf8-49e0-a22c-ca78d4fb3822-kube-api-access-jwghb\") pod \"payload-pre-processing-7677b774bb-95rpr\" (UID: \"d51d8634-5bf8-49e0-a22c-ca78d4fb3822\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.892918 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.892899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d51d8634-5bf8-49e0-a22c-ca78d4fb3822-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-95rpr\" (UID: \"d51d8634-5bf8-49e0-a22c-ca78d4fb3822\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.900671 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.900637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwghb\" (UniqueName: \"kubernetes.io/projected/d51d8634-5bf8-49e0-a22c-ca78d4fb3822-kube-api-access-jwghb\") pod \"payload-pre-processing-7677b774bb-95rpr\" (UID: \"d51d8634-5bf8-49e0-a22c-ca78d4fb3822\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:21.983741 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:21.983701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:22.133277 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:22.133251 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-95rpr"] Jul 20 19:24:22.134692 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:24:22.134663 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51d8634_5bf8_49e0_a22c_ca78d4fb3822.slice/crio-5f8b6d06f09eb1f2897ce93d44892c1de63f58d9b5f5970db2d677c9167be832 WatchSource:0}: Error finding container 5f8b6d06f09eb1f2897ce93d44892c1de63f58d9b5f5970db2d677c9167be832: Status 404 returned error can't find the container with id 5f8b6d06f09eb1f2897ce93d44892c1de63f58d9b5f5970db2d677c9167be832 Jul 20 19:24:22.818567 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:22.818529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" event={"ID":"d51d8634-5bf8-49e0-a22c-ca78d4fb3822","Type":"ContainerStarted","Data":"5f8b6d06f09eb1f2897ce93d44892c1de63f58d9b5f5970db2d677c9167be832"} Jul 20 19:24:23.853367 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:23.853319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" event={"ID":"87d72c73-0c8a-487c-b4e9-5a14826170ac","Type":"ContainerStarted","Data":"12799fa390a3d9fd4cd186597729799d48d173dfe632333927fe5990cd4bda09"} Jul 20 19:24:23.853972 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:23.853442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:23.871068 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:23.870983 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" podStartSLOduration=0.833424759 podStartE2EDuration="2.870960491s" totalImagesPullingTime="2.037535732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:24:23.870640276 +0000 UTC m=+565.263379847" watchObservedRunningTime="2026-07-20 19:24:23.870960491 +0000 UTC m=+565.263700024" Jul 20 19:24:25.866045 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:25.866012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" event={"ID":"d51d8634-5bf8-49e0-a22c-ca78d4fb3822","Type":"ContainerStarted","Data":"213071eb25185d3cb1f1d7b9f595c16be8aec704f523515160667209d5738bcb"} Jul 20 19:24:25.866458 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:25.866111 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:25.886102 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:25.886042 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" podStartSLOduration=1.8213565680000001 podStartE2EDuration="4.886023785s" totalImagesPullingTime="3.064667217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:24:25.885006759 +0000 UTC m=+567.277746291" watchObservedRunningTime="2026-07-20 19:24:25.886023785 +0000 UTC m=+567.278763318" Jul 20 19:24:29.864928 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.864895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ddcdf954-w47qt" Jul 20 19:24:29.887195 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.887163 2576 generic.go:356] "Generic (PLEG): container finished" podID="09824d4e-c75c-4a0f-be07-eed400cba7d7" containerID="b68c75ae8cceac555a11de263c355d94ebae2cb68b692773da6fa6fbc3a14e2c" exitCode=0 Jul 20 19:24:29.887378 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.887238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" event={"ID":"09824d4e-c75c-4a0f-be07-eed400cba7d7","Type":"ContainerDied","Data":"b68c75ae8cceac555a11de263c355d94ebae2cb68b692773da6fa6fbc3a14e2c"} Jul 20 19:24:29.887708 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.887690 2576 scope.go:117] "RemoveContainer" containerID="b68c75ae8cceac555a11de263c355d94ebae2cb68b692773da6fa6fbc3a14e2c" Jul 20 19:24:29.888825 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.888799 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:24:29.888877 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.888860 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:24:29.888911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:29.888891 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:24:30.894285 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:30.894239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" event={"ID":"09824d4e-c75c-4a0f-be07-eed400cba7d7","Type":"ContainerStarted","Data":"1c169f92767d8f634b8f8da6aa5bb92787b7c477200e6d34999eda840ae06e21"} Jul 20 19:24:31.573413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:31.573377 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:24:31.573621 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:31.573595 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kvnfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 19:24:31.573701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:31.573679 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" podUID="09824d4e-c75c-4a0f-be07-eed400cba7d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 19:24:32.573391 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:32.573347 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kvnfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 19:24:32.573837 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:32.573426 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" podUID="09824d4e-c75c-4a0f-be07-eed400cba7d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 19:24:33.573371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:33.573339 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kvnfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 19:24:33.573582 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:33.573397 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" podUID="09824d4e-c75c-4a0f-be07-eed400cba7d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 19:24:34.573029 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:34.572991 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kvnfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 19:24:34.573207 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:34.573048 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" podUID="09824d4e-c75c-4a0f-be07-eed400cba7d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 19:24:35.576525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:35.576465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:24:35.576998 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:35.576863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:24:35.577429 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:35.577410 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kvnfp" Jul 20 19:24:36.873597 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:36.873567 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-95rpr" Jul 20 19:24:58.983320 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:58.983288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:24:58.984024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:58.984009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:24:58.986946 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:58.986924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:24:58.987434 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:24:58.987415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:25:00.380593 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.380563 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z"] Jul 20 19:25:00.387682 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.387659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.390642 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.390610 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 19:25:00.390777 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.390754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4pg4h\"" Jul 20 19:25:00.392096 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.392079 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 19:25:00.392096 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.392094 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 20 19:25:00.396488 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.396465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z"] Jul 20 19:25:00.476079 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.476044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.476256 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.476084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.476256 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.476203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.476256 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.476248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.476357 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.476273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8sjj\" (UniqueName: \"kubernetes.io/projected/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-kube-api-access-p8sjj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.476357 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.476313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.577791 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.577756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.577825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.577846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.577885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.577911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.577939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8sjj\" (UniqueName: \"kubernetes.io/projected/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-kube-api-access-p8sjj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578261 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.578237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.578321 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.578422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.578401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.580227 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.580204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.580473 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.580453 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.589391 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.589367 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8sjj\" (UniqueName: \"kubernetes.io/projected/0a9a05dd-f3e5-4b83-80f6-1698f74fd45e-kube-api-access-p8sjj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gth9z\" (UID: \"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.700199 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.700101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:00.850262 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:00.850236 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z"] Jul 20 19:25:00.852401 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:25:00.852378 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9a05dd_f3e5_4b83_80f6_1698f74fd45e.slice/crio-e20f774cc2df80f387ea06657f3e3b089a15d9d9f31457e3504f0bf037dd65f3 WatchSource:0}: Error finding container e20f774cc2df80f387ea06657f3e3b089a15d9d9f31457e3504f0bf037dd65f3: Status 404 returned error can't find the container with id e20f774cc2df80f387ea06657f3e3b089a15d9d9f31457e3504f0bf037dd65f3 Jul 20 19:25:01.046205 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:01.046170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" event={"ID":"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e","Type":"ContainerStarted","Data":"e20f774cc2df80f387ea06657f3e3b089a15d9d9f31457e3504f0bf037dd65f3"} Jul 20 19:25:03.066569 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:03.066527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" event={"ID":"0a9a05dd-f3e5-4b83-80f6-1698f74fd45e","Type":"ContainerStarted","Data":"a5f97eb7e634633aa90d8e6d69f768867c496ed916ceaa36b79497d9f9338b42"} Jul 20 19:25:03.091185 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:03.091127 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" podStartSLOduration=1.7804773109999998 podStartE2EDuration="3.091111942s" totalImagesPullingTime="1.310634631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:25:03.089318323 +0000 UTC m=+604.482057855" watchObservedRunningTime="2026-07-20 19:25:03.091111942 +0000 UTC m=+604.483851475" Jul 20 19:25:10.700783 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:10.700731 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:10.701253 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:10.700851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:10.713908 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:10.713871 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:11.117261 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:11.117226 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gth9z" Jul 20 19:25:21.610951 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.610866 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z"] Jul 20 19:25:21.614800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.614775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.618607 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.618586 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 20 19:25:21.667651 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.667609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.667651 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.667652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.667882 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.667717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jxn\" (UniqueName: \"kubernetes.io/projected/27708505-ead8-434b-82a8-ae19e410f4b4-kube-api-access-f2jxn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.667882 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.667764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.667882 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.667826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27708505-ead8-434b-82a8-ae19e410f4b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.667882 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.667866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.719252 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.719213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z"] Jul 20 19:25:21.768314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jxn\" (UniqueName: \"kubernetes.io/projected/27708505-ead8-434b-82a8-ae19e410f4b4-kube-api-access-f2jxn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768751 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27708505-ead8-434b-82a8-ae19e410f4b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768885 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768945 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768878 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.768945 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.768901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.770756 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.770727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27708505-ead8-434b-82a8-ae19e410f4b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.770992 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.770972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27708505-ead8-434b-82a8-ae19e410f4b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.801514 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.793142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jxn\" (UniqueName: \"kubernetes.io/projected/27708505-ead8-434b-82a8-ae19e410f4b4-kube-api-access-f2jxn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nhw6z\" (UID: \"27708505-ead8-434b-82a8-ae19e410f4b4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:21.926434 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:21.926334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:22.089605 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:22.089574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z"] Jul 20 19:25:22.091132 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:25:22.091100 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27708505_ead8_434b_82a8_ae19e410f4b4.slice/crio-fae6385d9632659175153c0d8346925c45ed8ca83ef6be8e02a53e54640616d6 WatchSource:0}: Error finding container fae6385d9632659175153c0d8346925c45ed8ca83ef6be8e02a53e54640616d6: Status 404 returned error can't find the container with id fae6385d9632659175153c0d8346925c45ed8ca83ef6be8e02a53e54640616d6 Jul 20 19:25:22.092649 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:22.092631 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:25:22.162466 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:22.162432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" event={"ID":"27708505-ead8-434b-82a8-ae19e410f4b4","Type":"ContainerStarted","Data":"fae6385d9632659175153c0d8346925c45ed8ca83ef6be8e02a53e54640616d6"} Jul 20 19:25:23.169422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:23.169382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" event={"ID":"27708505-ead8-434b-82a8-ae19e410f4b4","Type":"ContainerStarted","Data":"84625aa50addd30d34e214f7a25563223e6f6cdffaf475d28664d933a8d4ce91"} Jul 20 19:25:23.193070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:23.193008 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" podStartSLOduration=1.955352876 podStartE2EDuration="2.192989678s" totalImagesPullingTime="237.636802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:25:23.192070855 +0000 UTC m=+624.584810388" watchObservedRunningTime="2026-07-20 19:25:23.192989678 +0000 UTC m=+624.585729210" Jul 20 19:25:31.927477 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:31.927435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:31.927477 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:31.927517 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:31.940435 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:31.940403 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:25:32.229869 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:25:32.229783 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nhw6z" Jul 20 19:27:09.106227 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.106182 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5578cffd79-ff5k9"] Jul 20 19:27:09.106842 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.106409 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5578cffd79-ff5k9" podUID="b167a5b1-daa5-4b57-ad46-6e39353e1b24" containerName="authorino" containerID="cri-o://31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771" gracePeriod=30 Jul 20 19:27:09.366401 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.366336 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:27:09.484558 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.484514 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2w45\" (UniqueName: \"kubernetes.io/projected/b167a5b1-daa5-4b57-ad46-6e39353e1b24-kube-api-access-k2w45\") pod \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " Jul 20 19:27:09.484864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.484615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b167a5b1-daa5-4b57-ad46-6e39353e1b24-tls-cert\") pod \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\" (UID: \"b167a5b1-daa5-4b57-ad46-6e39353e1b24\") " Jul 20 19:27:09.486565 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.486533 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b167a5b1-daa5-4b57-ad46-6e39353e1b24-kube-api-access-k2w45" (OuterVolumeSpecName: "kube-api-access-k2w45") pod "b167a5b1-daa5-4b57-ad46-6e39353e1b24" (UID: "b167a5b1-daa5-4b57-ad46-6e39353e1b24"). InnerVolumeSpecName "kube-api-access-k2w45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:09.496041 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.495993 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b167a5b1-daa5-4b57-ad46-6e39353e1b24-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b167a5b1-daa5-4b57-ad46-6e39353e1b24" (UID: "b167a5b1-daa5-4b57-ad46-6e39353e1b24"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:27:09.585443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.585404 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b167a5b1-daa5-4b57-ad46-6e39353e1b24-tls-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:27:09.585443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.585437 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2w45\" (UniqueName: \"kubernetes.io/projected/b167a5b1-daa5-4b57-ad46-6e39353e1b24-kube-api-access-k2w45\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:27:09.717034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.716943 2576 generic.go:356] "Generic (PLEG): container finished" podID="b167a5b1-daa5-4b57-ad46-6e39353e1b24" containerID="31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771" exitCode=0 Jul 20 19:27:09.717034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.716991 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5578cffd79-ff5k9" Jul 20 19:27:09.717034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.717022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5578cffd79-ff5k9" event={"ID":"b167a5b1-daa5-4b57-ad46-6e39353e1b24","Type":"ContainerDied","Data":"31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771"} Jul 20 19:27:09.717306 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.717052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5578cffd79-ff5k9" event={"ID":"b167a5b1-daa5-4b57-ad46-6e39353e1b24","Type":"ContainerDied","Data":"226c7ed34dde7aeb1195924729473e1285f005e48f22f51a9db8d2dedc75f815"} Jul 20 19:27:09.717306 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.717068 2576 scope.go:117] "RemoveContainer" containerID="31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771" Jul 20 19:27:09.726771 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.726751 2576 scope.go:117] "RemoveContainer" containerID="31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771" Jul 20 19:27:09.727035 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:27:09.727019 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771\": container with ID starting with 31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771 not found: ID does not exist" containerID="31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771" Jul 20 19:27:09.727098 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.727043 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771"} err="failed to get container status \"31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771\": rpc error: code = NotFound desc = could not find container \"31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771\": container with ID starting with 31482b72fdaff78869e47055540a1460cbbf2c583fe204ef67d14ba04f3ec771 not found: ID does not exist" Jul 20 19:27:09.738853 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.738822 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5578cffd79-ff5k9"] Jul 20 19:27:09.743480 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:09.743453 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5578cffd79-ff5k9"] Jul 20 19:27:11.043110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:11.043076 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b167a5b1-daa5-4b57-ad46-6e39353e1b24" path="/var/lib/kubelet/pods/b167a5b1-daa5-4b57-ad46-6e39353e1b24/volumes" Jul 20 19:27:54.909949 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:54.909907 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c84466777-6z8km"] Jul 20 19:27:54.910557 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:54.910163 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c84466777-6z8km" podUID="f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" containerName="manager" containerID="cri-o://0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb" gracePeriod=30 Jul 20 19:27:55.172795 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.172735 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:27:55.319539 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.319472 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2wv7\" (UniqueName: \"kubernetes.io/projected/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-kube-api-access-r2wv7\") pod \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " Jul 20 19:27:55.319715 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.319612 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-webhook-cert\") pod \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\" (UID: \"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd\") " Jul 20 19:27:55.321833 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.321786 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-kube-api-access-r2wv7" (OuterVolumeSpecName: "kube-api-access-r2wv7") pod "f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" (UID: "f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd"). InnerVolumeSpecName "kube-api-access-r2wv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:27:55.321833 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.321801 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" (UID: "f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:27:55.420944 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.420892 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-webhook-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:27:55.420944 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.420938 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2wv7\" (UniqueName: \"kubernetes.io/projected/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd-kube-api-access-r2wv7\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:27:55.968419 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.968379 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" containerID="0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb" exitCode=0 Jul 20 19:27:55.968864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.968440 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-6z8km" Jul 20 19:27:55.968864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.968465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-6z8km" event={"ID":"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd","Type":"ContainerDied","Data":"0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb"} Jul 20 19:27:55.968864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.968560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-6z8km" event={"ID":"f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd","Type":"ContainerDied","Data":"d3c2a475079c846234be74765798a42014bcf6ad1310972e962b7cdf1e214ef6"} Jul 20 19:27:55.968864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.968584 2576 scope.go:117] "RemoveContainer" containerID="0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb" Jul 20 19:27:55.978119 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.978096 2576 scope.go:117] "RemoveContainer" containerID="0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb" Jul 20 19:27:55.978368 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:27:55.978351 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb\": container with ID starting with 0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb not found: ID does not exist" containerID="0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb" Jul 20 19:27:55.978429 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.978376 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb"} err="failed to get container status \"0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb\": rpc error: code = NotFound desc = could not find container \"0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb\": container with ID starting with 0033c69013528071fee5f3c4f161b459cb2b043f50443e68e62c884f2fe93efb not found: ID does not exist" Jul 20 19:27:55.988931 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.988884 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c84466777-6z8km"] Jul 20 19:27:55.993245 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:55.993222 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c84466777-6z8km"] Jul 20 19:27:57.043038 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:27:57.043000 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" path="/var/lib/kubelet/pods/f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd/volumes" Jul 20 19:28:56.817769 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.817725 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c84466777-5nrzg"] Jul 20 19:28:56.818259 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.818204 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" containerName="manager" Jul 20 19:28:56.818259 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.818222 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" containerName="manager" Jul 20 19:28:56.818259 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.818234 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b167a5b1-daa5-4b57-ad46-6e39353e1b24" containerName="authorino" Jul 20 19:28:56.818259 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.818240 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b167a5b1-daa5-4b57-ad46-6e39353e1b24" containerName="authorino" Jul 20 19:28:56.818417 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.818330 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b167a5b1-daa5-4b57-ad46-6e39353e1b24" containerName="authorino" Jul 20 19:28:56.818417 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.818341 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ddedec-0eeb-48e1-a5d9-d5f4c20a6ccd" containerName="manager" Jul 20 19:28:56.821530 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.821511 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:56.824411 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.824385 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 19:28:56.825487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.825469 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5h8p\"" Jul 20 19:28:56.825613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.825471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 19:28:56.830896 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.830859 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c84466777-5nrzg"] Jul 20 19:28:56.901412 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.901375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blx6s\" (UniqueName: \"kubernetes.io/projected/9f8e7864-b522-4210-979d-350b31359cc5-kube-api-access-blx6s\") pod \"maas-controller-6c84466777-5nrzg\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:56.901412 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:56.901430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e7864-b522-4210-979d-350b31359cc5-webhook-cert\") pod \"maas-controller-6c84466777-5nrzg\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:57.002521 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.002457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e7864-b522-4210-979d-350b31359cc5-webhook-cert\") pod \"maas-controller-6c84466777-5nrzg\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:57.002729 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.002616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blx6s\" (UniqueName: \"kubernetes.io/projected/9f8e7864-b522-4210-979d-350b31359cc5-kube-api-access-blx6s\") pod \"maas-controller-6c84466777-5nrzg\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:57.004922 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.004901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e7864-b522-4210-979d-350b31359cc5-webhook-cert\") pod \"maas-controller-6c84466777-5nrzg\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:57.012342 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.012312 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blx6s\" (UniqueName: \"kubernetes.io/projected/9f8e7864-b522-4210-979d-350b31359cc5-kube-api-access-blx6s\") pod \"maas-controller-6c84466777-5nrzg\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:57.134779 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.134689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:57.280423 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.280395 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c84466777-5nrzg"] Jul 20 19:28:57.282798 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:28:57.282772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8e7864_b522_4210_979d_350b31359cc5.slice/crio-413f5c1b8654d0f7d91e2d86eec7b3705a00b19b0c3bd3d68184d69749518e8d WatchSource:0}: Error finding container 413f5c1b8654d0f7d91e2d86eec7b3705a00b19b0c3bd3d68184d69749518e8d: Status 404 returned error can't find the container with id 413f5c1b8654d0f7d91e2d86eec7b3705a00b19b0c3bd3d68184d69749518e8d Jul 20 19:28:57.291074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:57.291025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-5nrzg" event={"ID":"9f8e7864-b522-4210-979d-350b31359cc5","Type":"ContainerStarted","Data":"413f5c1b8654d0f7d91e2d86eec7b3705a00b19b0c3bd3d68184d69749518e8d"} Jul 20 19:28:58.296903 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:58.296863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-5nrzg" event={"ID":"9f8e7864-b522-4210-979d-350b31359cc5","Type":"ContainerStarted","Data":"85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f"} Jul 20 19:28:58.297317 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:58.297021 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:28:58.314606 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:28:58.314553 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c84466777-5nrzg" podStartSLOduration=1.7920131910000001 podStartE2EDuration="2.314535762s" totalImagesPullingTime="522.522571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:58.313348191 +0000 UTC m=+839.706087735" watchObservedRunningTime="2026-07-20 19:28:58.314535762 +0000 UTC m=+839.707275294" Jul 20 19:29:09.304469 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:09.304435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:29:14.004019 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.003978 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c84466777-5nrzg"] Jul 20 19:29:14.004583 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.004244 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c84466777-5nrzg" podUID="9f8e7864-b522-4210-979d-350b31359cc5" containerName="manager" containerID="cri-o://85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f" gracePeriod=30 Jul 20 19:29:14.263905 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.263839 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:29:14.357020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.356978 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blx6s\" (UniqueName: \"kubernetes.io/projected/9f8e7864-b522-4210-979d-350b31359cc5-kube-api-access-blx6s\") pod \"9f8e7864-b522-4210-979d-350b31359cc5\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " Jul 20 19:29:14.357020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.357025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e7864-b522-4210-979d-350b31359cc5-webhook-cert\") pod \"9f8e7864-b522-4210-979d-350b31359cc5\" (UID: \"9f8e7864-b522-4210-979d-350b31359cc5\") " Jul 20 19:29:14.359139 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.359109 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8e7864-b522-4210-979d-350b31359cc5-kube-api-access-blx6s" (OuterVolumeSpecName: "kube-api-access-blx6s") pod "9f8e7864-b522-4210-979d-350b31359cc5" (UID: "9f8e7864-b522-4210-979d-350b31359cc5"). InnerVolumeSpecName "kube-api-access-blx6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:29:14.359237 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.359192 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f8e7864-b522-4210-979d-350b31359cc5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9f8e7864-b522-4210-979d-350b31359cc5" (UID: "9f8e7864-b522-4210-979d-350b31359cc5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:29:14.393809 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.393774 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f8e7864-b522-4210-979d-350b31359cc5" containerID="85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f" exitCode=0 Jul 20 19:29:14.393989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.393832 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-5nrzg" Jul 20 19:29:14.393989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.393857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-5nrzg" event={"ID":"9f8e7864-b522-4210-979d-350b31359cc5","Type":"ContainerDied","Data":"85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f"} Jul 20 19:29:14.393989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.393928 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-5nrzg" event={"ID":"9f8e7864-b522-4210-979d-350b31359cc5","Type":"ContainerDied","Data":"413f5c1b8654d0f7d91e2d86eec7b3705a00b19b0c3bd3d68184d69749518e8d"} Jul 20 19:29:14.393989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.393951 2576 scope.go:117] "RemoveContainer" containerID="85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f" Jul 20 19:29:14.403249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.403230 2576 scope.go:117] "RemoveContainer" containerID="85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f" Jul 20 19:29:14.403600 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:29:14.403577 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f\": container with ID starting with 85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f not found: ID does not exist" containerID="85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f" Jul 20 19:29:14.403677 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.403614 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f"} err="failed to get container status \"85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f\": rpc error: code = NotFound desc = could not find container \"85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f\": container with ID starting with 85268626ab05dee883801002b11fc1da07562d8e9d741b69c219cf8e95277f8f not found: ID does not exist" Jul 20 19:29:14.416337 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.416307 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c84466777-5nrzg"] Jul 20 19:29:14.420169 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.420142 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c84466777-5nrzg"] Jul 20 19:29:14.458152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.458111 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blx6s\" (UniqueName: \"kubernetes.io/projected/9f8e7864-b522-4210-979d-350b31359cc5-kube-api-access-blx6s\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:29:14.458152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:14.458146 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e7864-b522-4210-979d-350b31359cc5-webhook-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:29:15.042089 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.042052 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8e7864-b522-4210-979d-350b31359cc5" path="/var/lib/kubelet/pods/9f8e7864-b522-4210-979d-350b31359cc5/volumes" Jul 20 19:29:15.281091 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.281054 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c84466777-pq64k"] Jul 20 19:29:15.281573 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.281548 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8e7864-b522-4210-979d-350b31359cc5" containerName="manager" Jul 20 19:29:15.281573 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.281572 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8e7864-b522-4210-979d-350b31359cc5" containerName="manager" Jul 20 19:29:15.281779 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.281680 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8e7864-b522-4210-979d-350b31359cc5" containerName="manager" Jul 20 19:29:15.286297 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.286278 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.290783 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.290761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 19:29:15.290922 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.290781 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5h8p\"" Jul 20 19:29:15.290922 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.290772 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 19:29:15.294862 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.294836 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c84466777-pq64k"] Jul 20 19:29:15.365800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.365764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f-webhook-cert\") pod \"maas-controller-6c84466777-pq64k\" (UID: \"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f\") " pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.366026 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.365811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnsjq\" (UniqueName: \"kubernetes.io/projected/fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f-kube-api-access-lnsjq\") pod \"maas-controller-6c84466777-pq64k\" (UID: \"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f\") " pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.466644 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.466606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f-webhook-cert\") pod \"maas-controller-6c84466777-pq64k\" (UID: \"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f\") " pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.466856 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.466653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnsjq\" (UniqueName: \"kubernetes.io/projected/fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f-kube-api-access-lnsjq\") pod \"maas-controller-6c84466777-pq64k\" (UID: \"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f\") " pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.469204 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.469179 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f-webhook-cert\") pod \"maas-controller-6c84466777-pq64k\" (UID: \"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f\") " pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.475857 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.475827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnsjq\" (UniqueName: \"kubernetes.io/projected/fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f-kube-api-access-lnsjq\") pod \"maas-controller-6c84466777-pq64k\" (UID: \"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f\") " pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.598229 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.598132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:15.738946 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:15.738920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c84466777-pq64k"] Jul 20 19:29:15.740797 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:29:15.740773 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbfd0f2_d93f_4b2b_8eab_195a3af5b84f.slice/crio-9c71be8b8b99d61ae9d526134244657f4b338739b5e62c7b298aa9465eec4dc9 WatchSource:0}: Error finding container 9c71be8b8b99d61ae9d526134244657f4b338739b5e62c7b298aa9465eec4dc9: Status 404 returned error can't find the container with id 9c71be8b8b99d61ae9d526134244657f4b338739b5e62c7b298aa9465eec4dc9 Jul 20 19:29:16.406865 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:16.406823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-pq64k" event={"ID":"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f","Type":"ContainerStarted","Data":"a3e9e5ba0edc1a5bb2f0411283716c1a43ef0c852248656bd4405ae069579f72"} Jul 20 19:29:16.407371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:16.406882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c84466777-pq64k" event={"ID":"fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f","Type":"ContainerStarted","Data":"9c71be8b8b99d61ae9d526134244657f4b338739b5e62c7b298aa9465eec4dc9"} Jul 20 19:29:16.407371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:16.406957 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:16.427527 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:16.427458 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c84466777-pq64k" podStartSLOduration=0.96848506 podStartE2EDuration="1.427436806s" totalImagesPullingTime="458.951746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:29:16.424672025 +0000 UTC m=+857.817411558" watchObservedRunningTime="2026-07-20 19:29:16.427436806 +0000 UTC m=+857.820176339" Jul 20 19:29:27.415028 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:27.414999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c84466777-pq64k" Jul 20 19:29:59.015182 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:59.015095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:29:59.018157 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:59.018125 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:29:59.018956 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:59.018931 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:29:59.021712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:29:59.021693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:30:00.143973 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.143939 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw"] Jul 20 19:30:00.148653 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.148629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" Jul 20 19:30:00.151633 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.151606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 19:30:00.153895 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.153865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw"] Jul 20 19:30:00.159610 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.159590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" Jul 20 19:30:00.510216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.510191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw"] Jul 20 19:30:00.512208 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:30:00.512179 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb084c127_4641_42ce_9d23_ff76d6631c4e.slice/crio-ce895525e9c42200fe39e521116cc4691d1b8b62bca181e6e1fe9711864a6c67 WatchSource:0}: Error finding container ce895525e9c42200fe39e521116cc4691d1b8b62bca181e6e1fe9711864a6c67: Status 404 returned error can't find the container with id ce895525e9c42200fe39e521116cc4691d1b8b62bca181e6e1fe9711864a6c67 Jul 20 19:30:00.630885 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:00.630852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" event={"ID":"b084c127-4641-42ce-9d23-ff76d6631c4e","Type":"ContainerStarted","Data":"ce895525e9c42200fe39e521116cc4691d1b8b62bca181e6e1fe9711864a6c67"} Jul 20 19:30:03.650976 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:03.650940 2576 generic.go:356] "Generic (PLEG): container finished" podID="b084c127-4641-42ce-9d23-ff76d6631c4e" containerID="af0ac1a5bd668e7f840b456ff473c8f1b819937db12d100c92cd0f1c975f0b0e" exitCode=0 Jul 20 19:30:03.651378 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:03.651022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" event={"ID":"b084c127-4641-42ce-9d23-ff76d6631c4e","Type":"ContainerDied","Data":"af0ac1a5bd668e7f840b456ff473c8f1b819937db12d100c92cd0f1c975f0b0e"} Jul 20 19:30:04.800385 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:04.800353 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" Jul 20 19:30:05.663522 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:05.663484 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" Jul 20 19:30:05.663522 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:05.663520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-snhkw" event={"ID":"b084c127-4641-42ce-9d23-ff76d6631c4e","Type":"ContainerDied","Data":"ce895525e9c42200fe39e521116cc4691d1b8b62bca181e6e1fe9711864a6c67"} Jul 20 19:30:05.663785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:30:05.663564 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce895525e9c42200fe39e521116cc4691d1b8b62bca181e6e1fe9711864a6c67" Jul 20 19:34:59.047829 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:34:59.047799 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:34:59.051128 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:34:59.051107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:34:59.051818 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:34:59.051797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:34:59.054826 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:34:59.054807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:39:59.080146 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:39:59.080016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:39:59.084299 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:39:59.083530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:39:59.085592 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:39:59.085569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:39:59.089131 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:39:59.089113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:42:26.366092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.366060 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw"] Jul 20 19:42:26.366722 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.366705 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b084c127-4641-42ce-9d23-ff76d6631c4e" containerName="cleanup" Jul 20 19:42:26.366801 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.366726 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b084c127-4641-42ce-9d23-ff76d6631c4e" containerName="cleanup" Jul 20 19:42:26.366872 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.366851 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b084c127-4641-42ce-9d23-ff76d6631c4e" containerName="cleanup" Jul 20 19:42:26.370066 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.370044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.375130 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.375106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-95e08f34-openshift-default-dockercfg-4ndr4\"" Jul 20 19:42:26.465761 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.465731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw"] Jul 20 19:42:26.486192 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-certs\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486378 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-data\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486378 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-podinfo\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486378 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istiod-ca-cert\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486378 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlddd\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-kube-api-access-jlddd\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486614 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-token\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486614 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-socket\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486614 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-credential-socket\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.486614 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.486551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-envoy\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587286 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-credential-socket\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587286 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-envoy\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-certs\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-data\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-podinfo\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istiod-ca-cert\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlddd\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-kube-api-access-jlddd\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-token\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-socket\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-credential-socket\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587777 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-data\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.587851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.587813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-certs\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.588120 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.588069 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-socket\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.588429 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.588410 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istiod-ca-cert\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.589846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.589829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-envoy\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.590078 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.590060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-podinfo\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.602302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.602278 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-token\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.602457 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.602414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlddd\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-kube-api-access-jlddd\") pod \"e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.682598 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.682472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:26.839275 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.839249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw"] Jul 20 19:42:26.841515 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:42:26.841476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde39cb16_6c1c_4f80_b093_efb41bf2f6e8.slice/crio-4da5de5d37891eb5d841739d57fb6c992a3f1dae9d5e0483679d91e19410a882 WatchSource:0}: Error finding container 4da5de5d37891eb5d841739d57fb6c992a3f1dae9d5e0483679d91e19410a882: Status 404 returned error can't find the container with id 4da5de5d37891eb5d841739d57fb6c992a3f1dae9d5e0483679d91e19410a882 Jul 20 19:42:26.843560 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.843531 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:42:26.843631 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.843594 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:42:26.843631 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:26.843620 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:42:27.468078 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:27.468032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" event={"ID":"de39cb16-6c1c-4f80-b093-efb41bf2f6e8","Type":"ContainerStarted","Data":"01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131"} Jul 20 19:42:27.468481 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:27.468093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" event={"ID":"de39cb16-6c1c-4f80-b093-efb41bf2f6e8","Type":"ContainerStarted","Data":"4da5de5d37891eb5d841739d57fb6c992a3f1dae9d5e0483679d91e19410a882"} Jul 20 19:42:27.500736 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:27.500653 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podStartSLOduration=1.500630849 podStartE2EDuration="1.500630849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:42:27.497361775 +0000 UTC m=+1648.890101309" watchObservedRunningTime="2026-07-20 19:42:27.500630849 +0000 UTC m=+1648.893370383" Jul 20 19:42:27.683425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:27.683380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:27.688097 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:27.688070 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:28.473889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:28.473858 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:28.475049 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:28.475026 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:44.162837 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.161782 2576 patch_prober.go:28] interesting pod/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:47900->10.132.0.54:15021: read: connection reset by peer" start-of-body= Jul 20 19:42:44.162837 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.161850 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:47900->10.132.0.54:15021: read: connection reset by peer" Jul 20 19:42:44.575628 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.575596 2576 generic.go:356] "Generic (PLEG): container finished" podID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerID="01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131" exitCode=0 Jul 20 19:42:44.575803 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.575672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" event={"ID":"de39cb16-6c1c-4f80-b093-efb41bf2f6e8","Type":"ContainerDied","Data":"01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131"} Jul 20 19:42:44.576119 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.576105 2576 scope.go:117] "RemoveContainer" containerID="01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131" Jul 20 19:42:44.577147 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.577120 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:42:44.577210 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.577196 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:42:44.577247 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:44.577233 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:42:45.582715 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:45.582680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" event={"ID":"de39cb16-6c1c-4f80-b093-efb41bf2f6e8","Type":"ContainerStarted","Data":"5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f"} Jul 20 19:42:45.682896 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:45.682867 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:45.683095 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:45.683071 2576 patch_prober.go:28] interesting pod/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 19:42:45.683152 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:45.683133 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 19:42:46.682974 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:46.682936 2576 patch_prober.go:28] interesting pod/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 19:42:46.683403 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:46.683003 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 19:42:47.683856 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:47.683809 2576 patch_prober.go:28] interesting pod/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 19:42:47.684367 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:47.683882 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 19:42:48.683264 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:48.683220 2576 patch_prober.go:28] interesting pod/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 19:42:48.683448 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:48.683291 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 19:42:49.687385 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:49.687355 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:49.687852 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:49.687703 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:49.688542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:49.688521 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:42:54.400669 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.400623 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl"] Jul 20 19:42:54.404864 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.404836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:54.407546 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.407522 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 19:42:54.411177 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.411136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl"] Jul 20 19:42:54.456806 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.456768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6daa967-160a-4c50-917f-2bc9a6e6a971-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl\" (UID: \"f6daa967-160a-4c50-917f-2bc9a6e6a971\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:54.557924 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.557887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6daa967-160a-4c50-917f-2bc9a6e6a971-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl\" (UID: \"f6daa967-160a-4c50-917f-2bc9a6e6a971\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:54.558673 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.558652 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6daa967-160a-4c50-917f-2bc9a6e6a971-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl\" (UID: \"f6daa967-160a-4c50-917f-2bc9a6e6a971\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:54.719100 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.719006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:54.871647 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:54.871623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl"] Jul 20 19:42:54.874363 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:42:54.874328 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6daa967_160a_4c50_917f_2bc9a6e6a971.slice/crio-17c25f8ed3a138264012b7459f8224fb3f141043e5198e0e3edde9538c7fb5e8 WatchSource:0}: Error finding container 17c25f8ed3a138264012b7459f8224fb3f141043e5198e0e3edde9538c7fb5e8: Status 404 returned error can't find the container with id 17c25f8ed3a138264012b7459f8224fb3f141043e5198e0e3edde9538c7fb5e8 Jul 20 19:42:55.637649 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:55.637612 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6daa967-160a-4c50-917f-2bc9a6e6a971" containerID="091441980b542222db05c645f47139dffd37e4d1eb8867eab477e78aa23a700a" exitCode=0 Jul 20 19:42:55.638034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:55.637702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" event={"ID":"f6daa967-160a-4c50-917f-2bc9a6e6a971","Type":"ContainerDied","Data":"091441980b542222db05c645f47139dffd37e4d1eb8867eab477e78aa23a700a"} Jul 20 19:42:55.638034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:55.637758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" event={"ID":"f6daa967-160a-4c50-917f-2bc9a6e6a971","Type":"ContainerStarted","Data":"17c25f8ed3a138264012b7459f8224fb3f141043e5198e0e3edde9538c7fb5e8"} Jul 20 19:42:56.784246 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:56.784218 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:56.879207 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:56.879158 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6daa967-160a-4c50-917f-2bc9a6e6a971-maas-api-service-ca\") pod \"f6daa967-160a-4c50-917f-2bc9a6e6a971\" (UID: \"f6daa967-160a-4c50-917f-2bc9a6e6a971\") " Jul 20 19:42:56.879643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:56.879618 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6daa967-160a-4c50-917f-2bc9a6e6a971-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6daa967-160a-4c50-917f-2bc9a6e6a971" (UID: "f6daa967-160a-4c50-917f-2bc9a6e6a971"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:42:56.980125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:56.980025 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6daa967-160a-4c50-917f-2bc9a6e6a971-maas-api-service-ca\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:42:57.650731 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:57.650703 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" Jul 20 19:42:57.650991 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:57.650706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl" event={"ID":"f6daa967-160a-4c50-917f-2bc9a6e6a971","Type":"ContainerDied","Data":"17c25f8ed3a138264012b7459f8224fb3f141043e5198e0e3edde9538c7fb5e8"} Jul 20 19:42:57.650991 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:42:57.650824 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17c25f8ed3a138264012b7459f8224fb3f141043e5198e0e3edde9538c7fb5e8" Jul 20 19:43:09.528808 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:09.528767 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl"] Jul 20 19:43:09.539690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:09.539650 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-95e08f34-kvgcl"] Jul 20 19:43:09.716110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:09.716078 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw"] Jul 20 19:43:09.716328 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:09.716304 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" containerID="cri-o://5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f" gracePeriod=30 Jul 20 19:43:11.051276 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.051235 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6daa967-160a-4c50-917f-2bc9a6e6a971" path="/var/lib/kubelet/pods/f6daa967-160a-4c50-917f-2bc9a6e6a971/volumes" Jul 20 19:43:11.056449 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.056410 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48"] Jul 20 19:43:11.058189 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.058160 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6daa967-160a-4c50-917f-2bc9a6e6a971" containerName="revoke-keys" Jul 20 19:43:11.058189 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.058186 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6daa967-160a-4c50-917f-2bc9a6e6a971" containerName="revoke-keys" Jul 20 19:43:11.058438 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.058328 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6daa967-160a-4c50-917f-2bc9a6e6a971" containerName="revoke-keys" Jul 20 19:43:11.062235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.062211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.068545 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.068516 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-01a6b0f7-gw-openshift-default-dockercfg-ngx64\"" Jul 20 19:43:11.108199 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.108166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48"] Jul 20 19:43:11.211896 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.211855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-socket\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.211916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkml\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-kube-api-access-smkml\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-envoy\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-certs\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25599ae7-7a85-4db2-81fa-80920baa2946-istio-podinfo\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212324 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-istio-token\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212324 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-data\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212324 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-credential-socket\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.212486 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.212397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25599ae7-7a85-4db2-81fa-80920baa2946-istiod-ca-cert\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-socket\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkml\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-kube-api-access-smkml\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-envoy\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-certs\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25599ae7-7a85-4db2-81fa-80920baa2946-istio-podinfo\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-istio-token\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-data\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-credential-socket\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25599ae7-7a85-4db2-81fa-80920baa2946-istiod-ca-cert\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313946 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-socket\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.313946 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.313879 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-data\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.314067 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.314044 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-credential-socket\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.314114 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.314062 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-certs\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.314217 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.314193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25599ae7-7a85-4db2-81fa-80920baa2946-istiod-ca-cert\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.315598 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.315576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-envoy\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.315869 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.315848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25599ae7-7a85-4db2-81fa-80920baa2946-istio-podinfo\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.336236 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.336192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-istio-token\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.352943 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.352915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkml\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-kube-api-access-smkml\") pod \"e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.375841 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.375804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:11.535760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.535712 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48"] Jul 20 19:43:11.538388 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:43:11.538362 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25599ae7_7a85_4db2_81fa_80920baa2946.slice/crio-df8aeb41bae9c8d7108d01dc99ff1130e74b576926083985b64d9c8791c9b119 WatchSource:0}: Error finding container df8aeb41bae9c8d7108d01dc99ff1130e74b576926083985b64d9c8791c9b119: Status 404 returned error can't find the container with id df8aeb41bae9c8d7108d01dc99ff1130e74b576926083985b64d9c8791c9b119 Jul 20 19:43:11.540509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.540455 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:11.540613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.540541 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:11.540613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.540572 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:11.728603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.728559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" event={"ID":"25599ae7-7a85-4db2-81fa-80920baa2946","Type":"ContainerStarted","Data":"305daa4fe459b3dd3c56af63c8bb3be1a9fc1ee0aa0a040896b30bb555bbcc75"} Jul 20 19:43:11.728812 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:11.728629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" event={"ID":"25599ae7-7a85-4db2-81fa-80920baa2946","Type":"ContainerStarted","Data":"df8aeb41bae9c8d7108d01dc99ff1130e74b576926083985b64d9c8791c9b119"} Jul 20 19:43:12.376621 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:12.376581 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:12.382202 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:12.382175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:12.409672 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:12.409623 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podStartSLOduration=2.40960597 podStartE2EDuration="2.40960597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:43:11.758438514 +0000 UTC m=+1693.151178058" watchObservedRunningTime="2026-07-20 19:43:12.40960597 +0000 UTC m=+1693.802345504" Jul 20 19:43:12.734786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:12.734699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:12.735884 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:12.735860 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:14.977929 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:14.977904 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:43:15.049344 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049312 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-podinfo\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049534 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049349 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlddd\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-kube-api-access-jlddd\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049534 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-envoy\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049534 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-data\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049534 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049520 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-socket\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049585 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istiod-ca-cert\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049645 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-certs\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049673 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-token\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.049720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.049716 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-credential-socket\") pod \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\" (UID: \"de39cb16-6c1c-4f80-b093-efb41bf2f6e8\") " Jul 20 19:43:15.050079 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.050017 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:15.050079 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.050044 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:15.050262 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.050085 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:43:15.050262 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.050244 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:15.050590 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.050561 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:15.051807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.051780 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:43:15.051904 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.051877 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-kube-api-access-jlddd" (OuterVolumeSpecName: "kube-api-access-jlddd") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "kube-api-access-jlddd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:43:15.052027 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.052004 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:15.052261 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.052235 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "de39cb16-6c1c-4f80-b093-efb41bf2f6e8" (UID: "de39cb16-6c1c-4f80-b093-efb41bf2f6e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:43:15.150723 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150688 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150723 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150718 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150723 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150731 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150740 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150751 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlddd\" (UniqueName: \"kubernetes.io/projected/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-kube-api-access-jlddd\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150762 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150770 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150778 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.150999 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.150799 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de39cb16-6c1c-4f80-b093-efb41bf2f6e8-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:15.752448 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.752410 2576 generic.go:356] "Generic (PLEG): container finished" podID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerID="5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f" exitCode=0 Jul 20 19:43:15.752679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.752480 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" Jul 20 19:43:15.752679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.752481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" event={"ID":"de39cb16-6c1c-4f80-b093-efb41bf2f6e8","Type":"ContainerDied","Data":"5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f"} Jul 20 19:43:15.752679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.752594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw" event={"ID":"de39cb16-6c1c-4f80-b093-efb41bf2f6e8","Type":"ContainerDied","Data":"4da5de5d37891eb5d841739d57fb6c992a3f1dae9d5e0483679d91e19410a882"} Jul 20 19:43:15.752679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.752618 2576 scope.go:117] "RemoveContainer" containerID="5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f" Jul 20 19:43:15.762049 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.762025 2576 scope.go:117] "RemoveContainer" containerID="01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131" Jul 20 19:43:15.770318 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.770299 2576 scope.go:117] "RemoveContainer" containerID="5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f" Jul 20 19:43:15.770586 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:43:15.770567 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f\": container with ID starting with 5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f not found: ID does not exist" containerID="5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f" Jul 20 19:43:15.770628 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.770596 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f"} err="failed to get container status \"5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f\": rpc error: code = NotFound desc = could not find container \"5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f\": container with ID starting with 5c1f506ea185e9abab2a78b4c5681986483baf777262bbb7e22762c2588d067f not found: ID does not exist" Jul 20 19:43:15.770628 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.770614 2576 scope.go:117] "RemoveContainer" containerID="01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131" Jul 20 19:43:15.770857 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:43:15.770841 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131\": container with ID starting with 01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131 not found: ID does not exist" containerID="01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131" Jul 20 19:43:15.770895 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.770861 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131"} err="failed to get container status \"01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131\": rpc error: code = NotFound desc = could not find container \"01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131\": container with ID starting with 01689d62720b32102aa01f7a39156c81a9cc0e556fb3fedd227fe02e77bf7131 not found: ID does not exist" Jul 20 19:43:15.775867 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.775844 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw"] Jul 20 19:43:15.779216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:15.779196 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-95e08f34-openshift-default-8678d7547f-kbcpw"] Jul 20 19:43:17.042767 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:17.042735 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" path="/var/lib/kubelet/pods/de39cb16-6c1c-4f80-b093-efb41bf2f6e8/volumes" Jul 20 19:43:27.736349 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.736260 2576 patch_prober.go:28] interesting pod/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 19:43:27.736349 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.736322 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 19:43:27.820869 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.820837 2576 generic.go:356] "Generic (PLEG): container finished" podID="25599ae7-7a85-4db2-81fa-80920baa2946" containerID="305daa4fe459b3dd3c56af63c8bb3be1a9fc1ee0aa0a040896b30bb555bbcc75" exitCode=0 Jul 20 19:43:27.821046 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.820876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" event={"ID":"25599ae7-7a85-4db2-81fa-80920baa2946","Type":"ContainerDied","Data":"305daa4fe459b3dd3c56af63c8bb3be1a9fc1ee0aa0a040896b30bb555bbcc75"} Jul 20 19:43:27.821339 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.821321 2576 scope.go:117] "RemoveContainer" containerID="305daa4fe459b3dd3c56af63c8bb3be1a9fc1ee0aa0a040896b30bb555bbcc75" Jul 20 19:43:27.822569 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.822535 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:27.822643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.822613 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:27.822685 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:27.822658 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:28.831508 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:28.831450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" event={"ID":"25599ae7-7a85-4db2-81fa-80920baa2946","Type":"ContainerStarted","Data":"333b87d79db8992e36371af27dbbc1b088dd53575a99407db8b4358dda7a388b"} Jul 20 19:43:29.376774 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:29.376740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:29.376982 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:29.376959 2576 patch_prober.go:28] interesting pod/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 19:43:29.377037 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:29.377016 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 19:43:30.376189 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:30.376148 2576 patch_prober.go:28] interesting pod/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 19:43:30.376696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:30.376214 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 19:43:31.377229 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:31.377190 2576 patch_prober.go:28] interesting pod/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 19:43:31.377666 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:31.377289 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 19:43:32.376918 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:32.376878 2576 patch_prober.go:28] interesting pod/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 19:43:32.377126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:32.376937 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 19:43:33.380025 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:33.379994 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:33.380423 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:33.380404 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:33.381043 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:33.381019 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:38.435046 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435011 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj"] Jul 20 19:43:38.435487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435422 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" Jul 20 19:43:38.435487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435433 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" Jul 20 19:43:38.435487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435443 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" Jul 20 19:43:38.435487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435448 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" Jul 20 19:43:38.435643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435539 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" Jul 20 19:43:38.435643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.435547 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de39cb16-6c1c-4f80-b093-efb41bf2f6e8" containerName="istio-proxy" Jul 20 19:43:38.438680 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.438662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:38.441307 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.441289 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 19:43:38.446281 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.446255 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj"] Jul 20 19:43:38.489643 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.489604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695d98c0-ffb7-40a1-a89e-97a4eb77fac6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj\" (UID: \"695d98c0-ffb7-40a1-a89e-97a4eb77fac6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:38.590119 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.590085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695d98c0-ffb7-40a1-a89e-97a4eb77fac6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj\" (UID: \"695d98c0-ffb7-40a1-a89e-97a4eb77fac6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:38.590862 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.590839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695d98c0-ffb7-40a1-a89e-97a4eb77fac6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj\" (UID: \"695d98c0-ffb7-40a1-a89e-97a4eb77fac6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:38.751761 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.751670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:38.896360 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:38.896329 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj"] Jul 20 19:43:38.897617 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:43:38.897591 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695d98c0_ffb7_40a1_a89e_97a4eb77fac6.slice/crio-584568650e04767e4f322dcb6e3d906989a646438fc05d5d79edc690061df8bf WatchSource:0}: Error finding container 584568650e04767e4f322dcb6e3d906989a646438fc05d5d79edc690061df8bf: Status 404 returned error can't find the container with id 584568650e04767e4f322dcb6e3d906989a646438fc05d5d79edc690061df8bf Jul 20 19:43:39.896005 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:39.895964 2576 generic.go:356] "Generic (PLEG): container finished" podID="695d98c0-ffb7-40a1-a89e-97a4eb77fac6" containerID="6edaa4dfa9ff83330abcadd81de8dfb8f468715e9d252c10e82fcbe34ed21423" exitCode=0 Jul 20 19:43:39.896419 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:39.896048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" event={"ID":"695d98c0-ffb7-40a1-a89e-97a4eb77fac6","Type":"ContainerDied","Data":"6edaa4dfa9ff83330abcadd81de8dfb8f468715e9d252c10e82fcbe34ed21423"} Jul 20 19:43:39.896419 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:39.896134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" event={"ID":"695d98c0-ffb7-40a1-a89e-97a4eb77fac6","Type":"ContainerStarted","Data":"584568650e04767e4f322dcb6e3d906989a646438fc05d5d79edc690061df8bf"} Jul 20 19:43:41.031993 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.031967 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:41.115718 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.115683 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695d98c0-ffb7-40a1-a89e-97a4eb77fac6-maas-api-service-ca\") pod \"695d98c0-ffb7-40a1-a89e-97a4eb77fac6\" (UID: \"695d98c0-ffb7-40a1-a89e-97a4eb77fac6\") " Jul 20 19:43:41.116141 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.116114 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695d98c0-ffb7-40a1-a89e-97a4eb77fac6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "695d98c0-ffb7-40a1-a89e-97a4eb77fac6" (UID: "695d98c0-ffb7-40a1-a89e-97a4eb77fac6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:43:41.217024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.216929 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/695d98c0-ffb7-40a1-a89e-97a4eb77fac6-maas-api-service-ca\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:41.908314 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.908283 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" Jul 20 19:43:41.908509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.908313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj" event={"ID":"695d98c0-ffb7-40a1-a89e-97a4eb77fac6","Type":"ContainerDied","Data":"584568650e04767e4f322dcb6e3d906989a646438fc05d5d79edc690061df8bf"} Jul 20 19:43:41.908509 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:41.908359 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="584568650e04767e4f322dcb6e3d906989a646438fc05d5d79edc690061df8bf" Jul 20 19:43:53.518148 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:53.518101 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj"] Jul 20 19:43:53.520098 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:53.520072 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-01a6b0f7-n9qkj"] Jul 20 19:43:53.844905 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:53.844869 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48"] Jul 20 19:43:53.845129 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:53.845104 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" containerID="cri-o://333b87d79db8992e36371af27dbbc1b088dd53575a99407db8b4358dda7a388b" gracePeriod=30 Jul 20 19:43:55.042349 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.042312 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695d98c0-ffb7-40a1-a89e-97a4eb77fac6" path="/var/lib/kubelet/pods/695d98c0-ffb7-40a1-a89e-97a4eb77fac6/volumes" Jul 20 19:43:55.407838 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.407757 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x"] Jul 20 19:43:55.408191 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.408178 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695d98c0-ffb7-40a1-a89e-97a4eb77fac6" containerName="revoke-keys" Jul 20 19:43:55.408237 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.408192 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="695d98c0-ffb7-40a1-a89e-97a4eb77fac6" containerName="revoke-keys" Jul 20 19:43:55.408293 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.408284 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="695d98c0-ffb7-40a1-a89e-97a4eb77fac6" containerName="revoke-keys" Jul 20 19:43:55.411783 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.411763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.419022 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.418997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-709e15b3-openshift-default-dockercfg-4dnpd\"" Jul 20 19:43:55.433447 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.433408 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x"] Jul 20 19:43:55.565754 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-data\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.565947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-istio-token\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.565947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-envoy\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.565947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342ddca6-3a70-4ccd-856f-738339df568e-istio-podinfo\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.565947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342ddca6-3a70-4ccd-856f-738339df568e-istiod-ca-cert\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.565947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-socket\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.565947 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-credential-socket\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.566161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-certs\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.566161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.565994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8xp\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-kube-api-access-5j8xp\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-credential-socket\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-certs\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8xp\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-kube-api-access-5j8xp\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-data\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-istio-token\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-envoy\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.667800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342ddca6-3a70-4ccd-856f-738339df568e-istio-podinfo\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342ddca6-3a70-4ccd-856f-738339df568e-istiod-ca-cert\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-socket\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-credential-socket\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.667931 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-data\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.668020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-certs\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668323 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.668160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-socket\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.668545 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.668526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342ddca6-3a70-4ccd-856f-738339df568e-istiod-ca-cert\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.670008 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.669989 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-envoy\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.670271 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.670252 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342ddca6-3a70-4ccd-856f-738339df568e-istio-podinfo\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.678377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.678336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-istio-token\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.678543 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.678505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8xp\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-kube-api-access-5j8xp\") pod \"e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.722679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.722634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:55.902557 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.902523 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x"] Jul 20 19:43:55.906338 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:43:55.906304 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342ddca6_3a70_4ccd_856f_738339df568e.slice/crio-e4ca3ee10102f7266444b902b6be72832ed95f62b3bf42e178069f969e5b5e69 WatchSource:0}: Error finding container e4ca3ee10102f7266444b902b6be72832ed95f62b3bf42e178069f969e5b5e69: Status 404 returned error can't find the container with id e4ca3ee10102f7266444b902b6be72832ed95f62b3bf42e178069f969e5b5e69 Jul 20 19:43:55.908535 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.908469 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:55.908615 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.908573 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:55.908615 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.908602 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:43:55.988088 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:55.988048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" event={"ID":"342ddca6-3a70-4ccd-856f-738339df568e","Type":"ContainerStarted","Data":"e4ca3ee10102f7266444b902b6be72832ed95f62b3bf42e178069f969e5b5e69"} Jul 20 19:43:56.994894 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:56.994862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" event={"ID":"342ddca6-3a70-4ccd-856f-738339df568e","Type":"ContainerStarted","Data":"2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da"} Jul 20 19:43:57.045189 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:57.038552 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" podStartSLOduration=2.038531234 podStartE2EDuration="2.038531234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:43:57.036312131 +0000 UTC m=+1738.429051666" watchObservedRunningTime="2026-07-20 19:43:57.038531234 +0000 UTC m=+1738.431270768" Jul 20 19:43:57.723413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:57.723377 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:57.728549 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:57.728523 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:58.001457 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:58.001367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:58.002488 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:58.002471 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:43:59.009733 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.009700 2576 generic.go:356] "Generic (PLEG): container finished" podID="25599ae7-7a85-4db2-81fa-80920baa2946" containerID="333b87d79db8992e36371af27dbbc1b088dd53575a99407db8b4358dda7a388b" exitCode=0 Jul 20 19:43:59.010232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.009778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" event={"ID":"25599ae7-7a85-4db2-81fa-80920baa2946","Type":"ContainerDied","Data":"333b87d79db8992e36371af27dbbc1b088dd53575a99407db8b4358dda7a388b"} Jul 20 19:43:59.010232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.009858 2576 scope.go:117] "RemoveContainer" containerID="305daa4fe459b3dd3c56af63c8bb3be1a9fc1ee0aa0a040896b30bb555bbcc75" Jul 20 19:43:59.116653 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.116580 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:43:59.305119 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305082 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25599ae7-7a85-4db2-81fa-80920baa2946-istio-podinfo\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-istio-token\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305211 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-socket\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-credential-socket\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-envoy\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305280 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-data\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305300 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smkml\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-kube-api-access-smkml\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305354 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25599ae7-7a85-4db2-81fa-80920baa2946-istiod-ca-cert\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305681 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305387 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-certs\") pod \"25599ae7-7a85-4db2-81fa-80920baa2946\" (UID: \"25599ae7-7a85-4db2-81fa-80920baa2946\") " Jul 20 19:43:59.305786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305698 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:59.305786 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305726 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:59.305951 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.305907 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:59.306112 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.306077 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25599ae7-7a85-4db2-81fa-80920baa2946-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:43:59.306591 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.306563 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-data" (OuterVolumeSpecName: "istio-data") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:59.307687 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.307649 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25599ae7-7a85-4db2-81fa-80920baa2946-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:43:59.307687 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.307668 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-kube-api-access-smkml" (OuterVolumeSpecName: "kube-api-access-smkml") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "kube-api-access-smkml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:43:59.307941 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.307914 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-istio-token" (OuterVolumeSpecName: "istio-token") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:43:59.308189 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.308169 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25599ae7-7a85-4db2-81fa-80920baa2946" (UID: "25599ae7-7a85-4db2-81fa-80920baa2946"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406388 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406419 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25599ae7-7a85-4db2-81fa-80920baa2946-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406427 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406437 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406447 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406455 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406463 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25599ae7-7a85-4db2-81fa-80920baa2946-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406472 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smkml\" (UniqueName: \"kubernetes.io/projected/25599ae7-7a85-4db2-81fa-80920baa2946-kube-api-access-smkml\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:43:59.406475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:43:59.406480 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25599ae7-7a85-4db2-81fa-80920baa2946-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:00.017930 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:00.017899 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" Jul 20 19:44:00.018420 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:00.017929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48" event={"ID":"25599ae7-7a85-4db2-81fa-80920baa2946","Type":"ContainerDied","Data":"df8aeb41bae9c8d7108d01dc99ff1130e74b576926083985b64d9c8791c9b119"} Jul 20 19:44:00.018420 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:00.017996 2576 scope.go:117] "RemoveContainer" containerID="333b87d79db8992e36371af27dbbc1b088dd53575a99407db8b4358dda7a388b" Jul 20 19:44:00.045321 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:00.045288 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48"] Jul 20 19:44:00.049389 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:00.049360 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-01a6b0f7-gw-openshift-default-7c4647ff67-7tg48"] Jul 20 19:44:01.042911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:01.042876 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" path="/var/lib/kubelet/pods/25599ae7-7a85-4db2-81fa-80920baa2946/volumes" Jul 20 19:44:11.086568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:11.086453 2576 generic.go:356] "Generic (PLEG): container finished" podID="342ddca6-3a70-4ccd-856f-738339df568e" containerID="2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da" exitCode=0 Jul 20 19:44:11.086568 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:11.086531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" event={"ID":"342ddca6-3a70-4ccd-856f-738339df568e","Type":"ContainerDied","Data":"2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da"} Jul 20 19:44:11.086998 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:11.086956 2576 scope.go:117] "RemoveContainer" containerID="2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da" Jul 20 19:44:11.087942 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:11.087908 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:11.088089 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:11.087981 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:11.088089 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:11.088025 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:12.093917 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:12.093883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" event={"ID":"342ddca6-3a70-4ccd-856f-738339df568e","Type":"ContainerStarted","Data":"87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11"} Jul 20 19:44:12.723517 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:12.723456 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:44:12.724746 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:12.724707 2576 patch_prober.go:28] interesting pod/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 19:44:12.724893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:12.724793 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 19:44:13.001914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:13.001819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:44:13.723487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:13.723440 2576 patch_prober.go:28] interesting pod/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 19:44:13.724031 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:13.723539 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 19:44:14.723830 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:14.723781 2576 patch_prober.go:28] interesting pod/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 19:44:14.724458 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:14.724423 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 19:44:15.723791 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:15.723741 2576 patch_prober.go:28] interesting pod/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 19:44:15.724018 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:15.723812 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 19:44:16.727158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:16.727123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:44:16.728223 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:16.728200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:44:24.575760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.575718 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5"] Jul 20 19:44:24.576355 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.576333 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" Jul 20 19:44:24.576449 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.576357 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" Jul 20 19:44:24.576526 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.576476 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" Jul 20 19:44:24.576526 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.576510 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" Jul 20 19:44:24.580110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.580087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:24.582937 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.582914 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 19:44:24.587877 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.587848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5"] Jul 20 19:44:24.641655 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.641621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6610cc1-1e54-4920-b04a-09ea92d41b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5\" (UID: \"b6610cc1-1e54-4920-b04a-09ea92d41b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:24.743108 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.743073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6610cc1-1e54-4920-b04a-09ea92d41b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5\" (UID: \"b6610cc1-1e54-4920-b04a-09ea92d41b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:24.743790 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.743770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6610cc1-1e54-4920-b04a-09ea92d41b4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5\" (UID: \"b6610cc1-1e54-4920-b04a-09ea92d41b4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:24.892367 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:24.892276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:25.035798 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:25.035768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5"] Jul 20 19:44:25.038049 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:44:25.038019 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6610cc1_1e54_4920_b04a_09ea92d41b4c.slice/crio-7d1747265ce33639e7777feb9e9c9b8ba31a419877b983bedd6b25f59cefd428 WatchSource:0}: Error finding container 7d1747265ce33639e7777feb9e9c9b8ba31a419877b983bedd6b25f59cefd428: Status 404 returned error can't find the container with id 7d1747265ce33639e7777feb9e9c9b8ba31a419877b983bedd6b25f59cefd428 Jul 20 19:44:25.163716 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:25.163623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" event={"ID":"b6610cc1-1e54-4920-b04a-09ea92d41b4c","Type":"ContainerStarted","Data":"7d1747265ce33639e7777feb9e9c9b8ba31a419877b983bedd6b25f59cefd428"} Jul 20 19:44:26.170368 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:26.170336 2576 generic.go:356] "Generic (PLEG): container finished" podID="b6610cc1-1e54-4920-b04a-09ea92d41b4c" containerID="71b400278ad2f45df69e80cfe8f517ff2b52f8138d0ae8b5be4d0a9fb31ee1cc" exitCode=0 Jul 20 19:44:26.170797 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:26.170416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" event={"ID":"b6610cc1-1e54-4920-b04a-09ea92d41b4c","Type":"ContainerDied","Data":"71b400278ad2f45df69e80cfe8f517ff2b52f8138d0ae8b5be4d0a9fb31ee1cc"} Jul 20 19:44:27.319791 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:27.319763 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:27.471081 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:27.470981 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6610cc1-1e54-4920-b04a-09ea92d41b4c-maas-api-service-ca\") pod \"b6610cc1-1e54-4920-b04a-09ea92d41b4c\" (UID: \"b6610cc1-1e54-4920-b04a-09ea92d41b4c\") " Jul 20 19:44:27.471358 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:27.471334 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6610cc1-1e54-4920-b04a-09ea92d41b4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b6610cc1-1e54-4920-b04a-09ea92d41b4c" (UID: "b6610cc1-1e54-4920-b04a-09ea92d41b4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:44:27.572457 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:27.572421 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6610cc1-1e54-4920-b04a-09ea92d41b4c-maas-api-service-ca\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:28.182604 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:28.182574 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" Jul 20 19:44:28.182813 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:28.182620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5" event={"ID":"b6610cc1-1e54-4920-b04a-09ea92d41b4c","Type":"ContainerDied","Data":"7d1747265ce33639e7777feb9e9c9b8ba31a419877b983bedd6b25f59cefd428"} Jul 20 19:44:28.182813 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:28.182673 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d1747265ce33639e7777feb9e9c9b8ba31a419877b983bedd6b25f59cefd428" Jul 20 19:44:39.675026 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:39.674988 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5"] Jul 20 19:44:39.678409 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:39.678381 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709e15b3-vmsr5"] Jul 20 19:44:40.809442 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:40.809403 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x"] Jul 20 19:44:40.809836 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:40.809757 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" containerID="cri-o://87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11" gracePeriod=30 Jul 20 19:44:41.043062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.043024 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6610cc1-1e54-4920-b04a-09ea92d41b4c" path="/var/lib/kubelet/pods/b6610cc1-1e54-4920-b04a-09ea92d41b4c/volumes" Jul 20 19:44:41.606538 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.606505 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq"] Jul 20 19:44:41.606941 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.606928 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6610cc1-1e54-4920-b04a-09ea92d41b4c" containerName="revoke-keys" Jul 20 19:44:41.607006 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.606942 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6610cc1-1e54-4920-b04a-09ea92d41b4c" containerName="revoke-keys" Jul 20 19:44:41.607006 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.606958 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" Jul 20 19:44:41.607006 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.606964 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="25599ae7-7a85-4db2-81fa-80920baa2946" containerName="istio-proxy" Jul 20 19:44:41.607163 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.607038 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6610cc1-1e54-4920-b04a-09ea92d41b4c" containerName="revoke-keys" Jul 20 19:44:41.610249 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.610231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.615029 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.615003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-77ee2bb7-openshift-default-dockercfg-7fb7c\"" Jul 20 19:44:41.627369 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.627344 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq"] Jul 20 19:44:41.709470 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-data\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.709700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-envoy\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.709700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-token\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.709700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-podinfo\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.709700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmm52\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-kube-api-access-dmm52\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.710000 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd80ad0-e341-4ebd-aace-267065db7ede-istiod-ca-cert\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.710000 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-socket\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.710000 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-certs\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.710000 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.709911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-credential-socket\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.810531 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-socket\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-certs\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-credential-socket\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-data\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-envoy\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-token\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-podinfo\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmm52\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-kube-api-access-dmm52\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd80ad0-e341-4ebd-aace-267065db7ede-istiod-ca-cert\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-socket\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811011 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.810990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-certs\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.811238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-data\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.811301 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-credential-socket\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.811898 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.811878 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd80ad0-e341-4ebd-aace-267065db7ede-istiod-ca-cert\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.813402 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.813382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-envoy\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.813548 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.813526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-podinfo\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.819871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.819848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-token\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.820088 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.820067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmm52\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-kube-api-access-dmm52\") pod \"e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:41.922147 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:41.922054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:42.076034 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.076007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq"] Jul 20 19:44:42.078171 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:44:42.078141 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd80ad0_e341_4ebd_aace_267065db7ede.slice/crio-6af4c1c26d8b3dd244ef8f13bf16fed44ae8e01e7d05e6e660ffed2b17555cc6 WatchSource:0}: Error finding container 6af4c1c26d8b3dd244ef8f13bf16fed44ae8e01e7d05e6e660ffed2b17555cc6: Status 404 returned error can't find the container with id 6af4c1c26d8b3dd244ef8f13bf16fed44ae8e01e7d05e6e660ffed2b17555cc6 Jul 20 19:44:42.080270 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.080239 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:42.080347 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.080306 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:42.080347 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.080340 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:42.261978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.261891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" event={"ID":"9cd80ad0-e341-4ebd-aace-267065db7ede","Type":"ContainerStarted","Data":"eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340"} Jul 20 19:44:42.261978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.261947 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" event={"ID":"9cd80ad0-e341-4ebd-aace-267065db7ede","Type":"ContainerStarted","Data":"6af4c1c26d8b3dd244ef8f13bf16fed44ae8e01e7d05e6e660ffed2b17555cc6"} Jul 20 19:44:42.282649 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.282593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" podStartSLOduration=1.282575096 podStartE2EDuration="1.282575096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:44:42.281044964 +0000 UTC m=+1783.673784496" watchObservedRunningTime="2026-07-20 19:44:42.282575096 +0000 UTC m=+1783.675314705" Jul 20 19:44:42.922708 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:42.922673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:43.938638 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:43.938598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:44.273566 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:44.273465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:44.274690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:44.274667 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:46.070071 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.070006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:44:46.155033 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.154994 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-envoy\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155041 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-credential-socket\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155078 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-socket\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-istio-token\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155183 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342ddca6-3a70-4ccd-856f-738339df568e-istiod-ca-cert\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155233 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-data\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155574 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342ddca6-3a70-4ccd-856f-738339df568e-istio-podinfo\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155574 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155288 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-certs\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155574 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155423 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:44:46.155574 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155437 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:44:46.155574 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155526 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j8xp\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-kube-api-access-5j8xp\") pod \"342ddca6-3a70-4ccd-856f-738339df568e\" (UID: \"342ddca6-3a70-4ccd-856f-738339df568e\") " Jul 20 19:44:46.155842 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155779 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:44:46.155842 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155805 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342ddca6-3a70-4ccd-856f-738339df568e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:44:46.155966 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155948 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/342ddca6-3a70-4ccd-856f-738339df568e-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.156022 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155967 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.156022 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155982 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.156022 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.155998 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.156187 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.156161 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-data" (OuterVolumeSpecName: "istio-data") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:44:46.157600 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.157571 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-istio-token" (OuterVolumeSpecName: "istio-token") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:44:46.157849 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.157828 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:44:46.157912 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.157831 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-kube-api-access-5j8xp" (OuterVolumeSpecName: "kube-api-access-5j8xp") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "kube-api-access-5j8xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:44:46.157954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.157915 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/342ddca6-3a70-4ccd-856f-738339df568e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "342ddca6-3a70-4ccd-856f-738339df568e" (UID: "342ddca6-3a70-4ccd-856f-738339df568e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:44:46.256721 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.256683 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.256721 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.256714 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/342ddca6-3a70-4ccd-856f-738339df568e-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.256721 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.256723 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j8xp\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-kube-api-access-5j8xp\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.256721 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.256733 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/342ddca6-3a70-4ccd-856f-738339df568e-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.256994 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.256741 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/342ddca6-3a70-4ccd-856f-738339df568e-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:44:46.286185 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.286150 2576 generic.go:356] "Generic (PLEG): container finished" podID="342ddca6-3a70-4ccd-856f-738339df568e" containerID="87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11" exitCode=0 Jul 20 19:44:46.286390 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.286191 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" Jul 20 19:44:46.286390 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.286232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" event={"ID":"342ddca6-3a70-4ccd-856f-738339df568e","Type":"ContainerDied","Data":"87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11"} Jul 20 19:44:46.286390 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.286294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x" event={"ID":"342ddca6-3a70-4ccd-856f-738339df568e","Type":"ContainerDied","Data":"e4ca3ee10102f7266444b902b6be72832ed95f62b3bf42e178069f969e5b5e69"} Jul 20 19:44:46.286390 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.286323 2576 scope.go:117] "RemoveContainer" containerID="87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11" Jul 20 19:44:46.296811 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.296795 2576 scope.go:117] "RemoveContainer" containerID="2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da" Jul 20 19:44:46.305708 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.305690 2576 scope.go:117] "RemoveContainer" containerID="87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11" Jul 20 19:44:46.306029 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:44:46.306010 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11\": container with ID starting with 87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11 not found: ID does not exist" containerID="87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11" Jul 20 19:44:46.306087 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.306041 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11"} err="failed to get container status \"87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11\": rpc error: code = NotFound desc = could not find container \"87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11\": container with ID starting with 87c6437c1aadbcbc4274234260220383ec3539ec38585c67fe6ee01e2a5b5a11 not found: ID does not exist" Jul 20 19:44:46.306087 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.306062 2576 scope.go:117] "RemoveContainer" containerID="2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da" Jul 20 19:44:46.306314 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:44:46.306297 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da\": container with ID starting with 2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da not found: ID does not exist" containerID="2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da" Jul 20 19:44:46.306362 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.306324 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da"} err="failed to get container status \"2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da\": rpc error: code = NotFound desc = could not find container \"2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da\": container with ID starting with 2ad45c42173bc5c118f928e04ec429868d455b8a3b61ee654bac90ed2e3a51da not found: ID does not exist" Jul 20 19:44:46.311232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.311202 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x"] Jul 20 19:44:46.319074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:46.319042 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-709e15b3-openshift-default-68b794c5ff-fhd4x"] Jul 20 19:44:47.043965 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:47.043932 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="342ddca6-3a70-4ccd-856f-738339df568e" path="/var/lib/kubelet/pods/342ddca6-3a70-4ccd-856f-738339df568e/volumes" Jul 20 19:44:57.351192 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:57.351154 2576 generic.go:356] "Generic (PLEG): container finished" podID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerID="eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340" exitCode=0 Jul 20 19:44:57.351673 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:57.351230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" event={"ID":"9cd80ad0-e341-4ebd-aace-267065db7ede","Type":"ContainerDied","Data":"eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340"} Jul 20 19:44:57.351779 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:57.351763 2576 scope.go:117] "RemoveContainer" containerID="eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340" Jul 20 19:44:57.352893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:57.352864 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:57.352969 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:57.352951 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:57.353023 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:57.353007 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:44:58.359664 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:58.359629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" event={"ID":"9cd80ad0-e341-4ebd-aace-267065db7ede","Type":"ContainerStarted","Data":"59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1"} Jul 20 19:44:58.922870 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:58.922829 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:58.924032 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:58.923999 2576 patch_prober.go:28] interesting pod/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 19:44:58.924178 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:58.924081 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 19:44:59.113382 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.113352 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:44:59.116694 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.116670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:44:59.121396 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.121373 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:44:59.149845 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.149820 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:44:59.274367 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.274344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:44:59.922954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.922917 2576 patch_prober.go:28] interesting pod/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 19:44:59.923602 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:44:59.923565 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 19:45:00.923176 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:00.923135 2576 patch_prober.go:28] interesting pod/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 19:45:00.923844 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:00.923810 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 19:45:01.922851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:01.922803 2576 patch_prober.go:28] interesting pod/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 19:45:01.923155 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:01.923120 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 19:45:02.927325 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:02.927293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:45:02.928515 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:02.928464 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:45:08.495914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.495872 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr"] Jul 20 19:45:08.496651 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.496629 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" Jul 20 19:45:08.496713 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.496655 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" Jul 20 19:45:08.496787 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.496773 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" Jul 20 19:45:08.496828 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.496793 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" Jul 20 19:45:08.500409 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.500389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:08.503137 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.503112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 19:45:08.505177 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.505157 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr"] Jul 20 19:45:08.568064 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.568019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3854f13-9889-4d01-8c73-e814cad6eb01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr\" (UID: \"c3854f13-9889-4d01-8c73-e814cad6eb01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:08.669529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.669457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3854f13-9889-4d01-8c73-e814cad6eb01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr\" (UID: \"c3854f13-9889-4d01-8c73-e814cad6eb01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:08.670168 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.670141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3854f13-9889-4d01-8c73-e814cad6eb01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr\" (UID: \"c3854f13-9889-4d01-8c73-e814cad6eb01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:08.813406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.813365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:08.955453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:08.955424 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr"] Jul 20 19:45:08.957878 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:45:08.957841 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3854f13_9889_4d01_8c73_e814cad6eb01.slice/crio-73ace0bcf8dab817f1f84adc53135097619bcf3fe01ebc77db3d86348487cf20 WatchSource:0}: Error finding container 73ace0bcf8dab817f1f84adc53135097619bcf3fe01ebc77db3d86348487cf20: Status 404 returned error can't find the container with id 73ace0bcf8dab817f1f84adc53135097619bcf3fe01ebc77db3d86348487cf20 Jul 20 19:45:09.419756 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:09.419664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" event={"ID":"c3854f13-9889-4d01-8c73-e814cad6eb01","Type":"ContainerStarted","Data":"99a9a86320e0551195d27df85c84c8bc58c152b2370c37c0e8501d4684066ce2"} Jul 20 19:45:09.419756 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:09.419721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" event={"ID":"c3854f13-9889-4d01-8c73-e814cad6eb01","Type":"ContainerStarted","Data":"73ace0bcf8dab817f1f84adc53135097619bcf3fe01ebc77db3d86348487cf20"} Jul 20 19:45:09.436817 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:09.436762 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" podStartSLOduration=1.436744339 podStartE2EDuration="1.436744339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:09.434618109 +0000 UTC m=+1810.827357643" watchObservedRunningTime="2026-07-20 19:45:09.436744339 +0000 UTC m=+1810.829483871" Jul 20 19:45:10.426825 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:10.426791 2576 generic.go:356] "Generic (PLEG): container finished" podID="c3854f13-9889-4d01-8c73-e814cad6eb01" containerID="99a9a86320e0551195d27df85c84c8bc58c152b2370c37c0e8501d4684066ce2" exitCode=0 Jul 20 19:45:10.427211 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:10.426878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" event={"ID":"c3854f13-9889-4d01-8c73-e814cad6eb01","Type":"ContainerDied","Data":"99a9a86320e0551195d27df85c84c8bc58c152b2370c37c0e8501d4684066ce2"} Jul 20 19:45:11.572232 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:11.572204 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:11.699635 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:11.699546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3854f13-9889-4d01-8c73-e814cad6eb01-maas-api-service-ca\") pod \"c3854f13-9889-4d01-8c73-e814cad6eb01\" (UID: \"c3854f13-9889-4d01-8c73-e814cad6eb01\") " Jul 20 19:45:11.699932 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:11.699909 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3854f13-9889-4d01-8c73-e814cad6eb01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3854f13-9889-4d01-8c73-e814cad6eb01" (UID: "c3854f13-9889-4d01-8c73-e814cad6eb01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:45:11.800989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:11.800946 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3854f13-9889-4d01-8c73-e814cad6eb01-maas-api-service-ca\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:12.438339 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:12.438310 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" Jul 20 19:45:12.438542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:12.438352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr" event={"ID":"c3854f13-9889-4d01-8c73-e814cad6eb01","Type":"ContainerDied","Data":"73ace0bcf8dab817f1f84adc53135097619bcf3fe01ebc77db3d86348487cf20"} Jul 20 19:45:12.438542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:12.438402 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73ace0bcf8dab817f1f84adc53135097619bcf3fe01ebc77db3d86348487cf20" Jul 20 19:45:23.572635 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:23.572597 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr"] Jul 20 19:45:23.576954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:23.576926 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-77ee2bb7-2t4kr"] Jul 20 19:45:23.702560 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:23.702527 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq"] Jul 20 19:45:23.702860 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:23.702827 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" containerID="cri-o://59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1" gracePeriod=30 Jul 20 19:45:25.042446 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:25.042412 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3854f13-9889-4d01-8c73-e814cad6eb01" path="/var/lib/kubelet/pods/c3854f13-9889-4d01-8c73-e814cad6eb01/volumes" Jul 20 19:45:28.965700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:28.965638 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:45:29.071908 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.071867 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd80ad0-e341-4ebd-aace-267065db7ede-istiod-ca-cert\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.071921 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-certs\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.071954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-token\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-socket\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072052 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-envoy\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-podinfo\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072123 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-data\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-credential-socket\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072191 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmm52\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-kube-api-access-dmm52\") pod \"9cd80ad0-e341-4ebd-aace-267065db7ede\" (UID: \"9cd80ad0-e341-4ebd-aace-267065db7ede\") " Jul 20 19:45:29.072377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072296 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:45:29.072377 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072309 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd80ad0-e341-4ebd-aace-267065db7ede-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:45:29.072692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:45:29.072692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072618 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:45:29.072692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072629 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cd80ad0-e341-4ebd-aace-267065db7ede-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.072692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072649 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.072692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.072665 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.073212 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.073181 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:45:29.074422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.074390 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-kube-api-access-dmm52" (OuterVolumeSpecName: "kube-api-access-dmm52") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "kube-api-access-dmm52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:45:29.074422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.074408 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:45:29.074762 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.074742 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:45:29.074810 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.074767 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cd80ad0-e341-4ebd-aace-267065db7ede" (UID: "9cd80ad0-e341-4ebd-aace-267065db7ede"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:45:29.173656 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.173617 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.173656 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.173649 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.173656 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.173658 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.173656 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.173667 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cd80ad0-e341-4ebd-aace-267065db7ede-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.173935 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.173676 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmm52\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-kube-api-access-dmm52\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.173935 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.173685 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd80ad0-e341-4ebd-aace-267065db7ede-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:45:29.528217 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.528179 2576 generic.go:356] "Generic (PLEG): container finished" podID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerID="59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1" exitCode=0 Jul 20 19:45:29.528406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.528235 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" Jul 20 19:45:29.528406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.528261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" event={"ID":"9cd80ad0-e341-4ebd-aace-267065db7ede","Type":"ContainerDied","Data":"59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1"} Jul 20 19:45:29.528406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.528323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq" event={"ID":"9cd80ad0-e341-4ebd-aace-267065db7ede","Type":"ContainerDied","Data":"6af4c1c26d8b3dd244ef8f13bf16fed44ae8e01e7d05e6e660ffed2b17555cc6"} Jul 20 19:45:29.528406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.528346 2576 scope.go:117] "RemoveContainer" containerID="59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1" Jul 20 19:45:29.538726 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.538706 2576 scope.go:117] "RemoveContainer" containerID="eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340" Jul 20 19:45:29.547302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.547277 2576 scope.go:117] "RemoveContainer" containerID="59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1" Jul 20 19:45:29.547639 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:45:29.547615 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1\": container with ID starting with 59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1 not found: ID does not exist" containerID="59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1" Jul 20 19:45:29.547722 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.547647 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1"} err="failed to get container status \"59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1\": rpc error: code = NotFound desc = could not find container \"59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1\": container with ID starting with 59fa82bed1fd3bc04c285ebeb34c1faf5a10497687bf0c1f20711e9306ee47e1 not found: ID does not exist" Jul 20 19:45:29.547722 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.547667 2576 scope.go:117] "RemoveContainer" containerID="eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340" Jul 20 19:45:29.547973 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:45:29.547921 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340\": container with ID starting with eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340 not found: ID does not exist" containerID="eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340" Jul 20 19:45:29.548098 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.547982 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340"} err="failed to get container status \"eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340\": rpc error: code = NotFound desc = could not find container \"eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340\": container with ID starting with eaf2d7cb02fa2bee9a4710a14ae87726827b7207eb7ca5d04cc9e5634617f340 not found: ID does not exist" Jul 20 19:45:29.550890 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.550869 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq"] Jul 20 19:45:29.554881 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:29.554859 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-77ee2bb7-openshift-default-58fd89d78c-pkkjq"] Jul 20 19:45:31.042636 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:45:31.042601 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" path="/var/lib/kubelet/pods/9cd80ad0-e341-4ebd-aace-267065db7ede/volumes" Jul 20 19:47:05.466005 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.465967 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml"] Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466421 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466435 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="342ddca6-3a70-4ccd-856f-738339df568e" containerName="istio-proxy" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466452 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466458 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466477 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3854f13-9889-4d01-8c73-e814cad6eb01" containerName="revoke-keys" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466483 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3854f13-9889-4d01-8c73-e814cad6eb01" containerName="revoke-keys" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466510 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" Jul 20 19:47:05.466579 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466516 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" Jul 20 19:47:05.466836 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466599 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3854f13-9889-4d01-8c73-e814cad6eb01" containerName="revoke-keys" Jul 20 19:47:05.466836 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466608 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" Jul 20 19:47:05.466836 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.466614 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd80ad0-e341-4ebd-aace-267065db7ede" containerName="istio-proxy" Jul 20 19:47:05.469220 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.469201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.471946 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.471927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-561ddcc3-openshift-default-dockercfg-2x9qb\"" Jul 20 19:47:05.476358 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istiod-ca-cert\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476554 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-credential-socket\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476554 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-token\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476554 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-data\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476554 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-certs\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476796 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-podinfo\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476796 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg56d\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-kube-api-access-gg56d\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476796 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-socket\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.476796 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.476677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-envoy\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.492009 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.491969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml"] Jul 20 19:47:05.577728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-certs\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.577934 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-podinfo\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.577934 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg56d\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-kube-api-access-gg56d\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.577934 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-socket\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.577934 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-envoy\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.577934 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istiod-ca-cert\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.577934 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-credential-socket\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578285 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.577976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-token\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578285 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.578016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-data\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578285 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.578219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-socket\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578428 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.578288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-data\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578520 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.578472 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-credential-socket\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.578728 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-certs\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.578910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.578889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istiod-ca-cert\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.580368 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.580348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-envoy\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.580710 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.580690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-podinfo\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.586421 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.586398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg56d\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-kube-api-access-gg56d\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.586565 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.586435 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-token\") pod \"e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.782476 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.782433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:05.938081 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.938048 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml"] Jul 20 19:47:05.939158 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:47:05.939125 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1f29a1_66e8_4af8_8dbc_3d41b9ef9a88.slice/crio-e3ef86e8e1cb5be21fc87e138094ac06bdc5ace23d2fc85e7ee86a7fc328350e WatchSource:0}: Error finding container e3ef86e8e1cb5be21fc87e138094ac06bdc5ace23d2fc85e7ee86a7fc328350e: Status 404 returned error can't find the container with id e3ef86e8e1cb5be21fc87e138094ac06bdc5ace23d2fc85e7ee86a7fc328350e Jul 20 19:47:05.944253 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.944212 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:47:05.944359 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.944295 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:47:05.944359 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:05.944325 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:47:06.043312 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:06.043220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" event={"ID":"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88","Type":"ContainerStarted","Data":"aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a"} Jul 20 19:47:06.043312 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:06.043280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" event={"ID":"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88","Type":"ContainerStarted","Data":"e3ef86e8e1cb5be21fc87e138094ac06bdc5ace23d2fc85e7ee86a7fc328350e"} Jul 20 19:47:06.065443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:06.065387 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podStartSLOduration=1.065364886 podStartE2EDuration="1.065364886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:47:06.063026872 +0000 UTC m=+1927.455766420" watchObservedRunningTime="2026-07-20 19:47:06.065364886 +0000 UTC m=+1927.458104420" Jul 20 19:47:06.782854 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:06.782812 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:07.788714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:07.788683 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:08.053420 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:08.053342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:08.054453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:08.054436 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:21.122551 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:21.122433 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerID="aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a" exitCode=0 Jul 20 19:47:21.122551 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:21.122522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" event={"ID":"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88","Type":"ContainerDied","Data":"aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a"} Jul 20 19:47:21.123051 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:21.122926 2576 scope.go:117] "RemoveContainer" containerID="aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a" Jul 20 19:47:21.123992 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:21.123958 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:47:21.124080 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:21.124061 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:47:21.124119 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:21.124110 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:47:22.139074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:22.139033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" event={"ID":"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88","Type":"ContainerStarted","Data":"ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99"} Jul 20 19:47:22.783309 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:22.783276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:22.784276 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:22.784248 2576 patch_prober.go:28] interesting pod/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 19:47:22.784400 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:22.784306 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 19:47:23.054126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:23.054039 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:23.782873 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:23.782841 2576 patch_prober.go:28] interesting pod/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 19:47:23.783256 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:23.782902 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 19:47:24.783487 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:24.783449 2576 patch_prober.go:28] interesting pod/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 19:47:24.783910 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:24.783540 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 19:47:25.782911 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:25.782877 2576 patch_prober.go:28] interesting pod/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 19:47:25.783084 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:25.782936 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 19:47:26.787174 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:26.787138 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:26.788394 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:26.788371 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:41.212889 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:41.212850 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml"] Jul 20 19:47:41.213418 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:41.213069 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" containerID="cri-o://ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99" gracePeriod=30 Jul 20 19:47:41.789914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:41.789869 2576 patch_prober.go:28] interesting pod/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 19:47:41.790116 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:41.789937 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:47:46.473355 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.473329 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:46.568803 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.568767 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-credential-socket\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.568803 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.568804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-token\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.568855 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-podinfo\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.568882 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-envoy\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.568931 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-data\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.568965 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-certs\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg56d\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-kube-api-access-gg56d\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569070 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569036 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-socket\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569383 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569100 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istiod-ca-cert\") pod \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\" (UID: \"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88\") " Jul 20 19:47:46.569383 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569159 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:47:46.569383 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569320 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:47:46.569383 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569370 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:47:46.569640 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569406 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.569700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.569685 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:47:46.570121 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.570097 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:47:46.571488 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.571457 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:47:46.571677 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.571560 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:47:46.571677 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.571639 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:47:46.571774 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.571680 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-kube-api-access-gg56d" (OuterVolumeSpecName: "kube-api-access-gg56d") pod "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" (UID: "cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88"). InnerVolumeSpecName "kube-api-access-gg56d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:47:46.669954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.669909 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.669954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.669947 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.669954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.669959 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.670216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.669972 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg56d\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-kube-api-access-gg56d\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.670216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.669985 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.670216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.669998 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.670216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.670010 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:46.670216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:46.670022 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:47:47.280657 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.280620 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerID="ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99" exitCode=0 Jul 20 19:47:47.280847 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.280668 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" Jul 20 19:47:47.280847 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.280705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" event={"ID":"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88","Type":"ContainerDied","Data":"ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99"} Jul 20 19:47:47.280847 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.280769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml" event={"ID":"cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88","Type":"ContainerDied","Data":"e3ef86e8e1cb5be21fc87e138094ac06bdc5ace23d2fc85e7ee86a7fc328350e"} Jul 20 19:47:47.280847 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.280792 2576 scope.go:117] "RemoveContainer" containerID="ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99" Jul 20 19:47:47.290439 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.290418 2576 scope.go:117] "RemoveContainer" containerID="aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a" Jul 20 19:47:47.299111 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.299063 2576 scope.go:117] "RemoveContainer" containerID="ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99" Jul 20 19:47:47.299407 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:47:47.299373 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99\": container with ID starting with ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99 not found: ID does not exist" containerID="ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99" Jul 20 19:47:47.299537 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.299413 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99"} err="failed to get container status \"ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99\": rpc error: code = NotFound desc = could not find container \"ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99\": container with ID starting with ab35c7bfb3e7f08fcb52234861beea8924af1787dd64275c79f7693314fdce99 not found: ID does not exist" Jul 20 19:47:47.299537 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.299432 2576 scope.go:117] "RemoveContainer" containerID="aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a" Jul 20 19:47:47.299750 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:47:47.299732 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a\": container with ID starting with aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a not found: ID does not exist" containerID="aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a" Jul 20 19:47:47.299803 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.299757 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a"} err="failed to get container status \"aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a\": rpc error: code = NotFound desc = could not find container \"aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a\": container with ID starting with aa322df0b39c5b96ca2f6d51dc332a82a250df7b11fb3b658a45c94e201f964a not found: ID does not exist" Jul 20 19:47:47.299901 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.299884 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml"] Jul 20 19:47:47.304033 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:47.304000 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-561ddcc3-openshift-default-76dc8bd767-f6qml"] Jul 20 19:47:49.043477 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:47:49.043444 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" path="/var/lib/kubelet/pods/cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88/volumes" Jul 20 19:48:00.968229 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.968190 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6"] Jul 20 19:48:00.968834 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.968813 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" Jul 20 19:48:00.968917 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.968836 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" Jul 20 19:48:00.968917 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.968887 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" Jul 20 19:48:00.968917 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.968897 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" Jul 20 19:48:00.969064 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.969020 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" Jul 20 19:48:00.969064 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.969033 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd1f29a1-66e8-4af8-8dbc-3d41b9ef9a88" containerName="istio-proxy" Jul 20 19:48:00.973678 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.973658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.977743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.977716 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a730d34e-openshift-default-dockercfg-j48nf\"" Jul 20 19:48:00.986274 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.986248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6"] Jul 20 19:48:00.998624 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-socket\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.998811 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-envoy\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.998811 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-token\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.998811 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-podinfo\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.998811 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8hw5\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-kube-api-access-h8hw5\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.999020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-data\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.999020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-credential-socket\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.999020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-certs\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:00.999020 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:00.998944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istiod-ca-cert\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099437 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8hw5\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-kube-api-access-h8hw5\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099437 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-data\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099761 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-credential-socket\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099761 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-certs\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099761 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istiod-ca-cert\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099761 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-socket\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-envoy\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-token\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-podinfo\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-data\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.099990 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.099912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-socket\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.100269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.100251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-credential-socket\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.100590 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.100568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-certs\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.100689 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.100571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istiod-ca-cert\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.102112 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.102091 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-envoy\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.102532 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.102481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-podinfo\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.108749 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.108727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-token\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.109350 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.109327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8hw5\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-kube-api-access-h8hw5\") pod \"e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.284440 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.284397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:01.433878 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.433848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6"] Jul 20 19:48:01.435445 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:48:01.435416 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4b615b_9a29_4546_9e70_3b1c2dc5eea3.slice/crio-4aa3622b5f0e176914d7140d8cc9a9a7d3ba0c90ab478a0d36ac44284a9b6ae6 WatchSource:0}: Error finding container 4aa3622b5f0e176914d7140d8cc9a9a7d3ba0c90ab478a0d36ac44284a9b6ae6: Status 404 returned error can't find the container with id 4aa3622b5f0e176914d7140d8cc9a9a7d3ba0c90ab478a0d36ac44284a9b6ae6 Jul 20 19:48:01.437691 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.437651 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:48:01.437762 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.437744 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:48:01.437811 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:01.437796 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:48:02.369053 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:02.369013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" event={"ID":"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3","Type":"ContainerStarted","Data":"cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59"} Jul 20 19:48:02.369465 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:02.369070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" event={"ID":"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3","Type":"ContainerStarted","Data":"4aa3622b5f0e176914d7140d8cc9a9a7d3ba0c90ab478a0d36ac44284a9b6ae6"} Jul 20 19:48:02.394327 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:02.394270 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" podStartSLOduration=2.394251246 podStartE2EDuration="2.394251246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:48:02.391552717 +0000 UTC m=+1983.784292252" watchObservedRunningTime="2026-07-20 19:48:02.394251246 +0000 UTC m=+1983.786990779" Jul 20 19:48:03.284797 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:03.284756 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:03.289832 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:03.289803 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:03.374460 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:03.374425 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:03.375379 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:03.375362 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:16.457354 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:16.457247 2576 generic.go:356] "Generic (PLEG): container finished" podID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerID="cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59" exitCode=0 Jul 20 19:48:16.457354 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:16.457286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" event={"ID":"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3","Type":"ContainerDied","Data":"cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59"} Jul 20 19:48:16.457838 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:16.457784 2576 scope.go:117] "RemoveContainer" containerID="cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59" Jul 20 19:48:16.458818 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:16.458790 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:48:16.458881 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:16.458860 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:48:16.458926 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:16.458894 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:48:17.464268 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:17.464235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" event={"ID":"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3","Type":"ContainerStarted","Data":"daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29"} Jul 20 19:48:18.285682 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:18.285638 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:18.286921 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:18.286896 2576 patch_prober.go:28] interesting pod/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 19:48:18.287044 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:18.286943 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 19:48:18.374475 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:18.374441 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:19.285815 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:19.285771 2576 patch_prober.go:28] interesting pod/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 19:48:19.286252 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:19.285837 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 19:48:20.285968 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:20.285922 2576 patch_prober.go:28] interesting pod/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 19:48:20.286398 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:20.285986 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 19:48:21.285049 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:21.285010 2576 patch_prober.go:28] interesting pod/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 19:48:21.285235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:21.285071 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 19:48:22.288634 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:22.288600 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:22.289595 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:22.289574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:48:36.935251 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:36.935199 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn"] Jul 20 19:48:36.939427 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:36.939400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn"] Jul 20 19:48:36.939595 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:36.939523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:36.942209 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:36.942188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 19:48:37.052644 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:37.052612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn\" (UID: \"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:37.153446 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:37.153406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn\" (UID: \"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:37.154073 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:37.154053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn\" (UID: \"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:37.250901 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:37.250806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:37.394545 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:37.394510 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn"] Jul 20 19:48:37.397076 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:48:37.397044 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0ee07d_0f0a_4a2e_8f7c_3af7bc04e3bb.slice/crio-d0ad105a141b860f91c9764489772eeb253a754a0749d4449e7ee1183f49a0bf WatchSource:0}: Error finding container d0ad105a141b860f91c9764489772eeb253a754a0749d4449e7ee1183f49a0bf: Status 404 returned error can't find the container with id d0ad105a141b860f91c9764489772eeb253a754a0749d4449e7ee1183f49a0bf Jul 20 19:48:37.573529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:37.573470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" event={"ID":"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb","Type":"ContainerStarted","Data":"d0ad105a141b860f91c9764489772eeb253a754a0749d4449e7ee1183f49a0bf"} Jul 20 19:48:38.580353 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:38.580323 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb" containerID="4e5d02f5173d8e775716206d51c87e58b4c822f0359642d80412ad9d32089cf4" exitCode=0 Jul 20 19:48:38.580764 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:38.580410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" event={"ID":"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb","Type":"ContainerDied","Data":"4e5d02f5173d8e775716206d51c87e58b4c822f0359642d80412ad9d32089cf4"} Jul 20 19:48:39.724722 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:39.724695 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:39.878679 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:39.878570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb-maas-api-service-ca\") pod \"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb\" (UID: \"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb\") " Jul 20 19:48:39.878989 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:39.878962 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb" (UID: "ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:48:39.980282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:39.980231 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb-maas-api-service-ca\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:48:40.592428 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:40.592398 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" Jul 20 19:48:40.592648 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:40.592434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn" event={"ID":"ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb","Type":"ContainerDied","Data":"d0ad105a141b860f91c9764489772eeb253a754a0749d4449e7ee1183f49a0bf"} Jul 20 19:48:40.592648 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:40.592483 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0ad105a141b860f91c9764489772eeb253a754a0749d4449e7ee1183f49a0bf" Jul 20 19:48:57.014452 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:57.014413 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn"] Jul 20 19:48:57.016943 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:57.016922 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a730d34e-qbjvn"] Jul 20 19:48:57.042301 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:57.042272 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb" path="/var/lib/kubelet/pods/ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb/volumes" Jul 20 19:48:59.302208 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:48:59.302176 2576 scope.go:117] "RemoveContainer" containerID="091441980b542222db05c645f47139dffd37e4d1eb8867eab477e78aa23a700a" Jul 20 19:49:53.265723 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:53.265637 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6"] Jul 20 19:49:53.266330 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:53.265856 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" containerID="cri-o://daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29" gracePeriod=30 Jul 20 19:49:58.531301 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.531235 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:49:58.617576 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617545 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-credential-socket\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617587 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8hw5\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-kube-api-access-h8hw5\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617622 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-podinfo\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617649 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-data\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617701 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-token\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617742 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-socket\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617769 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-certs\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.617846 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617806 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-envoy\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617856 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istiod-ca-cert\") pod \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\" (UID: \"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3\") " Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.617880 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618092 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618107 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618197 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618218 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.618260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618235 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.618555 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618379 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:49:58.618851 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.618826 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:49:58.620021 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.619996 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-kube-api-access-h8hw5" (OuterVolumeSpecName: "kube-api-access-h8hw5") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "kube-api-access-h8hw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:49:58.620127 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.620112 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:49:58.620291 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.620276 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:49:58.620373 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.620347 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" (UID: "ff4b615b-9a29-4546-9e70-3b1c2dc5eea3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:49:58.719024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.718983 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.719024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.719015 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.719024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.719026 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8hw5\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-kube-api-access-h8hw5\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.719024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.719036 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.719358 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.719044 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:58.719358 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:58.719052 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:49:59.018104 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.018010 2576 generic.go:356] "Generic (PLEG): container finished" podID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerID="daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29" exitCode=0 Jul 20 19:49:59.018104 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.018060 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" Jul 20 19:49:59.018104 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.018080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" event={"ID":"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3","Type":"ContainerDied","Data":"daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29"} Jul 20 19:49:59.018371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.018125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6" event={"ID":"ff4b615b-9a29-4546-9e70-3b1c2dc5eea3","Type":"ContainerDied","Data":"4aa3622b5f0e176914d7140d8cc9a9a7d3ba0c90ab478a0d36ac44284a9b6ae6"} Jul 20 19:49:59.018371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.018147 2576 scope.go:117] "RemoveContainer" containerID="daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29" Jul 20 19:49:59.030366 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.030338 2576 scope.go:117] "RemoveContainer" containerID="cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59" Jul 20 19:49:59.039928 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.039896 2576 scope.go:117] "RemoveContainer" containerID="daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29" Jul 20 19:49:59.040286 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:49:59.040257 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29\": container with ID starting with daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29 not found: ID does not exist" containerID="daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29" Jul 20 19:49:59.040403 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.040288 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29"} err="failed to get container status \"daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29\": rpc error: code = NotFound desc = could not find container \"daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29\": container with ID starting with daef8bca1a15964dd3f550022b617bb7f425e27c681be437e8959ab059609a29 not found: ID does not exist" Jul 20 19:49:59.040403 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.040308 2576 scope.go:117] "RemoveContainer" containerID="cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59" Jul 20 19:49:59.040610 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:49:59.040589 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59\": container with ID starting with cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59 not found: ID does not exist" containerID="cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59" Jul 20 19:49:59.040676 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.040614 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59"} err="failed to get container status \"cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59\": rpc error: code = NotFound desc = could not find container \"cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59\": container with ID starting with cd8ed4f55ca53876f3c789a6b2e6c6497eb9909d36c6f7c29a8fda887782bd59 not found: ID does not exist" Jul 20 19:49:59.045191 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.045167 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6"] Jul 20 19:49:59.049718 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.049694 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a730d34e-openshift-default-664bf94b47-f7pv6"] Jul 20 19:49:59.145294 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.145267 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:49:59.148388 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.148365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:49:59.180488 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.180455 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:49:59.183653 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.183635 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:49:59.323630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:49:59.323562 2576 scope.go:117] "RemoveContainer" containerID="6edaa4dfa9ff83330abcadd81de8dfb8f468715e9d252c10e82fcbe34ed21423" Jul 20 19:50:01.042180 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:01.042150 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" path="/var/lib/kubelet/pods/ff4b615b-9a29-4546-9e70-3b1c2dc5eea3/volumes" Jul 20 19:50:49.535108 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535074 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7"] Jul 20 19:50:49.535603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535474 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" Jul 20 19:50:49.535603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535485 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" Jul 20 19:50:49.535603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535528 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb" containerName="revoke-keys" Jul 20 19:50:49.535603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535535 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb" containerName="revoke-keys" Jul 20 19:50:49.535603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535596 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed0ee07d-0f0a-4a2e-8f7c-3af7bc04e3bb" containerName="revoke-keys" Jul 20 19:50:49.535603 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535604 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" Jul 20 19:50:49.535798 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.535610 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" Jul 20 19:50:49.538778 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.538758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.541416 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.541393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-aae264-openshift-default-dockercfg-ftkrw\"" Jul 20 19:50:49.552432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.552406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7"] Jul 20 19:50:49.622461 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-token\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.622744 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-credential-socket\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.622744 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-data\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.622744 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-certs\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.622744 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-envoy\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.622744 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-podinfo\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.623035 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istiod-ca-cert\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.623035 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-socket\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.623035 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.622808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4tff\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-kube-api-access-j4tff\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723506 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-token\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-credential-socket\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-data\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-certs\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-envoy\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-podinfo\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.723714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istiod-ca-cert\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-socket\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.723762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4tff\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-kube-api-access-j4tff\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.724036 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-credential-socket\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724226 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.724198 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-data\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724390 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.724363 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-certs\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724456 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.724400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-socket\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.724774 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.724751 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istiod-ca-cert\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.726675 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.726649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-envoy\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.726888 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.726869 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-podinfo\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.732294 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.732264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-token\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.732630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.732612 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4tff\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-kube-api-access-j4tff\") pod \"e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:49.849244 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:49.849146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:50.006376 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.006348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7"] Jul 20 19:50:50.007468 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:50:50.007445 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cbc7f5_657d_4e10_bd2f_02506a5f09ba.slice/crio-75afb615ab72c70c7ce6b840d8f9b244d9e1ce292d02e65c5497de53bbe598f7 WatchSource:0}: Error finding container 75afb615ab72c70c7ce6b840d8f9b244d9e1ce292d02e65c5497de53bbe598f7: Status 404 returned error can't find the container with id 75afb615ab72c70c7ce6b840d8f9b244d9e1ce292d02e65c5497de53bbe598f7 Jul 20 19:50:50.009642 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.009603 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:50:50.009728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.009693 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:50:50.009778 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.009729 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:50:50.296743 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.296704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" event={"ID":"92cbc7f5-657d-4e10-bd2f-02506a5f09ba","Type":"ContainerStarted","Data":"230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822"} Jul 20 19:50:50.296957 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.296788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" event={"ID":"92cbc7f5-657d-4e10-bd2f-02506a5f09ba","Type":"ContainerStarted","Data":"75afb615ab72c70c7ce6b840d8f9b244d9e1ce292d02e65c5497de53bbe598f7"} Jul 20 19:50:50.327687 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.327578 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podStartSLOduration=1.327555918 podStartE2EDuration="1.327555918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:50:50.323824515 +0000 UTC m=+2151.716564049" watchObservedRunningTime="2026-07-20 19:50:50.327555918 +0000 UTC m=+2151.720295453" Jul 20 19:50:50.850289 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:50.850246 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:51.854818 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:51.854784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:52.309966 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:52.309937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:52.310975 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:52.310955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:50:57.391062 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.391031 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn"] Jul 20 19:50:57.391577 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.391533 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" Jul 20 19:50:57.391577 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.391547 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4b615b-9a29-4546-9e70-3b1c2dc5eea3" containerName="istio-proxy" Jul 20 19:50:57.395047 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.395017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.398467 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.398444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2fb506-openshift-default-dockercfg-txplj\"" Jul 20 19:50:57.410403 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.410374 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn"] Jul 20 19:50:57.498453 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bsp9\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-kube-api-access-4bsp9\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-data\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-envoy\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-socket\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-credential-socket\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498923 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3325056-7684-44a0-832b-8283e9a5bf2c-istiod-ca-cert\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498923 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-token\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498923 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-certs\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.498923 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.498849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-podinfo\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.599775 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.599733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-podinfo\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.599954 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.599794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bsp9\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-kube-api-access-4bsp9\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600015 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.599968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-data\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600071 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-envoy\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600130 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-socket\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600181 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-credential-socket\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600238 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3325056-7684-44a0-832b-8283e9a5bf2c-istiod-ca-cert\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600238 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-token\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600353 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-certs\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600353 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600328 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-data\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600536 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-socket\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600622 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-credential-socket\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600757 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600734 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-certs\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.600928 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.600908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3325056-7684-44a0-832b-8283e9a5bf2c-istiod-ca-cert\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.602260 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.602240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-envoy\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.602391 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.602376 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-podinfo\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.609057 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.609034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-token\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.609221 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.609203 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bsp9\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-kube-api-access-4bsp9\") pod \"e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.707101 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.707005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:57.854869 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.854840 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn"] Jul 20 19:50:57.857189 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:50:57.857145 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3325056_7684_44a0_832b_8283e9a5bf2c.slice/crio-5ee475ab9f0efc61cc82e45ff30dcff5eddca0fb070d723020f1aa904455e46e WatchSource:0}: Error finding container 5ee475ab9f0efc61cc82e45ff30dcff5eddca0fb070d723020f1aa904455e46e: Status 404 returned error can't find the container with id 5ee475ab9f0efc61cc82e45ff30dcff5eddca0fb070d723020f1aa904455e46e Jul 20 19:50:57.859537 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.859503 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:50:57.859636 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.859571 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:50:57.859636 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:57.859604 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:50:58.355339 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:58.355300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" event={"ID":"f3325056-7684-44a0-832b-8283e9a5bf2c","Type":"ContainerStarted","Data":"aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27"} Jul 20 19:50:58.355573 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:58.355359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" event={"ID":"f3325056-7684-44a0-832b-8283e9a5bf2c","Type":"ContainerStarted","Data":"5ee475ab9f0efc61cc82e45ff30dcff5eddca0fb070d723020f1aa904455e46e"} Jul 20 19:50:58.417833 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:58.417752 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podStartSLOduration=1.417733739 podStartE2EDuration="1.417733739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:50:58.416356567 +0000 UTC m=+2159.809096100" watchObservedRunningTime="2026-07-20 19:50:58.417733739 +0000 UTC m=+2159.810473268" Jul 20 19:50:58.707628 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:58.707536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:58.712728 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:58.712703 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:59.350109 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:59.350074 2576 scope.go:117] "RemoveContainer" containerID="71b400278ad2f45df69e80cfe8f517ff2b52f8138d0ae8b5be4d0a9fb31ee1cc" Jul 20 19:50:59.363219 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:59.363192 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:50:59.364322 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:50:59.364306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:51:05.970969 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:51:05.970927 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cbc7f5_657d_4e10_bd2f_02506a5f09ba.slice/crio-conmon-230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822.scope\": RecentStats: unable to find data in memory cache]" Jul 20 19:51:06.401407 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:06.401372 2576 generic.go:356] "Generic (PLEG): container finished" podID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerID="230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822" exitCode=0 Jul 20 19:51:06.401641 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:06.401444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" event={"ID":"92cbc7f5-657d-4e10-bd2f-02506a5f09ba","Type":"ContainerDied","Data":"230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822"} Jul 20 19:51:06.401895 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:06.401871 2576 scope.go:117] "RemoveContainer" containerID="230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822" Jul 20 19:51:06.402976 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:06.402946 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:51:06.403049 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:06.403033 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:51:06.403099 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:06.403070 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:51:07.310407 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:07.310359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:51:07.408696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:07.408660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" event={"ID":"92cbc7f5-657d-4e10-bd2f-02506a5f09ba","Type":"ContainerStarted","Data":"ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8"} Jul 20 19:51:07.851618 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:07.851573 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:51:07.851807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:07.851719 2576 patch_prober.go:28] interesting pod/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 19:51:07.851807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:07.851767 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 19:51:08.850184 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:08.850141 2576 patch_prober.go:28] interesting pod/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 19:51:08.850709 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:08.850200 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 19:51:09.849963 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:09.849917 2576 patch_prober.go:28] interesting pod/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 19:51:09.850185 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:09.850012 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 19:51:10.849717 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:10.849679 2576 patch_prober.go:28] interesting pod/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 19:51:10.850120 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:10.849741 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 19:51:11.854576 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:11.854548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:51:11.855054 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:11.854980 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:51:11.855902 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:11.855659 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:51:12.442711 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:12.442678 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerID="aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27" exitCode=0 Jul 20 19:51:12.442914 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:12.442753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" event={"ID":"f3325056-7684-44a0-832b-8283e9a5bf2c","Type":"ContainerDied","Data":"aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27"} Jul 20 19:51:12.443226 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:12.443210 2576 scope.go:117] "RemoveContainer" containerID="aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27" Jul 20 19:51:12.444236 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:12.444210 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:51:12.444331 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:12.444281 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:51:12.444370 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:12.444355 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:51:13.452365 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:13.452322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" event={"ID":"f3325056-7684-44a0-832b-8283e9a5bf2c","Type":"ContainerStarted","Data":"b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9"} Jul 20 19:51:13.707723 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:13.707633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:51:13.708938 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:13.708908 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 20 19:51:13.709092 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:13.708982 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 20 19:51:14.364188 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:14.364144 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:51:14.708525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:14.708401 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 20 19:51:14.708525 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:14.708474 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 20 19:51:15.707959 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:15.707855 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 20 19:51:15.707959 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:15.707919 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 20 19:51:16.708479 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:16.708442 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 20 19:51:16.708952 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:16.708536 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 20 19:51:17.712586 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:17.712553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:51:17.713654 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:17.713626 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:51:59.372292 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:51:59.372261 2576 scope.go:117] "RemoveContainer" containerID="99a9a86320e0551195d27df85c84c8bc58c152b2370c37c0e8501d4684066ce2" Jul 20 19:52:52.352529 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:52.352416 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7"] Jul 20 19:52:52.353164 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:52.352723 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" containerID="cri-o://ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8" gracePeriod=30 Jul 20 19:52:56.857599 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:56.857558 2576 patch_prober.go:28] interesting pod/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 19:52:56.858000 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:56.857630 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:52:57.626662 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.626592 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:52:57.718319 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718265 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istiod-ca-cert\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718319 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718334 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-credential-socket\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718357 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-data\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718463 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-socket\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718557 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-token\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718630 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-podinfo\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718654 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:57.718871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718670 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-envoy\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718702 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4tff\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-kube-api-access-j4tff\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718743 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-certs\") pod \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\" (UID: \"92cbc7f5-657d-4e10-bd2f-02506a5f09ba\") " Jul 20 19:52:57.718871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718756 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:57.718871 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.718819 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:52:57.719179 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.719047 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:57.719179 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.719118 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.719179 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.719136 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.719179 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.719150 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.719380 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.719361 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:57.720992 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.720952 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-kube-api-access-j4tff" (OuterVolumeSpecName: "kube-api-access-j4tff") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "kube-api-access-j4tff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:52:57.721110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.721066 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:52:57.721216 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.721201 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:52:57.721282 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.721241 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "92cbc7f5-657d-4e10-bd2f-02506a5f09ba" (UID: "92cbc7f5-657d-4e10-bd2f-02506a5f09ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:52:57.820361 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.820297 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.820361 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.820352 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.820361 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.820366 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.820361 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.820378 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.820701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.820392 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4tff\" (UniqueName: \"kubernetes.io/projected/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-kube-api-access-j4tff\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:57.820701 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:57.820406 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cbc7f5-657d-4e10-bd2f-02506a5f09ba-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:52:58.022879 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.022780 2576 generic.go:356] "Generic (PLEG): container finished" podID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerID="ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8" exitCode=0 Jul 20 19:52:58.022879 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.022831 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" Jul 20 19:52:58.022879 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.022864 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" event={"ID":"92cbc7f5-657d-4e10-bd2f-02506a5f09ba","Type":"ContainerDied","Data":"ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8"} Jul 20 19:52:58.023430 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.022920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7" event={"ID":"92cbc7f5-657d-4e10-bd2f-02506a5f09ba","Type":"ContainerDied","Data":"75afb615ab72c70c7ce6b840d8f9b244d9e1ce292d02e65c5497de53bbe598f7"} Jul 20 19:52:58.023430 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.022944 2576 scope.go:117] "RemoveContainer" containerID="ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8" Jul 20 19:52:58.033288 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.033267 2576 scope.go:117] "RemoveContainer" containerID="230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822" Jul 20 19:52:58.041974 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.041945 2576 scope.go:117] "RemoveContainer" containerID="ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8" Jul 20 19:52:58.042288 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:52:58.042267 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8\": container with ID starting with ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8 not found: ID does not exist" containerID="ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8" Jul 20 19:52:58.042347 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.042300 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8"} err="failed to get container status \"ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8\": rpc error: code = NotFound desc = could not find container \"ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8\": container with ID starting with ac89dcd8a95bf952de9c7f60f397d270eefd69564d172da7a581e16913a56ba8 not found: ID does not exist" Jul 20 19:52:58.042347 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.042322 2576 scope.go:117] "RemoveContainer" containerID="230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822" Jul 20 19:52:58.042627 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:52:58.042606 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822\": container with ID starting with 230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822 not found: ID does not exist" containerID="230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822" Jul 20 19:52:58.042712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.042633 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822"} err="failed to get container status \"230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822\": rpc error: code = NotFound desc = could not find container \"230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822\": container with ID starting with 230f51a282852db69687333e5b5b35ce92dc55938198ea457f38133afd532822 not found: ID does not exist" Jul 20 19:52:58.046198 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.046173 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7"] Jul 20 19:52:58.050030 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:58.050004 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-aae264-openshift-default-5496b6968c-zbzx7"] Jul 20 19:52:59.042547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:52:59.042511 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" path="/var/lib/kubelet/pods/92cbc7f5-657d-4e10-bd2f-02506a5f09ba/volumes" Jul 20 19:53:14.231730 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:14.231693 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn"] Jul 20 19:53:14.232116 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:14.231923 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" containerID="cri-o://b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9" gracePeriod=30 Jul 20 19:53:15.158286 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.158255 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49"] Jul 20 19:53:15.158766 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.158749 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" Jul 20 19:53:15.158865 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.158769 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" Jul 20 19:53:15.158865 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.158793 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" Jul 20 19:53:15.158865 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.158802 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" Jul 20 19:53:15.159028 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.158917 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" Jul 20 19:53:15.162136 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.162117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.165449 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.165431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9d91b9-openshift-default-dockercfg-nkdcr\"" Jul 20 19:53:15.183084 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-credential-socket\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183190 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmqkr\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-kube-api-access-wmqkr\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183190 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-data\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183266 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istiod-ca-cert\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183266 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-podinfo\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183266 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-certs\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-token\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183371 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-socket\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.183447 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.183390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-envoy\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.188007 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.187981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49"] Jul 20 19:53:15.284445 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-data\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istiod-ca-cert\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-podinfo\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-certs\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-token\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-socket\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-envoy\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-credential-socket\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmqkr\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-kube-api-access-wmqkr\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284916 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-data\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.284978 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.284952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-certs\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.285552 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.285079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-socket\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.285552 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.285145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-credential-socket\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.285672 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.285551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istiod-ca-cert\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.286856 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.286837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-envoy\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.287100 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.287083 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-podinfo\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.303257 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.303228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-token\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.303417 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.303396 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmqkr\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-kube-api-access-wmqkr\") pod \"e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.473269 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.473226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:15.616809 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.616781 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49"] Jul 20 19:53:15.618135 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:53:15.618106 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce34e08a_2a54_4fbc_bb49_cdb861a5d50d.slice/crio-0ba0a5fcdfbf8ae4f41ef09cb0c37dc83e89e558c6a89301f169d5d268ab393d WatchSource:0}: Error finding container 0ba0a5fcdfbf8ae4f41ef09cb0c37dc83e89e558c6a89301f169d5d268ab393d: Status 404 returned error can't find the container with id 0ba0a5fcdfbf8ae4f41ef09cb0c37dc83e89e558c6a89301f169d5d268ab393d Jul 20 19:53:15.620676 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.620645 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:15.620741 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.620711 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:15.620777 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:15.620740 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:16.122424 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:16.122383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" event={"ID":"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d","Type":"ContainerStarted","Data":"9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94"} Jul 20 19:53:16.122634 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:16.122444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" event={"ID":"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d","Type":"ContainerStarted","Data":"0ba0a5fcdfbf8ae4f41ef09cb0c37dc83e89e558c6a89301f169d5d268ab393d"} Jul 20 19:53:16.146571 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:16.146524 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" podStartSLOduration=1.146508024 podStartE2EDuration="1.146508024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:16.14523852 +0000 UTC m=+2297.537978053" watchObservedRunningTime="2026-07-20 19:53:16.146508024 +0000 UTC m=+2297.539247549" Jul 20 19:53:16.474198 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:16.474109 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:16.479584 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:16.479555 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:17.127819 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:17.127784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:17.128655 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:17.128637 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:17.715459 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:17.715422 2576 patch_prober.go:28] interesting pod/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 19:53:17.715861 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:17.715475 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 19:53:19.499826 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.499762 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:53:19.632893 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.632857 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-data\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.632917 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-podinfo\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.632953 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-socket\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.632993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-certs\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633042 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-envoy\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-credential-socket\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bsp9\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-kube-api-access-4bsp9\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-token\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633273 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3325056-7684-44a0-832b-8283e9a5bf2c-istiod-ca-cert\") pod \"f3325056-7684-44a0-832b-8283e9a5bf2c\" (UID: \"f3325056-7684-44a0-832b-8283e9a5bf2c\") " Jul 20 19:53:19.633522 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633379 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:19.633522 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633420 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:19.633645 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633341 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:19.633645 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633599 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.633645 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633623 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.633807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633695 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3325056-7684-44a0-832b-8283e9a5bf2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:53:19.633807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.633787 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:19.635290 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.635261 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:53:19.635406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.635372 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:53:19.635731 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.635705 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:53:19.635731 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.635716 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-kube-api-access-4bsp9" (OuterVolumeSpecName: "kube-api-access-4bsp9") pod "f3325056-7684-44a0-832b-8283e9a5bf2c" (UID: "f3325056-7684-44a0-832b-8283e9a5bf2c"). InnerVolumeSpecName "kube-api-access-4bsp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:53:19.734922 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734886 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.734922 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734917 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bsp9\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-kube-api-access-4bsp9\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.734922 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734927 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.735167 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734938 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3325056-7684-44a0-832b-8283e9a5bf2c-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.735167 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734946 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.735167 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734954 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3325056-7684-44a0-832b-8283e9a5bf2c-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:19.735167 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:19.734961 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3325056-7684-44a0-832b-8283e9a5bf2c-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:53:20.145033 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.144998 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerID="b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9" exitCode=0 Jul 20 19:53:20.145235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.145041 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" Jul 20 19:53:20.145235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.145068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" event={"ID":"f3325056-7684-44a0-832b-8283e9a5bf2c","Type":"ContainerDied","Data":"b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9"} Jul 20 19:53:20.145235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.145113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn" event={"ID":"f3325056-7684-44a0-832b-8283e9a5bf2c","Type":"ContainerDied","Data":"5ee475ab9f0efc61cc82e45ff30dcff5eddca0fb070d723020f1aa904455e46e"} Jul 20 19:53:20.145235 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.145135 2576 scope.go:117] "RemoveContainer" containerID="b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9" Jul 20 19:53:20.155046 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.155028 2576 scope.go:117] "RemoveContainer" containerID="aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27" Jul 20 19:53:20.165392 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.165368 2576 scope.go:117] "RemoveContainer" containerID="b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9" Jul 20 19:53:20.165747 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:53:20.165727 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9\": container with ID starting with b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9 not found: ID does not exist" containerID="b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9" Jul 20 19:53:20.165850 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.165760 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9"} err="failed to get container status \"b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9\": rpc error: code = NotFound desc = could not find container \"b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9\": container with ID starting with b25a05301399285d75de79bdd719d2041ae46a354c4b848e0314b80feece89c9 not found: ID does not exist" Jul 20 19:53:20.165850 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.165785 2576 scope.go:117] "RemoveContainer" containerID="aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27" Jul 20 19:53:20.166099 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:53:20.166082 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27\": container with ID starting with aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27 not found: ID does not exist" containerID="aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27" Jul 20 19:53:20.166161 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.166106 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27"} err="failed to get container status \"aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27\": rpc error: code = NotFound desc = could not find container \"aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27\": container with ID starting with aabae038c57fba261a965cfa2ff99c14eef2e976ba4710d9b2853d67c0291b27 not found: ID does not exist" Jul 20 19:53:20.168056 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.168036 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn"] Jul 20 19:53:20.171226 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:20.171204 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2fb506-openshift-default-56c6fd456f-bqjxn"] Jul 20 19:53:21.042825 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:21.042790 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" path="/var/lib/kubelet/pods/f3325056-7684-44a0-832b-8283e9a5bf2c/volumes" Jul 20 19:53:23.368645 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.368612 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb"] Jul 20 19:53:23.369646 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.369621 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" Jul 20 19:53:23.369646 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.369642 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" Jul 20 19:53:23.369808 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.369724 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" Jul 20 19:53:23.369808 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.369739 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92cbc7f5-657d-4e10-bd2f-02506a5f09ba" containerName="istio-proxy" Jul 20 19:53:23.374926 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.374901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.378405 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.378383 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-920350-openshift-default-dockercfg-s4jbf\"" Jul 20 19:53:23.391133 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.391103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb"] Jul 20 19:53:23.471111 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-podinfo\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-token\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-socket\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471413 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-envoy\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471607 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-data\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471607 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-credential-socket\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471607 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59v6\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-kube-api-access-z59v6\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471607 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-certs\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.471784 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.471634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3701c1d-c567-49d9-915e-28bf6e18b440-istiod-ca-cert\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572692 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-socket\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-envoy\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-data\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-credential-socket\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z59v6\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-kube-api-access-z59v6\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-certs\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3701c1d-c567-49d9-915e-28bf6e18b440-istiod-ca-cert\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-podinfo\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.572897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.572874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-token\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.573340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.573114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-socket\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.573340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.573182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-data\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.573340 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.573315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-credential-socket\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.573481 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.573359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-certs\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.573724 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.573705 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3701c1d-c567-49d9-915e-28bf6e18b440-istiod-ca-cert\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.575181 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.575163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-envoy\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.575303 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.575286 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-podinfo\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.581589 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.581569 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-token\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.581940 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.581918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59v6\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-kube-api-access-z59v6\") pod \"e2e-api-b-920350-openshift-default-b7654d75-8xgsb\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.687686 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.687584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:23.878561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.878536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb"] Jul 20 19:53:23.880558 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:53:23.880527 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3701c1d_c567_49d9_915e_28bf6e18b440.slice/crio-d94440fad8532d84f56dae575157fe70d8c1c17ad4dfad1404d3d7467426604b WatchSource:0}: Error finding container d94440fad8532d84f56dae575157fe70d8c1c17ad4dfad1404d3d7467426604b: Status 404 returned error can't find the container with id d94440fad8532d84f56dae575157fe70d8c1c17ad4dfad1404d3d7467426604b Jul 20 19:53:23.885629 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.883699 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:23.885629 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.884008 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:23.885629 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:23.884203 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:24.178547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:24.178449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" event={"ID":"d3701c1d-c567-49d9-915e-28bf6e18b440","Type":"ContainerStarted","Data":"1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3"} Jul 20 19:53:24.178547 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:24.178550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" event={"ID":"d3701c1d-c567-49d9-915e-28bf6e18b440","Type":"ContainerStarted","Data":"d94440fad8532d84f56dae575157fe70d8c1c17ad4dfad1404d3d7467426604b"} Jul 20 19:53:24.200807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:24.200753 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podStartSLOduration=1.200734111 podStartE2EDuration="1.200734111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:24.198817536 +0000 UTC m=+2305.591557071" watchObservedRunningTime="2026-07-20 19:53:24.200734111 +0000 UTC m=+2305.593473644" Jul 20 19:53:24.688736 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:24.688697 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:24.693859 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:24.693835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:25.184194 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:25.184165 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:25.185139 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:25.185113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:29.210107 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:29.210071 2576 generic.go:356] "Generic (PLEG): container finished" podID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerID="9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94" exitCode=0 Jul 20 19:53:29.210567 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:29.210151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" event={"ID":"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d","Type":"ContainerDied","Data":"9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94"} Jul 20 19:53:29.210653 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:29.210638 2576 scope.go:117] "RemoveContainer" containerID="9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94" Jul 20 19:53:29.211700 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:29.211667 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:29.211813 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:29.211738 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:29.211813 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:29.211771 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:30.217375 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:30.217337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" event={"ID":"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d","Type":"ContainerStarted","Data":"5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9"} Jul 20 19:53:30.473510 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:30.473389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:30.474800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:30.474776 2576 patch_prober.go:28] interesting pod/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 20 19:53:30.474858 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:30.474833 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 20 19:53:31.474302 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:31.474265 2576 patch_prober.go:28] interesting pod/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 20 19:53:31.474714 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:31.474318 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 20 19:53:32.128206 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:32.128163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:32.474300 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:32.474206 2576 patch_prober.go:28] interesting pod/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 20 19:53:32.474472 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:32.474299 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 20 19:53:33.473671 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:33.473632 2576 patch_prober.go:28] interesting pod/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 20 19:53:33.473863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:33.473689 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 20 19:53:34.477549 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:34.477512 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:34.478423 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:34.478406 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:53:41.226712 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:41.226668 2576 patch_prober.go:28] interesting pod/e2e-api-b-920350-openshift-default-b7654d75-8xgsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 19:53:41.227123 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:41.226747 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 19:53:42.292894 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:42.292861 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerID="1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3" exitCode=0 Jul 20 19:53:42.293337 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:42.292944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" event={"ID":"d3701c1d-c567-49d9-915e-28bf6e18b440","Type":"ContainerDied","Data":"1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3"} Jul 20 19:53:42.293425 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:42.293409 2576 scope.go:117] "RemoveContainer" containerID="1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3" Jul 20 19:53:42.294505 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:42.294460 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:42.294582 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:42.294563 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:42.294670 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:42.294609 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:53:43.311915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:43.311881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" event={"ID":"d3701c1d-c567-49d9-915e-28bf6e18b440","Type":"ContainerStarted","Data":"71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c"} Jul 20 19:53:43.688072 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:43.687970 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:43.688287 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:43.688264 2576 patch_prober.go:28] interesting pod/e2e-api-b-920350-openshift-default-b7654d75-8xgsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 20 19:53:43.688352 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:43.688325 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 20 19:53:44.688441 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:44.688402 2576 patch_prober.go:28] interesting pod/e2e-api-b-920350-openshift-default-b7654d75-8xgsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 20 19:53:44.688879 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:44.688466 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 20 19:53:45.688360 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:45.688323 2576 patch_prober.go:28] interesting pod/e2e-api-b-920350-openshift-default-b7654d75-8xgsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 20 19:53:45.688580 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:45.688384 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 20 19:53:46.689009 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:46.688966 2576 patch_prober.go:28] interesting pod/e2e-api-b-920350-openshift-default-b7654d75-8xgsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 20 19:53:46.689459 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:46.689029 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 20 19:53:47.691784 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:47.691742 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:47.692261 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:47.691996 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:53:47.692915 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:53:47.692899 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:54:05.662530 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:05.662478 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49"] Jul 20 19:54:05.662993 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:05.662740 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" containerID="cri-o://5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9" gracePeriod=30 Jul 20 19:54:10.923305 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:10.923277 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:54:11.048717 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.048691 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-data\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.048897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.048728 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istiod-ca-cert\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.048897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.048805 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmqkr\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-kube-api-access-wmqkr\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.048897 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.048834 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-envoy\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.049037 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.048969 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-token\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.049079 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049052 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-credential-socket\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.049125 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049078 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-socket\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.049171 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-certs\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.049171 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-podinfo\") pod \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\" (UID: \"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d\") " Jul 20 19:54:11.049280 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049204 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:54:11.049339 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049266 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:11.049430 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049394 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:11.049561 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049531 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:11.049647 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049614 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.049647 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049635 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.049753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049651 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.049753 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.049699 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:11.051304 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.051278 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:54:11.051304 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.051287 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:54:11.051544 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.051523 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-kube-api-access-wmqkr" (OuterVolumeSpecName: "kube-api-access-wmqkr") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "kube-api-access-wmqkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:54:11.051661 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.051634 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" (UID: "ce34e08a-2a54-4fbc-bb49-cdb861a5d50d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:11.150410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.150366 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmqkr\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-kube-api-access-wmqkr\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.150410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.150403 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.150410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.150412 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.150410 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.150420 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.150733 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.150428 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.150733 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.150435 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:11.469252 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.469154 2576 generic.go:356] "Generic (PLEG): container finished" podID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerID="5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9" exitCode=0 Jul 20 19:54:11.469252 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.469203 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" Jul 20 19:54:11.469443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.469239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" event={"ID":"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d","Type":"ContainerDied","Data":"5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9"} Jul 20 19:54:11.469443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.469309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49" event={"ID":"ce34e08a-2a54-4fbc-bb49-cdb861a5d50d","Type":"ContainerDied","Data":"0ba0a5fcdfbf8ae4f41ef09cb0c37dc83e89e558c6a89301f169d5d268ab393d"} Jul 20 19:54:11.469443 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.469344 2576 scope.go:117] "RemoveContainer" containerID="5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9" Jul 20 19:54:11.480064 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.480041 2576 scope.go:117] "RemoveContainer" containerID="9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94" Jul 20 19:54:11.489142 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.489109 2576 scope.go:117] "RemoveContainer" containerID="5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9" Jul 20 19:54:11.489469 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:54:11.489446 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9\": container with ID starting with 5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9 not found: ID does not exist" containerID="5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9" Jul 20 19:54:11.489589 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.489477 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9"} err="failed to get container status \"5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9\": rpc error: code = NotFound desc = could not find container \"5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9\": container with ID starting with 5fd0c7df8b3c640ab4ebcb889e4c2c67def114cc6d77cbc571a56ed6d1f555f9 not found: ID does not exist" Jul 20 19:54:11.489589 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.489523 2576 scope.go:117] "RemoveContainer" containerID="9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94" Jul 20 19:54:11.489790 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:54:11.489774 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94\": container with ID starting with 9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94 not found: ID does not exist" containerID="9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94" Jul 20 19:54:11.489834 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.489796 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94"} err="failed to get container status \"9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94\": rpc error: code = NotFound desc = could not find container \"9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94\": container with ID starting with 9f5b2c6811ab7fbf22e9172d492c62a17ce049556c3380244f4a4491a7b24c94 not found: ID does not exist" Jul 20 19:54:11.494199 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.494173 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49"] Jul 20 19:54:11.498036 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:11.498009 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9d91b9-openshift-default-8578fd64c5-bcs49"] Jul 20 19:54:13.043406 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:13.043368 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" path="/var/lib/kubelet/pods/ce34e08a-2a54-4fbc-bb49-cdb861a5d50d/volumes" Jul 20 19:54:33.013662 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.013624 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb"] Jul 20 19:54:33.014263 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.013836 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" containerID="cri-o://71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c" gracePeriod=30 Jul 20 19:54:33.963458 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963421 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g"] Jul 20 19:54:33.963908 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963895 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" Jul 20 19:54:33.963960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963918 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" Jul 20 19:54:33.963960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963935 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" Jul 20 19:54:33.963960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963942 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" Jul 20 19:54:33.963960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963950 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" Jul 20 19:54:33.963960 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.963956 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" Jul 20 19:54:33.964131 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.964032 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" Jul 20 19:54:33.964131 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.964044 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3325056-7684-44a0-832b-8283e9a5bf2c" containerName="istio-proxy" Jul 20 19:54:33.968703 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.968678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:33.973808 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.973774 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-710890-openshift-default-dockercfg-k2l8z\"" Jul 20 19:54:33.993432 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:33.993393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g"] Jul 20 19:54:34.074076 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-socket\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-envoy\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994d6855-5445-4b6d-a22c-19605e8f6642-istiod-ca-cert\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-credential-socket\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994d6855-5445-4b6d-a22c-19605e8f6642-istio-podinfo\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-certs\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-istio-token\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghcz\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-kube-api-access-nghcz\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.074542 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.074302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-data\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.175829 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.175787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-socket\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.175829 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.175835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-envoy\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.175866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994d6855-5445-4b6d-a22c-19605e8f6642-istiod-ca-cert\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.175902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-credential-socket\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.175956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994d6855-5445-4b6d-a22c-19605e8f6642-istio-podinfo\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-certs\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-istio-token\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176126 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nghcz\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-kube-api-access-nghcz\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176444 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-data\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176444 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-socket\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176444 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-credential-socket\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176663 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176532 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-data\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176725 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-certs\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.176956 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.176930 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994d6855-5445-4b6d-a22c-19605e8f6642-istiod-ca-cert\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.178263 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.178244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-envoy\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.178807 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.178783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994d6855-5445-4b6d-a22c-19605e8f6642-istio-podinfo\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.194776 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.194743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-istio-token\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.197503 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.197466 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghcz\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-kube-api-access-nghcz\") pod \"e2e-shared-a-710890-openshift-default-594bc56c-7cj7g\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.280002 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.279968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:34.440688 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.440655 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g"] Jul 20 19:54:34.442215 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:54:34.442186 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994d6855_5445_4b6d_a22c_19605e8f6642.slice/crio-b24e3d9f48a1dd0baa91c37fd258dc45bc46e3a9f1b3705de8f9902c9d158ea6 WatchSource:0}: Error finding container b24e3d9f48a1dd0baa91c37fd258dc45bc46e3a9f1b3705de8f9902c9d158ea6: Status 404 returned error can't find the container with id b24e3d9f48a1dd0baa91c37fd258dc45bc46e3a9f1b3705de8f9902c9d158ea6 Jul 20 19:54:34.444353 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.444319 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:34.444422 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.444392 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:34.444462 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.444419 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:34.602060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.601957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" event={"ID":"994d6855-5445-4b6d-a22c-19605e8f6642","Type":"ContainerStarted","Data":"c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e"} Jul 20 19:54:34.602060 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.602030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" event={"ID":"994d6855-5445-4b6d-a22c-19605e8f6642","Type":"ContainerStarted","Data":"b24e3d9f48a1dd0baa91c37fd258dc45bc46e3a9f1b3705de8f9902c9d158ea6"} Jul 20 19:54:34.635385 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:34.635323 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podStartSLOduration=1.6353040189999999 podStartE2EDuration="1.635304019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:54:34.633774594 +0000 UTC m=+2376.026514128" watchObservedRunningTime="2026-07-20 19:54:34.635304019 +0000 UTC m=+2376.028043552" Jul 20 19:54:35.280892 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:35.280846 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:35.285969 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:35.285940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:35.615341 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:35.615229 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:35.616355 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:35.616331 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:38.311210 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.311183 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:54:38.316308 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316282 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3701c1d-c567-49d9-915e-28bf6e18b440-istiod-ca-cert\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316460 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316337 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-podinfo\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316460 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316365 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-socket\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316460 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316407 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-data\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316460 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316450 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-credential-socket\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316478 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-envoy\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316516 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-certs\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316559 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z59v6\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-kube-api-access-z59v6\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316629 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-token\") pod \"d3701c1d-c567-49d9-915e-28bf6e18b440\" (UID: \"d3701c1d-c567-49d9-915e-28bf6e18b440\") " Jul 20 19:54:38.316720 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316692 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:38.316974 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316769 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3701c1d-c567-49d9-915e-28bf6e18b440-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:54:38.316974 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316814 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:38.317088 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.316999 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3701c1d-c567-49d9-915e-28bf6e18b440-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.317088 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.317020 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.317088 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.317034 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.317088 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.317051 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:38.317731 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.317703 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:38.319001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.318950 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-kube-api-access-z59v6" (OuterVolumeSpecName: "kube-api-access-z59v6") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "kube-api-access-z59v6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:54:38.319001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.318956 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:54:38.319001 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.318992 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:54:38.319171 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.319048 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3701c1d-c567-49d9-915e-28bf6e18b440" (UID: "d3701c1d-c567-49d9-915e-28bf6e18b440"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:54:38.417511 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.417461 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.417696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.417521 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.417696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.417531 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.417696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.417539 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3701c1d-c567-49d9-915e-28bf6e18b440-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.417696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.417547 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z59v6\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-kube-api-access-z59v6\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.417696 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.417558 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3701c1d-c567-49d9-915e-28bf6e18b440-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 19:54:38.636532 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.636421 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerID="71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c" exitCode=0 Jul 20 19:54:38.636532 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.636473 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" Jul 20 19:54:38.636532 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.636512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" event={"ID":"d3701c1d-c567-49d9-915e-28bf6e18b440","Type":"ContainerDied","Data":"71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c"} Jul 20 19:54:38.636758 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.636574 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb" event={"ID":"d3701c1d-c567-49d9-915e-28bf6e18b440","Type":"ContainerDied","Data":"d94440fad8532d84f56dae575157fe70d8c1c17ad4dfad1404d3d7467426604b"} Jul 20 19:54:38.636758 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.636603 2576 scope.go:117] "RemoveContainer" containerID="71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c" Jul 20 19:54:38.647069 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.647049 2576 scope.go:117] "RemoveContainer" containerID="1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3" Jul 20 19:54:38.656097 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.656076 2576 scope.go:117] "RemoveContainer" containerID="71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c" Jul 20 19:54:38.656403 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:54:38.656384 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c\": container with ID starting with 71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c not found: ID does not exist" containerID="71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c" Jul 20 19:54:38.656479 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.656418 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c"} err="failed to get container status \"71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c\": rpc error: code = NotFound desc = could not find container \"71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c\": container with ID starting with 71dadabd97e1984794ea0bf9fa8839e296d8ef0649c39ae0fe34103cc3c3e70c not found: ID does not exist" Jul 20 19:54:38.656479 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.656446 2576 scope.go:117] "RemoveContainer" containerID="1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3" Jul 20 19:54:38.656731 ip-10-0-132-142 kubenswrapper[2576]: E0720 19:54:38.656712 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3\": container with ID starting with 1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3 not found: ID does not exist" containerID="1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3" Jul 20 19:54:38.656772 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.656739 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3"} err="failed to get container status \"1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3\": rpc error: code = NotFound desc = could not find container \"1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3\": container with ID starting with 1e9a5208c564f81c771b0390854b57a64eb22c277f77779488471b3a5a90eed3 not found: ID does not exist" Jul 20 19:54:38.661888 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.661860 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb"] Jul 20 19:54:38.666709 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:38.666686 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-920350-openshift-default-b7654d75-8xgsb"] Jul 20 19:54:39.043531 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:39.043474 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" path="/var/lib/kubelet/pods/d3701c1d-c567-49d9-915e-28bf6e18b440/volumes" Jul 20 19:54:41.766479 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.766439 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64"] Jul 20 19:54:41.766950 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.766935 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" Jul 20 19:54:41.766996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.766953 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" Jul 20 19:54:41.766996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.766972 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" Jul 20 19:54:41.766996 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.766979 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" Jul 20 19:54:41.767094 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.767050 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" Jul 20 19:54:41.767094 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.767062 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce34e08a-2a54-4fbc-bb49-cdb861a5d50d" containerName="istio-proxy" Jul 20 19:54:41.771745 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.771713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.774961 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.774927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-01f2d8-openshift-default-dockercfg-zctzd\"" Jul 20 19:54:41.790297 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.790259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64"] Jul 20 19:54:41.848946 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.848905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a421d886-4ef7-448f-9688-e9790b253f20-istio-podinfo\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.848966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-istio-token\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-data\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-credential-socket\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-certs\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849158 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-socket\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwsm5\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-kube-api-access-vwsm5\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a421d886-4ef7-448f-9688-e9790b253f20-istiod-ca-cert\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.849397 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.849241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-envoy\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950404 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-istio-token\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-data\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-credential-socket\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-certs\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-socket\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950613 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwsm5\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-kube-api-access-vwsm5\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950965 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a421d886-4ef7-448f-9688-e9790b253f20-istiod-ca-cert\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950965 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-envoy\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950965 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a421d886-4ef7-448f-9688-e9790b253f20-istio-podinfo\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.950965 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.950955 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-credential-socket\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.951218 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.951093 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-certs\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.951454 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.951432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-socket\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.951584 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.951470 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-data\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.951713 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.951694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a421d886-4ef7-448f-9688-e9790b253f20-istiod-ca-cert\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.953268 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.953246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-envoy\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.953421 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.953404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a421d886-4ef7-448f-9688-e9790b253f20-istio-podinfo\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.963702 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.963655 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-istio-token\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:41.963863 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:41.963813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwsm5\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-kube-api-access-vwsm5\") pod \"e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:42.083279 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.083236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:42.248303 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.248272 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64"] Jul 20 19:54:42.250553 ip-10-0-132-142 kubenswrapper[2576]: W0720 19:54:42.250524 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda421d886_4ef7_448f_9688_e9790b253f20.slice/crio-d37f593a93fdb95fc2380f55f39e565b6c5ef736414df116d1856f879334ac8f WatchSource:0}: Error finding container d37f593a93fdb95fc2380f55f39e565b6c5ef736414df116d1856f879334ac8f: Status 404 returned error can't find the container with id d37f593a93fdb95fc2380f55f39e565b6c5ef736414df116d1856f879334ac8f Jul 20 19:54:42.252768 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.252733 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:42.252852 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.252827 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:42.252891 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.252862 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:42.663336 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.663296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" event={"ID":"a421d886-4ef7-448f-9688-e9790b253f20","Type":"ContainerStarted","Data":"b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71"} Jul 20 19:54:42.663548 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.663358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" event={"ID":"a421d886-4ef7-448f-9688-e9790b253f20","Type":"ContainerStarted","Data":"d37f593a93fdb95fc2380f55f39e565b6c5ef736414df116d1856f879334ac8f"} Jul 20 19:54:42.702920 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:42.702856 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podStartSLOduration=1.702838971 podStartE2EDuration="1.702838971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:54:42.700477075 +0000 UTC m=+2384.093216648" watchObservedRunningTime="2026-07-20 19:54:42.702838971 +0000 UTC m=+2384.095578503" Jul 20 19:54:43.083395 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:43.083352 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:43.088228 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:43.088201 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:43.669357 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:43.669323 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:43.670368 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:43.670350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:54:49.711074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:49.710979 2576 generic.go:356] "Generic (PLEG): container finished" podID="994d6855-5445-4b6d-a22c-19605e8f6642" containerID="c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e" exitCode=0 Jul 20 19:54:49.711074 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:49.711052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" event={"ID":"994d6855-5445-4b6d-a22c-19605e8f6642","Type":"ContainerDied","Data":"c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e"} Jul 20 19:54:49.711690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:49.711610 2576 scope.go:117] "RemoveContainer" containerID="c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e" Jul 20 19:54:49.712690 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:49.712662 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:49.712802 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:49.712746 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:49.712802 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:49.712791 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:50.615785 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:50.615750 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:50.719110 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:50.719071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" event={"ID":"994d6855-5445-4b6d-a22c-19605e8f6642","Type":"ContainerStarted","Data":"3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e"} Jul 20 19:54:51.280433 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:51.280397 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:51.281426 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:51.281401 2576 patch_prober.go:28] interesting pod/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 20 19:54:51.281584 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:51.281453 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 20 19:54:52.281179 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:52.281142 2576 patch_prober.go:28] interesting pod/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 20 19:54:52.281740 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:52.281208 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 20 19:54:53.281364 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:53.281326 2576 patch_prober.go:28] interesting pod/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 20 19:54:53.281848 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:53.281382 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 20 19:54:54.281289 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:54.281249 2576 patch_prober.go:28] interesting pod/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 20 19:54:54.281519 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:54.281309 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 20 19:54:55.284623 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:55.284586 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:55.285128 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:55.284884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:55.285665 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:55.285649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 19:54:58.670800 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.670759 2576 patch_prober.go:28] interesting pod/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 20 19:54:58.671225 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.670829 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 20 19:54:58.775024 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.774993 2576 generic.go:356] "Generic (PLEG): container finished" podID="a421d886-4ef7-448f-9688-e9790b253f20" containerID="b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71" exitCode=0 Jul 20 19:54:58.775214 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.775079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" event={"ID":"a421d886-4ef7-448f-9688-e9790b253f20","Type":"ContainerDied","Data":"b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71"} Jul 20 19:54:58.775620 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.775605 2576 scope.go:117] "RemoveContainer" containerID="b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71" Jul 20 19:54:58.776695 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.776669 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:58.776760 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.776746 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:58.776796 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:58.776777 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 19:54:59.177816 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:59.177789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:54:59.181073 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:59.181051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:54:59.217106 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:59.217072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:54:59.221327 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:59.221306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:54:59.417414 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:59.417380 2576 scope.go:117] "RemoveContainer" containerID="4e5d02f5173d8e775716206d51c87e58b4c822f0359642d80412ad9d32089cf4" Jul 20 19:54:59.782143 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:54:59.782104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" event={"ID":"a421d886-4ef7-448f-9688-e9790b253f20","Type":"ContainerStarted","Data":"3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4"} Jul 20 19:55:00.084434 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:00.084326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:55:00.084658 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:00.084575 2576 patch_prober.go:28] interesting pod/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 20 19:55:00.084658 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:00.084635 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 20 19:55:01.083644 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:01.083605 2576 patch_prober.go:28] interesting pod/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 20 19:55:01.084051 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:01.083666 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 20 19:55:02.084233 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:02.084192 2576 patch_prober.go:28] interesting pod/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 20 19:55:02.084667 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:02.084255 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 20 19:55:03.083963 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:03.083924 2576 patch_prober.go:28] interesting pod/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 20 19:55:03.084221 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:03.083990 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 20 19:55:04.087881 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:04.087845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:55:04.088411 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:04.088111 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:55:04.088981 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:55:04.088958 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 19:59:59.209307 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:59:59.209278 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:59:59.213199 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:59:59.213174 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 19:59:59.253488 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:59:59.253457 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 19:59:59.256949 ip-10-0-132-142 kubenswrapper[2576]: I0720 19:59:59.256920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4kvq_015476e6-0abe-4284-95a3-8454a66b916a/ovn-acl-logging/0.log" Jul 20 20:00:00.137398 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.137365 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb"] Jul 20 20:00:00.137934 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.137918 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3701c1d-c567-49d9-915e-28bf6e18b440" containerName="istio-proxy" Jul 20 20:00:00.140973 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.140947 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr"] Jul 20 20:00:00.141076 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.141020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" Jul 20 20:00:00.143866 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.143847 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\"" Jul 20 20:00:00.144542 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.144519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" Jul 20 20:00:00.146699 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.146679 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb"] Jul 20 20:00:00.152156 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.152133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr"] Jul 20 20:00:00.155934 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.155913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" Jul 20 20:00:00.164683 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.164658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" Jul 20 20:00:00.322528 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.322479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb"] Jul 20 20:00:00.325003 ip-10-0-132-142 kubenswrapper[2576]: W0720 20:00:00.324968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b46b8bf_ef1f_450c_b997_9da0856a3c7b.slice/crio-1c5c61cfe186a90dfef15641c8ab2734fe526230a16e7e76311f090323cf3cec WatchSource:0}: Error finding container 1c5c61cfe186a90dfef15641c8ab2734fe526230a16e7e76311f090323cf3cec: Status 404 returned error can't find the container with id 1c5c61cfe186a90dfef15641c8ab2734fe526230a16e7e76311f090323cf3cec Jul 20 20:00:00.359532 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.354813 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr"] Jul 20 20:00:00.387882 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.387805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" event={"ID":"b231ec27-9119-4066-b6c0-2147518d83b2","Type":"ContainerStarted","Data":"ee92a72e31baee169bad7011a63aa2a1878e4750f1277c7be48c03351ea627de"} Jul 20 20:00:00.388986 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:00.388957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" event={"ID":"7b46b8bf-ef1f-450c-b997-9da0856a3c7b","Type":"ContainerStarted","Data":"1c5c61cfe186a90dfef15641c8ab2734fe526230a16e7e76311f090323cf3cec"} Jul 20 20:00:01.395987 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:01.395953 2576 generic.go:356] "Generic (PLEG): container finished" podID="b231ec27-9119-4066-b6c0-2147518d83b2" containerID="b6ae65546387633565241a5fa0dc43c1571100525cc27f158715a02c6921d392" exitCode=0 Jul 20 20:00:01.396449 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:01.396045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" event={"ID":"b231ec27-9119-4066-b6c0-2147518d83b2","Type":"ContainerDied","Data":"b6ae65546387633565241a5fa0dc43c1571100525cc27f158715a02c6921d392"} Jul 20 20:00:01.397625 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:01.397602 2576 generic.go:356] "Generic (PLEG): container finished" podID="7b46b8bf-ef1f-450c-b997-9da0856a3c7b" containerID="f2e8a622bdfad1f9660abd05b87292a5c5d09550a9d156c6cf774b30af5113ca" exitCode=0 Jul 20 20:00:01.397705 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:01.397685 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" event={"ID":"7b46b8bf-ef1f-450c-b997-9da0856a3c7b","Type":"ContainerDied","Data":"f2e8a622bdfad1f9660abd05b87292a5c5d09550a9d156c6cf774b30af5113ca"} Jul 20 20:00:02.562718 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:02.562690 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" Jul 20 20:00:02.583644 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:02.583614 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" Jul 20 20:00:03.409716 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:03.409630 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" Jul 20 20:00:03.409716 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:03.409667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-xgwkb" event={"ID":"7b46b8bf-ef1f-450c-b997-9da0856a3c7b","Type":"ContainerDied","Data":"1c5c61cfe186a90dfef15641c8ab2734fe526230a16e7e76311f090323cf3cec"} Jul 20 20:00:03.410070 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:03.409725 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c5c61cfe186a90dfef15641c8ab2734fe526230a16e7e76311f090323cf3cec" Jul 20 20:00:03.410982 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:03.410959 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" event={"ID":"b231ec27-9119-4066-b6c0-2147518d83b2","Type":"ContainerDied","Data":"ee92a72e31baee169bad7011a63aa2a1878e4750f1277c7be48c03351ea627de"} Jul 20 20:00:03.411088 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:03.410994 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr" Jul 20 20:00:03.411088 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:03.410998 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee92a72e31baee169bad7011a63aa2a1878e4750f1277c7be48c03351ea627de" Jul 20 20:00:30.063716 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.063678 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7415-139772282186672"] Jul 20 20:00:30.064146 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.064123 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b231ec27-9119-4066-b6c0-2147518d83b2" containerName="cleanup" Jul 20 20:00:30.064146 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.064135 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b231ec27-9119-4066-b6c0-2147518d83b2" containerName="cleanup" Jul 20 20:00:30.064146 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.064144 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b46b8bf-ef1f-450c-b997-9da0856a3c7b" containerName="cleanup" Jul 20 20:00:30.064262 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.064151 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b46b8bf-ef1f-450c-b997-9da0856a3c7b" containerName="cleanup" Jul 20 20:00:30.064262 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.064227 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b46b8bf-ef1f-450c-b997-9da0856a3c7b" containerName="cleanup" Jul 20 20:00:30.064262 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.064238 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b231ec27-9119-4066-b6c0-2147518d83b2" containerName="cleanup" Jul 20 20:00:30.067419 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.067399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:30.070144 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.070117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmpxm\"" Jul 20 20:00:30.074776 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.074742 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282186672"] Jul 20 20:00:30.139426 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.139381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ps6z\" (UniqueName: \"kubernetes.io/projected/d033f96d-2c6e-4fc3-abfb-da038f7b7b30-kube-api-access-5ps6z\") pod \"test-curl-7415-139772282186672\" (UID: \"d033f96d-2c6e-4fc3-abfb-da038f7b7b30\") " pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:30.240461 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.240424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ps6z\" (UniqueName: \"kubernetes.io/projected/d033f96d-2c6e-4fc3-abfb-da038f7b7b30-kube-api-access-5ps6z\") pod \"test-curl-7415-139772282186672\" (UID: \"d033f96d-2c6e-4fc3-abfb-da038f7b7b30\") " pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:30.249878 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.249846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ps6z\" (UniqueName: \"kubernetes.io/projected/d033f96d-2c6e-4fc3-abfb-da038f7b7b30-kube-api-access-5ps6z\") pod \"test-curl-7415-139772282186672\" (UID: \"d033f96d-2c6e-4fc3-abfb-da038f7b7b30\") " pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:30.378719 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.378631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:30.538253 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.538222 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282186672"] Jul 20 20:00:30.540964 ip-10-0-132-142 kubenswrapper[2576]: W0720 20:00:30.540929 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd033f96d_2c6e_4fc3_abfb_da038f7b7b30.slice/crio-e3c2f7c601af079a0799ebb4f516038a3956872862e4f44a3e30ce0da3d94de4 WatchSource:0}: Error finding container e3c2f7c601af079a0799ebb4f516038a3956872862e4f44a3e30ce0da3d94de4: Status 404 returned error can't find the container with id e3c2f7c601af079a0799ebb4f516038a3956872862e4f44a3e30ce0da3d94de4 Jul 20 20:00:30.542358 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.542338 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 20:00:30.558106 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:30.558071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282186672" event={"ID":"d033f96d-2c6e-4fc3-abfb-da038f7b7b30","Type":"ContainerStarted","Data":"e3c2f7c601af079a0799ebb4f516038a3956872862e4f44a3e30ce0da3d94de4"} Jul 20 20:00:31.566428 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:31.566313 2576 generic.go:356] "Generic (PLEG): container finished" podID="d033f96d-2c6e-4fc3-abfb-da038f7b7b30" containerID="518df7a663f7d0d87adb975a16c909ceea7d2df329435edb4cc7ba31864b42cc" exitCode=0 Jul 20 20:00:31.566428 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:31.566371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282186672" event={"ID":"d033f96d-2c6e-4fc3-abfb-da038f7b7b30","Type":"ContainerDied","Data":"518df7a663f7d0d87adb975a16c909ceea7d2df329435edb4cc7ba31864b42cc"} Jul 20 20:00:32.716927 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.716901 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:32.753398 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.753335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7415-139772282186672_d033f96d-2c6e-4fc3-abfb-da038f7b7b30/test-curl-7415-139772282186672/0.log" Jul 20 20:00:32.762617 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.762588 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ps6z\" (UniqueName: \"kubernetes.io/projected/d033f96d-2c6e-4fc3-abfb-da038f7b7b30-kube-api-access-5ps6z\") pod \"d033f96d-2c6e-4fc3-abfb-da038f7b7b30\" (UID: \"d033f96d-2c6e-4fc3-abfb-da038f7b7b30\") " Jul 20 20:00:32.764824 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.764795 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d033f96d-2c6e-4fc3-abfb-da038f7b7b30-kube-api-access-5ps6z" (OuterVolumeSpecName: "kube-api-access-5ps6z") pod "d033f96d-2c6e-4fc3-abfb-da038f7b7b30" (UID: "d033f96d-2c6e-4fc3-abfb-da038f7b7b30"). InnerVolumeSpecName "kube-api-access-5ps6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:00:32.776261 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.776230 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7415-139772282186672"] Jul 20 20:00:32.779915 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.779887 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7415-139772282186672"] Jul 20 20:00:32.864287 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.864186 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ps6z\" (UniqueName: \"kubernetes.io/projected/d033f96d-2c6e-4fc3-abfb-da038f7b7b30-kube-api-access-5ps6z\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:00:32.936012 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.935979 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7415-139772282290368"] Jul 20 20:00:32.936504 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.936474 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d033f96d-2c6e-4fc3-abfb-da038f7b7b30" containerName="test-curl-7415-139772282186672" Jul 20 20:00:32.936504 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.936504 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d033f96d-2c6e-4fc3-abfb-da038f7b7b30" containerName="test-curl-7415-139772282186672" Jul 20 20:00:32.936600 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.936593 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d033f96d-2c6e-4fc3-abfb-da038f7b7b30" containerName="test-curl-7415-139772282186672" Jul 20 20:00:32.939737 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.939713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:32.946657 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.946627 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"] Jul 20 20:00:32.965228 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:32.965195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czw84\" (UniqueName: \"kubernetes.io/projected/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec-kube-api-access-czw84\") pod \"test-curl-7415-139772282290368\" (UID: \"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec\") " pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:33.043441 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.043408 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d033f96d-2c6e-4fc3-abfb-da038f7b7b30" path="/var/lib/kubelet/pods/d033f96d-2c6e-4fc3-abfb-da038f7b7b30/volumes" Jul 20 20:00:33.066032 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.065987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czw84\" (UniqueName: \"kubernetes.io/projected/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec-kube-api-access-czw84\") pod \"test-curl-7415-139772282290368\" (UID: \"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec\") " pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:33.074926 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.074893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czw84\" (UniqueName: \"kubernetes.io/projected/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec-kube-api-access-czw84\") pod \"test-curl-7415-139772282290368\" (UID: \"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec\") " pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:33.252077 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.251981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:33.425595 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.425567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"] Jul 20 20:00:33.427400 ip-10-0-132-142 kubenswrapper[2576]: W0720 20:00:33.427366 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod927c6d6c_8b5a_437f_9bf9_b69b7bf974ec.slice/crio-d77e33866f0467bd2775820e4b078fda5423c1ee4033f2d8dc0068a9a58e27f7 WatchSource:0}: Error finding container d77e33866f0467bd2775820e4b078fda5423c1ee4033f2d8dc0068a9a58e27f7: Status 404 returned error can't find the container with id d77e33866f0467bd2775820e4b078fda5423c1ee4033f2d8dc0068a9a58e27f7 Jul 20 20:00:33.577418 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.577390 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186672" Jul 20 20:00:33.577613 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.577425 2576 scope.go:117] "RemoveContainer" containerID="518df7a663f7d0d87adb975a16c909ceea7d2df329435edb4cc7ba31864b42cc" Jul 20 20:00:33.578910 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:33.578730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282290368" event={"ID":"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec","Type":"ContainerStarted","Data":"d77e33866f0467bd2775820e4b078fda5423c1ee4033f2d8dc0068a9a58e27f7"} Jul 20 20:00:34.586319 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:34.586277 2576 generic.go:356] "Generic (PLEG): container finished" podID="927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" containerID="5b7912f4d37db904bd12db4013b7437705cde6ced31e3b6b703fbd034bf70722" exitCode=0 Jul 20 20:00:34.586319 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:34.586310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282290368" event={"ID":"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec","Type":"ContainerDied","Data":"5b7912f4d37db904bd12db4013b7437705cde6ced31e3b6b703fbd034bf70722"} Jul 20 20:00:35.733940 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.733916 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:35.756306 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.756266 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7415-139772282290368_927c6d6c-8b5a-437f-9bf9-b69b7bf974ec/test-curl-7415-139772282290368/0.log" Jul 20 20:00:35.779661 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.779627 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"] Jul 20 20:00:35.783310 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.783283 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"] Jul 20 20:00:35.795198 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.795174 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czw84\" (UniqueName: \"kubernetes.io/projected/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec-kube-api-access-czw84\") pod \"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec\" (UID: \"927c6d6c-8b5a-437f-9bf9-b69b7bf974ec\") " Jul 20 20:00:35.797294 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.797261 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec-kube-api-access-czw84" (OuterVolumeSpecName: "kube-api-access-czw84") pod "927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" (UID: "927c6d6c-8b5a-437f-9bf9-b69b7bf974ec"). InnerVolumeSpecName "kube-api-access-czw84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:00:35.895896 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:35.895802 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czw84\" (UniqueName: \"kubernetes.io/projected/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec-kube-api-access-czw84\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:00:36.598678 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:36.598651 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:36.598879 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:36.598704 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d77e33866f0467bd2775820e4b078fda5423c1ee4033f2d8dc0068a9a58e27f7" Jul 20 20:00:36.609206 ip-10-0-132-142 kubenswrapper[2576]: E0720 20:00:36.609175 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7415-139772282290368\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" pod="opendatahub/test-curl-7415-139772282290368" Jul 20 20:00:37.043787 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:37.043756 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" path="/var/lib/kubelet/pods/927c6d6c-8b5a-437f-9bf9-b69b7bf974ec/volumes" Jul 20 20:00:39.087320 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.087282 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7415-139772282508320"] Jul 20 20:00:39.087802 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.087784 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" containerName="test-curl-7415-139772282290368" Jul 20 20:00:39.087852 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.087803 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" containerName="test-curl-7415-139772282290368" Jul 20 20:00:39.087895 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.087884 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="927c6d6c-8b5a-437f-9bf9-b69b7bf974ec" containerName="test-curl-7415-139772282290368" Jul 20 20:00:39.091130 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.091112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:39.094160 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.094124 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmpxm\"" Jul 20 20:00:39.095918 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.095885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"] Jul 20 20:00:39.128623 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.128586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4c9\" (UniqueName: \"kubernetes.io/projected/19f9ecc6-c434-4648-a870-42eda90cbed7-kube-api-access-7x4c9\") pod \"test-curl-7415-139772282508320\" (UID: \"19f9ecc6-c434-4648-a870-42eda90cbed7\") " pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:39.229472 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.229427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4c9\" (UniqueName: \"kubernetes.io/projected/19f9ecc6-c434-4648-a870-42eda90cbed7-kube-api-access-7x4c9\") pod \"test-curl-7415-139772282508320\" (UID: \"19f9ecc6-c434-4648-a870-42eda90cbed7\") " pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:39.237852 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.237825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4c9\" (UniqueName: \"kubernetes.io/projected/19f9ecc6-c434-4648-a870-42eda90cbed7-kube-api-access-7x4c9\") pod \"test-curl-7415-139772282508320\" (UID: \"19f9ecc6-c434-4648-a870-42eda90cbed7\") " pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:39.403195 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.403108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:39.548227 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.548198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"] Jul 20 20:00:39.550166 ip-10-0-132-142 kubenswrapper[2576]: W0720 20:00:39.550138 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19f9ecc6_c434_4648_a870_42eda90cbed7.slice/crio-203b604fa9b17e43a24fae62439e01dfed9acb9a06cd4711656014cde47a5a38 WatchSource:0}: Error finding container 203b604fa9b17e43a24fae62439e01dfed9acb9a06cd4711656014cde47a5a38: Status 404 returned error can't find the container with id 203b604fa9b17e43a24fae62439e01dfed9acb9a06cd4711656014cde47a5a38 Jul 20 20:00:39.616424 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:39.616386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282508320" event={"ID":"19f9ecc6-c434-4648-a870-42eda90cbed7","Type":"ContainerStarted","Data":"203b604fa9b17e43a24fae62439e01dfed9acb9a06cd4711656014cde47a5a38"} Jul 20 20:00:40.623207 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:40.623173 2576 generic.go:356] "Generic (PLEG): container finished" podID="19f9ecc6-c434-4648-a870-42eda90cbed7" containerID="4ad598744dfb2cb10d7e3cb8ddc79d6020357667f4601836f3b63a7ccef53266" exitCode=0 Jul 20 20:00:40.623650 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:40.623263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282508320" event={"ID":"19f9ecc6-c434-4648-a870-42eda90cbed7","Type":"ContainerDied","Data":"4ad598744dfb2cb10d7e3cb8ddc79d6020357667f4601836f3b63a7ccef53266"} Jul 20 20:00:41.776790 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.776766 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:41.829028 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.828997 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7415-139772282508320_19f9ecc6-c434-4648-a870-42eda90cbed7/test-curl-7415-139772282508320/0.log" Jul 20 20:00:41.854854 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.854804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x4c9\" (UniqueName: \"kubernetes.io/projected/19f9ecc6-c434-4648-a870-42eda90cbed7-kube-api-access-7x4c9\") pod \"19f9ecc6-c434-4648-a870-42eda90cbed7\" (UID: \"19f9ecc6-c434-4648-a870-42eda90cbed7\") " Jul 20 20:00:41.854854 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.854842 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"] Jul 20 20:00:41.857175 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.857142 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f9ecc6-c434-4648-a870-42eda90cbed7-kube-api-access-7x4c9" (OuterVolumeSpecName: "kube-api-access-7x4c9") pod "19f9ecc6-c434-4648-a870-42eda90cbed7" (UID: "19f9ecc6-c434-4648-a870-42eda90cbed7"). InnerVolumeSpecName "kube-api-access-7x4c9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:00:41.859221 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.859198 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"] Jul 20 20:00:41.956403 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:41.956308 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x4c9\" (UniqueName: \"kubernetes.io/projected/19f9ecc6-c434-4648-a870-42eda90cbed7-kube-api-access-7x4c9\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:00:42.634224 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:42.634199 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:42.634405 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:42.634232 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="203b604fa9b17e43a24fae62439e01dfed9acb9a06cd4711656014cde47a5a38" Jul 20 20:00:42.644183 ip-10-0-132-142 kubenswrapper[2576]: E0720 20:00:42.644152 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7415-139772282508320\" is forbidden: User \"system:node:ip-10-0-132-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-142.ec2.internal' and this object" podUID="19f9ecc6-c434-4648-a870-42eda90cbed7" pod="opendatahub/test-curl-7415-139772282508320" Jul 20 20:00:43.042439 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:43.042405 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f9ecc6-c434-4648-a870-42eda90cbed7" path="/var/lib/kubelet/pods/19f9ecc6-c434-4648-a870-42eda90cbed7/volumes" Jul 20 20:00:55.901902 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:55.901867 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr"] Jul 20 20:00:55.904957 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:55.904929 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-710890-29742960-pz7cr"] Jul 20 20:00:57.042740 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:00:57.042707 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b231ec27-9119-4066-b6c0-2147518d83b2" path="/var/lib/kubelet/pods/b231ec27-9119-4066-b6c0-2147518d83b2/volumes" Jul 20 20:01:07.295175 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:07.295132 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g"] Jul 20 20:01:07.295716 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:07.295376 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" containerID="cri-o://3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e" gracePeriod=30 Jul 20 20:01:10.288246 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:10.288206 2576 patch_prober.go:28] interesting pod/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 20:01:10.288670 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:10.288269 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 20:01:12.566552 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.566456 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 20:01:12.663158 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663116 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nghcz\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-kube-api-access-nghcz\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663158 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663163 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-data\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663208 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-credential-socket\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994d6855-5445-4b6d-a22c-19605e8f6642-istio-podinfo\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-certs\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663308 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994d6855-5445-4b6d-a22c-19605e8f6642-istiod-ca-cert\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-socket\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663362 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-envoy\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663459 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663398 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-istio-token\") pod \"994d6855-5445-4b6d-a22c-19605e8f6642\" (UID: \"994d6855-5445-4b6d-a22c-19605e8f6642\") " Jul 20 20:01:12.663869 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663654 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:12.663869 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663758 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:12.663869 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663778 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.663869 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.663784 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:12.664103 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.664056 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994d6855-5445-4b6d-a22c-19605e8f6642-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:01:12.664452 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.664425 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-data" (OuterVolumeSpecName: "istio-data") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:12.665663 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.665636 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-kube-api-access-nghcz" (OuterVolumeSpecName: "kube-api-access-nghcz") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "kube-api-access-nghcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:01:12.665771 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.665681 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/994d6855-5445-4b6d-a22c-19605e8f6642-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:01:12.665830 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.665810 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-istio-token" (OuterVolumeSpecName: "istio-token") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:01:12.665872 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.665821 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "994d6855-5445-4b6d-a22c-19605e8f6642" (UID: "994d6855-5445-4b6d-a22c-19605e8f6642"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:12.765282 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765242 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994d6855-5445-4b6d-a22c-19605e8f6642-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765282 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765274 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765282 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765285 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994d6855-5445-4b6d-a22c-19605e8f6642-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765282 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765295 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765622 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765304 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765622 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765312 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765622 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765319 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nghcz\" (UniqueName: \"kubernetes.io/projected/994d6855-5445-4b6d-a22c-19605e8f6642-kube-api-access-nghcz\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.765622 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.765327 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994d6855-5445-4b6d-a22c-19605e8f6642-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:12.801861 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.801825 2576 generic.go:356] "Generic (PLEG): container finished" podID="994d6855-5445-4b6d-a22c-19605e8f6642" containerID="3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e" exitCode=0 Jul 20 20:01:12.802019 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.801877 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" Jul 20 20:01:12.802019 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.801890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" event={"ID":"994d6855-5445-4b6d-a22c-19605e8f6642","Type":"ContainerDied","Data":"3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e"} Jul 20 20:01:12.802019 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.801945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g" event={"ID":"994d6855-5445-4b6d-a22c-19605e8f6642","Type":"ContainerDied","Data":"b24e3d9f48a1dd0baa91c37fd258dc45bc46e3a9f1b3705de8f9902c9d158ea6"} Jul 20 20:01:12.802019 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.801975 2576 scope.go:117] "RemoveContainer" containerID="3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e" Jul 20 20:01:12.812657 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.812633 2576 scope.go:117] "RemoveContainer" containerID="c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e" Jul 20 20:01:12.822466 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.822439 2576 scope.go:117] "RemoveContainer" containerID="3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e" Jul 20 20:01:12.822890 ip-10-0-132-142 kubenswrapper[2576]: E0720 20:01:12.822869 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e\": container with ID starting with 3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e not found: ID does not exist" containerID="3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e" Jul 20 20:01:12.822972 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.822910 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e"} err="failed to get container status \"3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e\": rpc error: code = NotFound desc = could not find container \"3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e\": container with ID starting with 3fff74bcfd5833b5273412b50339132618a196add91a618e253dd4890832d22e not found: ID does not exist" Jul 20 20:01:12.822972 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.822930 2576 scope.go:117] "RemoveContainer" containerID="c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e" Jul 20 20:01:12.823194 ip-10-0-132-142 kubenswrapper[2576]: E0720 20:01:12.823179 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e\": container with ID starting with c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e not found: ID does not exist" containerID="c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e" Jul 20 20:01:12.823266 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.823196 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e"} err="failed to get container status \"c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e\": rpc error: code = NotFound desc = could not find container \"c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e\": container with ID starting with c784895538fba23992260124e9f9ac505f862fd0e0a501d8ff83b6ad40e06f9e not found: ID does not exist" Jul 20 20:01:12.826633 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.826606 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g"] Jul 20 20:01:12.829982 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:12.829956 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-710890-openshift-default-594bc56c-7cj7g"] Jul 20 20:01:13.043880 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:13.043846 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" path="/var/lib/kubelet/pods/994d6855-5445-4b6d-a22c-19605e8f6642/volumes" Jul 20 20:01:29.445154 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:29.445056 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64"] Jul 20 20:01:29.445618 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:29.445359 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" containerID="cri-o://3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4" gracePeriod=30 Jul 20 20:01:34.090436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.090394 2576 patch_prober.go:28] interesting pod/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 20:01:34.090877 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.090459 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 20:01:34.717030 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.716961 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 20:01:34.887270 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887233 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-istio-token\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887453 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887299 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-data\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887453 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887371 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-envoy\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887453 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887400 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-certs\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887453 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a421d886-4ef7-448f-9688-e9790b253f20-istiod-ca-cert\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887717 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887460 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-socket\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887717 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887530 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-credential-socket\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887717 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887582 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a421d886-4ef7-448f-9688-e9790b253f20-istio-podinfo\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887717 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887613 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwsm5\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-kube-api-access-vwsm5\") pod \"a421d886-4ef7-448f-9688-e9790b253f20\" (UID: \"a421d886-4ef7-448f-9688-e9790b253f20\") " Jul 20 20:01:34.887920 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887803 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:34.887920 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887840 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:34.887920 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887889 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:34.887920 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.887907 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a421d886-4ef7-448f-9688-e9790b253f20-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:01:34.888142 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.888044 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.888142 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.888069 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-credential-socket\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.888142 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.888092 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-workload-certs\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.888142 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.888107 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a421d886-4ef7-448f-9688-e9790b253f20-istiod-ca-cert\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.888284 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.888265 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-data" (OuterVolumeSpecName: "istio-data") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:34.889790 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.889763 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:01:34.889790 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.889780 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-istio-token" (OuterVolumeSpecName: "istio-token") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:01:34.890181 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.890162 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a421d886-4ef7-448f-9688-e9790b253f20-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:01:34.890253 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.890165 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-kube-api-access-vwsm5" (OuterVolumeSpecName: "kube-api-access-vwsm5") pod "a421d886-4ef7-448f-9688-e9790b253f20" (UID: "a421d886-4ef7-448f-9688-e9790b253f20"). InnerVolumeSpecName "kube-api-access-vwsm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:01:34.923764 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.923729 2576 generic.go:356] "Generic (PLEG): container finished" podID="a421d886-4ef7-448f-9688-e9790b253f20" containerID="3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4" exitCode=0 Jul 20 20:01:34.923909 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.923773 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" Jul 20 20:01:34.923909 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.923810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" event={"ID":"a421d886-4ef7-448f-9688-e9790b253f20","Type":"ContainerDied","Data":"3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4"} Jul 20 20:01:34.923909 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.923871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64" event={"ID":"a421d886-4ef7-448f-9688-e9790b253f20","Type":"ContainerDied","Data":"d37f593a93fdb95fc2380f55f39e565b6c5ef736414df116d1856f879334ac8f"} Jul 20 20:01:34.923909 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.923899 2576 scope.go:117] "RemoveContainer" containerID="3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4" Jul 20 20:01:34.933676 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.933650 2576 scope.go:117] "RemoveContainer" containerID="b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71" Jul 20 20:01:34.942473 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.942456 2576 scope.go:117] "RemoveContainer" containerID="3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4" Jul 20 20:01:34.942782 ip-10-0-132-142 kubenswrapper[2576]: E0720 20:01:34.942760 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4\": container with ID starting with 3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4 not found: ID does not exist" containerID="3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4" Jul 20 20:01:34.942836 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.942793 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4"} err="failed to get container status \"3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4\": rpc error: code = NotFound desc = could not find container \"3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4\": container with ID starting with 3a4635764a614fb8c261e27ffcebf5ba3c7540a8aa21fbc922f99c688e6a7fe4 not found: ID does not exist" Jul 20 20:01:34.942836 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.942816 2576 scope.go:117] "RemoveContainer" containerID="b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71" Jul 20 20:01:34.943079 ip-10-0-132-142 kubenswrapper[2576]: E0720 20:01:34.943060 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71\": container with ID starting with b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71 not found: ID does not exist" containerID="b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71" Jul 20 20:01:34.943122 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.943085 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71"} err="failed to get container status \"b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71\": rpc error: code = NotFound desc = could not find container \"b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71\": container with ID starting with b62e6b720c81f05e7901d72326ff575c9736b0231bbb2dcaf44b02bafc4cad71 not found: ID does not exist" Jul 20 20:01:34.947092 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.947067 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64"] Jul 20 20:01:34.951400 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.951380 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-01f2d8-openshift-default-688f657f9-pxt64"] Jul 20 20:01:34.989367 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.989279 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-envoy\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.989367 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.989307 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a421d886-4ef7-448f-9688-e9790b253f20-istio-podinfo\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.989367 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.989316 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwsm5\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-kube-api-access-vwsm5\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.989367 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.989326 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a421d886-4ef7-448f-9688-e9790b253f20-istio-token\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:34.989367 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:34.989335 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a421d886-4ef7-448f-9688-e9790b253f20-istio-data\") on node \"ip-10-0-132-142.ec2.internal\" DevicePath \"\"" Jul 20 20:01:35.049275 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:35.044632 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a421d886-4ef7-448f-9688-e9790b253f20" path="/var/lib/kubelet/pods/a421d886-4ef7-448f-9688-e9790b253f20/volumes" Jul 20 20:01:35.637316 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:35.637284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qslw6_a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da/manager/0.log" Jul 20 20:01:35.754721 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:35.754686 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c84466777-pq64k_fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f/manager/0.log" Jul 20 20:01:35.864289 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:35.864258 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lvbxg_f59e4485-5a66-4738-b598-28351918fe0e/server/0.log" Jul 20 20:01:35.988418 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:35.988336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zpl5s_1334545e-9b62-4e6b-a003-9ea573d87c69/manager/0.log" Jul 20 20:01:36.103391 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:36.103361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-8lpr4_4e3e945c-48b8-487b-839a-ded4d71102e7/copy-manifests/0.log" Jul 20 20:01:36.111295 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:36.111272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-8lpr4_4e3e945c-48b8-487b-839a-ded4d71102e7/manager/0.log" Jul 20 20:01:36.688611 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:36.688574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5ddcdf954-w47qt_87d72c73-0c8a-487c-b4e9-5a14826170ac/maas-api/0.log" Jul 20 20:01:36.800132 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:36.800103 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742930-snhkw_b084c127-4641-42ce-9d23-ff76d6631c4e/cleanup/0.log" Jul 20 20:01:37.018063 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:37.017986 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742960-xgwkb_7b46b8bf-ef1f-450c-b997-9da0856a3c7b/cleanup/0.log" Jul 20 20:01:37.129115 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:37.129066 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ffsqv_73d915c3-0f35-45e3-bc95-75876e5c104d/postgres/0.log" Jul 20 20:01:38.486839 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:38.486811 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gg8p6_71a258a0-06b9-420f-886c-5b75afe1a6c6/manager/0.log" Jul 20 20:01:38.600324 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:38.600297 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2sthf_7f6125ef-af01-443c-99b0-ea72b386bd84/manager/0.log" Jul 20 20:01:38.814789 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:38.814750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7c8rv_6e29bf11-751f-4c86-b4a2-bc74a92e5b99/registry-server/0.log" Jul 20 20:01:39.174163 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:39.174081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s7ws4_b8f9352e-fc77-45e4-9f73-dfaa27b83c36/manager/0.log" Jul 20 20:01:39.511019 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:39.510918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg6cb_9b6832cf-bb34-4165-9c2c-05836cb905c2/istio-proxy/0.log" Jul 20 20:01:39.845044 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:39.845013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-rwlks_9ff2ecee-451e-4cc7-8f80-3213faeeb76c/kube-auth-proxy/0.log" Jul 20 20:01:39.967344 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:39.967306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/1.log" Jul 20 20:01:40.082990 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:40.082957 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-95rpr_d51d8634-5bf8-49e0-a22c-ca78d4fb3822/payload-pre-processing/0.log" Jul 20 20:01:40.305692 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:40.305662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67666785d-tmfb4_bb1599ee-7c95-4b17-8f06-126ae0a6794c/router/0.log" Jul 20 20:01:40.753791 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:40.753703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gth9z_0a9a05dd-f3e5-4b83-80f6-1698f74fd45e/main/0.log" Jul 20 20:01:40.866036 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:40.866001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nhw6z_27708505-ead8-434b-82a8-ae19e410f4b4/main/0.log" Jul 20 20:01:50.778695 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:50.778658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f42sp_cfdecac6-161c-4f42-8d9e-b42a74bfa964/global-pull-secret-syncer/0.log" Jul 20 20:01:51.153865 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:51.153780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lsjgw_766a7aaf-d001-4c0b-ab1c-a1107f5921ec/konnectivity-agent/0.log" Jul 20 20:01:51.259324 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:51.259296 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-142.ec2.internal_b50cf1cf50a6e5e2eb27256335c2c144/haproxy/0.log" Jul 20 20:01:56.878451 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:56.878421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gg8p6_71a258a0-06b9-420f-886c-5b75afe1a6c6/manager/0.log" Jul 20 20:01:56.942351 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:56.942319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2sthf_7f6125ef-af01-443c-99b0-ea72b386bd84/manager/0.log" Jul 20 20:01:57.069250 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:57.069216 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7c8rv_6e29bf11-751f-4c86-b4a2-bc74a92e5b99/registry-server/0.log" Jul 20 20:01:57.620141 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:57.620109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s7ws4_b8f9352e-fc77-45e4-9f73-dfaa27b83c36/manager/0.log" Jul 20 20:01:59.466452 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:59.466417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-kj92j_ab796ac5-7859-498b-8d63-77b7d22ef77b/cluster-monitoring-operator/0.log" Jul 20 20:01:59.764987 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:59.764907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2tgn_3eb80656-555e-4cb2-b5ab-45e701f0cdba/node-exporter/0.log" Jul 20 20:01:59.796410 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:59.796380 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2tgn_3eb80656-555e-4cb2-b5ab-45e701f0cdba/kube-rbac-proxy/0.log" Jul 20 20:01:59.825840 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:01:59.825807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v2tgn_3eb80656-555e-4cb2-b5ab-45e701f0cdba/init-textfile/0.log" Jul 20 20:02:00.765887 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.765854 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds"] Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766283 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f9ecc6-c434-4648-a870-42eda90cbed7" containerName="test-curl-7415-139772282508320" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766297 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f9ecc6-c434-4648-a870-42eda90cbed7" containerName="test-curl-7415-139772282508320" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766307 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766313 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766331 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766340 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766345 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766356 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766361 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" Jul 20 20:02:00.766436 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766438 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f9ecc6-c434-4648-a870-42eda90cbed7" containerName="test-curl-7415-139772282508320" Jul 20 20:02:00.766853 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766452 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" Jul 20 20:02:00.766853 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766460 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a421d886-4ef7-448f-9688-e9790b253f20" containerName="istio-proxy" Jul 20 20:02:00.766853 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766467 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" Jul 20 20:02:00.766853 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.766473 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="994d6855-5445-4b6d-a22c-19605e8f6642" containerName="istio-proxy" Jul 20 20:02:00.770730 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.770713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.778029 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.777994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzf79\"/\"openshift-service-ca.crt\"" Jul 20 20:02:00.778141 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.777994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hzf79\"/\"default-dockercfg-ghgxr\"" Jul 20 20:02:00.778141 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.778033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzf79\"/\"kube-root-ca.crt\"" Jul 20 20:02:00.792825 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.792782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbkn\" (UniqueName: \"kubernetes.io/projected/376d6831-897e-4e95-9a3e-2de26559b43d-kube-api-access-pvbkn\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.792825 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.792830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-lib-modules\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.793067 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.792897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-sys\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.793067 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.792921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-podres\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.793067 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.792974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-proc\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.800479 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.800441 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds"] Jul 20 20:02:00.894201 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbkn\" (UniqueName: \"kubernetes.io/projected/376d6831-897e-4e95-9a3e-2de26559b43d-kube-api-access-pvbkn\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894201 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-lib-modules\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894434 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-sys\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894434 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-podres\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894434 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-proc\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894434 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894376 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-sys\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894434 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894428 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-lib-modules\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894647 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894452 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-proc\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.894647 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.894473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/376d6831-897e-4e95-9a3e-2de26559b43d-podres\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:00.911632 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:00.911601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbkn\" (UniqueName: \"kubernetes.io/projected/376d6831-897e-4e95-9a3e-2de26559b43d-kube-api-access-pvbkn\") pod \"perf-node-gather-daemonset-bjpds\" (UID: \"376d6831-897e-4e95-9a3e-2de26559b43d\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:01.081478 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:01.081444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:01.255978 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:01.255953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds"] Jul 20 20:02:01.258319 ip-10-0-132-142 kubenswrapper[2576]: W0720 20:02:01.258280 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod376d6831_897e_4e95_9a3e_2de26559b43d.slice/crio-443779d5f49bec35b65c96218f69a7e3b6c4b3c06df2fa6dfa2784c325ebdb14 WatchSource:0}: Error finding container 443779d5f49bec35b65c96218f69a7e3b6c4b3c06df2fa6dfa2784c325ebdb14: Status 404 returned error can't find the container with id 443779d5f49bec35b65c96218f69a7e3b6c4b3c06df2fa6dfa2784c325ebdb14 Jul 20 20:02:02.081979 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:02.081942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" event={"ID":"376d6831-897e-4e95-9a3e-2de26559b43d","Type":"ContainerStarted","Data":"90112e6640be277ee2b327da0dab9ee1f144f760ac264def56339bb523c9376b"} Jul 20 20:02:02.082706 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:02.082007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" event={"ID":"376d6831-897e-4e95-9a3e-2de26559b43d","Type":"ContainerStarted","Data":"443779d5f49bec35b65c96218f69a7e3b6c4b3c06df2fa6dfa2784c325ebdb14"} Jul 20 20:02:02.082706 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:02.082094 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:02.135885 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:02.135824 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" podStartSLOduration=2.135802812 podStartE2EDuration="2.135802812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:02.134526124 +0000 UTC m=+2823.527265656" watchObservedRunningTime="2026-07-20 20:02:02.135802812 +0000 UTC m=+2823.528542345" Jul 20 20:02:02.475710 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:02.475630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-zl2fv_d2497bd4-1c12-43c7-bc13-fde3b53402ce/networking-console-plugin/0.log" Jul 20 20:02:03.102597 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:03.102566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/1.log" Jul 20 20:02:03.107960 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:03.107936 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7v9v8_46bac223-834d-4105-a8e3-6995bf22f54a/console-operator/2.log" Jul 20 20:02:04.446930 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:04.446900 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-vlck8_67508af8-bfeb-4a8b-a310-41b9a699c485/volume-data-source-validator/0.log" Jul 20 20:02:05.711233 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:05.711199 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4pklv_8218dc0c-366a-408a-8f03-e8ba65854acd/dns/0.log" Jul 20 20:02:05.752888 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:05.752859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4pklv_8218dc0c-366a-408a-8f03-e8ba65854acd/kube-rbac-proxy/0.log" Jul 20 20:02:06.163663 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:06.163634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vt6nr_c19cada6-cfc9-4684-aaa7-d6d3aef3fc60/dns-node-resolver/0.log" Jul 20 20:02:07.039281 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:07.039251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9fhj_0e401ed6-b6f5-444d-b724-532d696079c1/node-ca/0.log" Jul 20 20:02:08.098362 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.098327 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-bjpds" Jul 20 20:02:08.404095 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.403981 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg6cb_9b6832cf-bb34-4165-9c2c-05836cb905c2/istio-proxy/0.log" Jul 20 20:02:08.663939 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.663859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-rwlks_9ff2ecee-451e-4cc7-8f80-3213faeeb76c/kube-auth-proxy/0.log" Jul 20 20:02:08.709967 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.709939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/0.log" Jul 20 20:02:08.736348 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.736305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/1.log" Jul 20 20:02:08.781508 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.781457 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-95rpr_d51d8634-5bf8-49e0-a22c-ca78d4fb3822/payload-pre-processing/0.log" Jul 20 20:02:08.902444 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:08.902400 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67666785d-tmfb4_bb1599ee-7c95-4b17-8f06-126ae0a6794c/router/0.log" Jul 20 20:02:09.732726 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:09.732686 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9x2jc_63cc0837-109f-4521-a91f-a795796bc8ab/serve-healthcheck-canary/0.log" Jul 20 20:02:10.414350 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:10.414298 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-nbklj_4b5f0e17-cd8d-4010-9fd8-dc332e2f7096/insights-operator/0.log" Jul 20 20:02:10.414914 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:10.414894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-nbklj_4b5f0e17-cd8d-4010-9fd8-dc332e2f7096/insights-operator/1.log" Jul 20 20:02:10.800920 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:10.800896 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxpxm_fa050036-bcb4-4f50-878b-9ad569a72d36/kube-rbac-proxy/0.log" Jul 20 20:02:10.858817 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:10.858790 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxpxm_fa050036-bcb4-4f50-878b-9ad569a72d36/exporter/0.log" Jul 20 20:02:10.917683 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:10.917644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxpxm_fa050036-bcb4-4f50-878b-9ad569a72d36/extractor/0.log" Jul 20 20:02:11.483695 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:11.483669 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg6cb_9b6832cf-bb34-4165-9c2c-05836cb905c2/istio-proxy/0.log" Jul 20 20:02:11.743671 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:11.743638 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-rwlks_9ff2ecee-451e-4cc7-8f80-3213faeeb76c/kube-auth-proxy/0.log" Jul 20 20:02:11.773261 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:11.773234 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/0.log" Jul 20 20:02:11.802772 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:11.802737 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/1.log" Jul 20 20:02:11.827175 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:11.827147 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-95rpr_d51d8634-5bf8-49e0-a22c-ca78d4fb3822/payload-pre-processing/0.log" Jul 20 20:02:11.873151 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:11.873124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67666785d-tmfb4_bb1599ee-7c95-4b17-8f06-126ae0a6794c/router/0.log" Jul 20 20:02:13.012747 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.012716 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xg6cb_9b6832cf-bb34-4165-9c2c-05836cb905c2/istio-proxy/0.log" Jul 20 20:02:13.219340 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.219304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6469fb7d96-rwlks_9ff2ecee-451e-4cc7-8f80-3213faeeb76c/kube-auth-proxy/0.log" Jul 20 20:02:13.240823 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.240793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/0.log" Jul 20 20:02:13.266763 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.266676 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kvnfp_09824d4e-c75c-4a0f-be07-eed400cba7d7/istio-proxy/1.log" Jul 20 20:02:13.290372 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.290347 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-95rpr_d51d8634-5bf8-49e0-a22c-ca78d4fb3822/payload-pre-processing/0.log" Jul 20 20:02:13.332273 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.332246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67666785d-tmfb4_bb1599ee-7c95-4b17-8f06-126ae0a6794c/router/0.log" Jul 20 20:02:13.795365 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.795278 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qslw6_a86050fe-ffc2-4f0d-9f5e-9aa471bbc4da/manager/0.log" Jul 20 20:02:13.912058 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.912013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c84466777-pq64k_fbbfd0f2-d93f-4b2b-8eab-195a3af5b84f/manager/0.log" Jul 20 20:02:13.972145 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:13.972115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lvbxg_f59e4485-5a66-4738-b598-28351918fe0e/server/0.log" Jul 20 20:02:14.079355 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:14.079260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zpl5s_1334545e-9b62-4e6b-a003-9ea573d87c69/manager/0.log" Jul 20 20:02:14.232249 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:14.232220 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-8lpr4_4e3e945c-48b8-487b-839a-ded4d71102e7/manager/0.log" Jul 20 20:02:14.274531 ip-10-0-132-142 kubenswrapper[2576]: I0720 20:02:14.274481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-8lpr4_4e3e945c-48b8-487b-839a-ded4d71102e7/copy-manifests/0.log"