Jul 28 20:45:37.269148 ip-10-0-134-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 20:45:37.269157 ip-10-0-134-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 20:45:37.269164 ip-10-0-134-221 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 20:45:37.269381 ip-10-0-134-221 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 20:45:46.309808 ip-10-0-134-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 20:45:46.309822 ip-10-0-134-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 93b7795826bc4088978f8bcc0f927d86 -- Jul 28 20:47:14.561460 ip-10-0-134-221 systemd[1]: Starting Kubernetes Kubelet... Jul 28 20:47:14.999846 ip-10-0-134-221 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 20:47:14.999846 ip-10-0-134-221 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 20:47:14.999846 ip-10-0-134-221 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 20:47:14.999846 ip-10-0-134-221 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 20:47:14.999846 ip-10-0-134-221 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 20:47:15.001928 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.001836 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 20:47:15.009707 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009686 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 20:47:15.009707 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009707 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009711 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009715 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009718 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009721 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009724 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009726 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009730 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009733 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009735 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009738 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009740 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009743 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009747 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009749 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009752 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009754 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009758 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009763 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 20:47:15.009797 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009765 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009768 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009772 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009775 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009777 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009780 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009782 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009785 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009788 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009790 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009794 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009797 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009799 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009802 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009805 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009808 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009811 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009814 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009816 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009819 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 20:47:15.010279 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009822 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009824 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009827 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009829 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009832 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009834 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009837 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009839 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009841 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009844 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009847 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009850 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009852 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009854 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009858 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009861 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009864 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009866 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009869 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009872 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 20:47:15.010795 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009875 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009877 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009880 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009882 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009885 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009888 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009890 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009894 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009897 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009900 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009903 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009906 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009908 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009912 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009916 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009918 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009921 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009925 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009928 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 20:47:15.011302 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009931 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009934 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009937 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009940 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009943 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009945 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009948 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009951 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009953 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009956 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009959 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009961 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009964 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009967 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009969 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009972 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009974 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009977 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009980 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.009982 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 20:47:15.011865 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010740 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010747 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010750 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010753 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010756 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010761 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010765 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010768 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010771 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010774 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010776 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010779 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010782 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010785 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010790 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010793 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010803 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010806 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010808 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 20:47:15.012381 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010811 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010814 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010817 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010820 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010823 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010826 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010829 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010831 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010840 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010843 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010846 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010850 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010853 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010856 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010859 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010862 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010865 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010884 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010888 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 20:47:15.012861 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010892 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010895 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010898 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010901 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010904 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010906 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010909 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010912 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010914 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010917 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010919 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010923 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010925 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010929 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010931 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010934 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010937 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010939 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010942 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010944 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 20:47:15.013357 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010947 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010949 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010952 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010954 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010956 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010959 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010961 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010964 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010966 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010969 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010971 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010974 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010977 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010979 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010981 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010984 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010986 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010989 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010992 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 20:47:15.013898 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010994 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010997 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.010999 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011002 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011004 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011009 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011013 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011016 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011018 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011021 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011023 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011026 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011028 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011031 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011033 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011035 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011038 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011040 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011043 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011045 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 20:47:15.014386 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011048 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011050 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011471 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011476 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011479 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011482 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011485 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011488 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011491 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011494 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011496 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011499 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011502 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011505 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011507 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011510 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011512 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011515 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011518 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011521 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 20:47:15.014887 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011524 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011526 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011530 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011535 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011538 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011541 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011543 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011546 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011548 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011551 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011553 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011556 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011558 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011561 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011563 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011566 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011568 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011572 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011574 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 20:47:15.015427 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011577 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011579 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011582 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011585 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011587 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011589 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011592 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011595 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011597 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011600 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011604 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011608 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011611 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011614 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011617 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011620 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011623 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011625 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011628 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 20:47:15.015892 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011632 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011635 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011638 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011641 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011643 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011646 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011649 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011652 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011654 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011657 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011660 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011663 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011665 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011668 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011670 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011673 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011675 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011677 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011680 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011682 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 20:47:15.016403 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011685 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011702 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011705 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011709 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011712 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011715 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011718 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011721 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011723 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011726 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011728 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011731 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011733 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011736 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011738 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011742 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011744 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011747 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011749 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011752 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 20:47:15.016899 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011755 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011757 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.011760 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011832 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011839 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011846 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011851 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011855 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011859 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011864 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011868 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011872 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011875 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011879 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011882 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011886 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011889 2568 flags.go:64] FLAG: --cgroup-root="" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011892 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011896 2568 flags.go:64] FLAG: --client-ca-file="" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011899 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011902 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011906 2568 flags.go:64] FLAG: --cluster-domain="" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011909 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011912 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 20:47:15.017424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011915 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011918 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011922 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011925 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011929 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011932 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011935 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011938 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011941 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011944 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011947 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011951 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011954 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011957 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011961 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011963 2568 flags.go:64] FLAG: --enable-server="true" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011969 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011976 2568 flags.go:64] FLAG: --event-burst="100" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011979 2568 flags.go:64] FLAG: --event-qps="50" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011982 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011985 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011988 2568 flags.go:64] FLAG: --eviction-hard="" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011991 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011994 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.011998 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 20:47:15.018006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012001 2568 flags.go:64] FLAG: --eviction-soft="" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012004 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012008 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012011 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012014 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012016 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012019 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012022 2568 flags.go:64] FLAG: --feature-gates="" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012026 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012029 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012032 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012035 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012038 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012041 2568 flags.go:64] FLAG: --help="false" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012044 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012047 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012050 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012052 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012056 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012059 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012063 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012066 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012069 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 20:47:15.018621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012073 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012076 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012079 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012082 2568 flags.go:64] FLAG: --kube-reserved="" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012085 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012088 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012091 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012094 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012097 2568 flags.go:64] FLAG: --lock-file="" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012100 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012103 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012105 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012112 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012115 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012118 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012120 2568 flags.go:64] FLAG: --logging-format="text" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012123 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012126 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012129 2568 flags.go:64] FLAG: --manifest-url="" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012132 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012136 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012139 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012143 2568 flags.go:64] FLAG: --max-pods="110" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012146 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012149 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 20:47:15.019226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012151 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012154 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012171 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012174 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012177 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012185 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012188 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012192 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012195 2568 flags.go:64] FLAG: --pod-cidr="" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012198 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012204 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012207 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012210 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012214 2568 flags.go:64] FLAG: --port="10250" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012217 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012220 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0deebd8c5a470b1f8" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012223 2568 flags.go:64] FLAG: --qos-reserved="" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012226 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012229 2568 flags.go:64] FLAG: --register-node="true" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012232 2568 flags.go:64] FLAG: --register-with-taints="" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012236 2568 flags.go:64] FLAG: --registry-burst="10" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012239 2568 flags.go:64] FLAG: --registry-qps="5" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012242 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012245 2568 flags.go:64] FLAG: --reserved-memory="" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012249 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 20:47:15.019903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012252 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012255 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012258 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012261 2568 flags.go:64] FLAG: --runonce="false" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012263 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012266 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012269 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012272 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012275 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012278 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012283 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012286 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012289 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012292 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012296 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012299 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012303 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012306 2568 flags.go:64] FLAG: --system-cgroups="" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012308 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012313 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012316 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012319 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012323 2568 flags.go:64] FLAG: --tls-min-version="" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012326 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012329 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 20:47:15.020693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012331 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012334 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012337 2568 flags.go:64] FLAG: --v="2" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012342 2568 flags.go:64] FLAG: --version="false" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012346 2568 flags.go:64] FLAG: --vmodule="" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012349 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.012352 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012468 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012471 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012474 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012477 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012480 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012483 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012485 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012488 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012492 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012495 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012500 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012504 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012506 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012509 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 20:47:15.021655 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012513 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012516 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012519 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012521 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012524 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012527 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012529 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012532 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012535 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012537 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012540 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012542 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012545 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012547 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012550 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012553 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012555 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012558 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012560 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012564 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 20:47:15.022219 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012567 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012569 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012572 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012574 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012577 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012579 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012582 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012585 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012589 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012592 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012594 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012597 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012601 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012604 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012607 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012609 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012613 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012617 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012620 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 20:47:15.022710 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012622 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012625 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012627 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012630 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012632 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012635 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012638 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012641 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012643 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012647 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012649 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012652 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012654 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012657 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012659 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012663 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012667 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012670 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012673 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012675 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 20:47:15.023183 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012678 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012682 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012685 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012687 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012690 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012697 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012700 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012703 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012705 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012708 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012711 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012713 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012716 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012718 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012721 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012724 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012726 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012729 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012731 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012734 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 20:47:15.023718 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012737 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012740 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012743 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012745 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012748 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.012750 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.013637 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.022406 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.022423 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.023334 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.023345 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023427 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023445 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023451 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 20:47:15.024227 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023456 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023459 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023463 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023466 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023469 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023471 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023474 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023477 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023479 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023482 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023485 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023488 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023490 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023493 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023496 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023499 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023502 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023504 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023507 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023509 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 20:47:15.024589 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023512 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023515 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023517 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023520 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023522 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023526 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023531 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023534 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023537 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023540 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023543 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023546 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023549 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023552 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023555 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023557 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023560 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023562 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023565 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 20:47:15.025079 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023567 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023570 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023573 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023575 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023578 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023580 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023583 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023586 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023589 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023591 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023594 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023596 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023598 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023601 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023604 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023606 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023609 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023611 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023614 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023617 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 20:47:15.025706 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023620 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023622 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023625 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023628 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023630 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023633 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023635 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023638 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023641 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023644 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023647 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023649 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023652 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023655 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023657 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023660 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023663 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023666 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023669 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023672 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 20:47:15.026212 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023674 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023677 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023679 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023682 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023686 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023690 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023693 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023696 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023698 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023701 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023704 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023707 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023710 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023712 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023715 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023718 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 20:47:15.026685 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023720 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.023726 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023847 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023853 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023856 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023859 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023862 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023865 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023869 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023871 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023874 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023877 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023880 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023883 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023887 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 20:47:15.027116 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023889 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023892 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023895 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023898 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023900 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023903 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023906 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023908 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023911 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023914 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023916 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023919 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023922 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023924 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023927 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023929 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023933 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023937 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023940 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 20:47:15.027502 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023943 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023946 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023949 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023951 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023954 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023956 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023959 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023962 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023964 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023967 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023969 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023972 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023974 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023978 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023980 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023983 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023986 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023988 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023991 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023993 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 20:47:15.027964 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023996 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.023998 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024000 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024003 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024005 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024008 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024011 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024013 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024016 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024018 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024021 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024023 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024026 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024028 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024031 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024033 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024036 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024038 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024040 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 20:47:15.028466 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024043 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024046 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024048 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024051 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024053 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024056 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024061 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024065 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024067 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024070 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024073 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024076 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024080 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024083 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024087 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024090 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024093 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024096 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024099 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 20:47:15.028934 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024101 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024104 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024106 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024109 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024112 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024114 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024117 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024119 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:15.024122 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.024127 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.024265 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.026749 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.028459 2568 server.go:1019] "Starting client certificate rotation" Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.028561 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 20:47:15.029478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.028591 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 20:47:15.031478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.031462 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 20:47:15.032914 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.032888 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 20:47:15.045764 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.045742 2568 log.go:25] "Validated CRI v1 runtime API" Jul 28 20:47:15.048557 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.048536 2568 log.go:25] "Validated CRI v1 image API" Jul 28 20:47:15.050386 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.050369 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 20:47:15.057553 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.057526 2568 fs.go:135] Filesystem UUIDs: map[3004226c-4270-496d-8476-105441d476be:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8be7da00-66da-4de4-a323-4bb759e29c31:/dev/nvme0n1p3] Jul 28 20:47:15.057652 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.057547 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 20:47:15.062125 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.062106 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 20:47:15.063707 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.063589 2568 manager.go:216] Machine: {Timestamp:2026-07-28 20:47:15.062287382 +0000 UTC m=+0.372104669 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100082 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec270ea552390377940dbaa956cd2109 SystemUUID:ec270ea5-5239-0377-940d-baa956cd2109 BootID:93b77958-26bc-4088-978f-8bcc0f927d86 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:10:a6:01:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:10:a6:01:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:58:05:a2:4c:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 20:47:15.063707 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.063703 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 20:47:15.063893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.063793 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 20:47:15.065982 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.065953 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 20:47:15.066172 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.065985 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 20:47:15.066916 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.066903 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 20:47:15.066970 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.066923 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 20:47:15.066970 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.066934 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 20:47:15.066970 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.066955 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 20:47:15.068268 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.068255 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 20:47:15.071150 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071134 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 28 20:47:15.071288 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071281 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 20:47:15.071346 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071312 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 28 20:47:15.071346 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071323 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 20:47:15.071346 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071337 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 20:47:15.071467 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071349 2568 kubelet.go:398] "Adding apiserver pod source" Jul 28 20:47:15.071467 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071359 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 20:47:15.071938 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071921 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 20:47:15.072028 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.071943 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 20:47:15.076910 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.076891 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 20:47:15.079393 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.079378 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 20:47:15.079450 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.079409 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 20:47:15.081499 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081485 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081503 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081510 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081519 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081529 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081536 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081544 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 20:47:15.081550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081550 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 20:47:15.081814 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081556 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 20:47:15.081814 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081563 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 20:47:15.081814 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081573 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 20:47:15.081814 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.081581 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 20:47:15.083319 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.083303 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 20:47:15.083375 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.083322 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 20:47:15.086950 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.086934 2568 server.go:1268] "Started kubelet" Jul 28 20:47:15.087199 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.087082 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 20:47:15.087318 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.087306 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 20:47:15.087760 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.087301 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 20:47:15.087760 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.087673 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 20:47:15.087965 ip-10-0-134-221 systemd[1]: Started Kubernetes Kubelet. Jul 28 20:47:15.089551 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.089528 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 20:47:15.090522 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.090503 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 28 20:47:15.093955 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.093934 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 20:47:15.098766 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.097609 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-221.ec2.internal.18c68f17e4ef9714 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-221.ec2.internal,UID:ip-10-0-134-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-221.ec2.internal,},FirstTimestamp:2026-07-28 20:47:15.086907156 +0000 UTC m=+0.396724444,LastTimestamp:2026-07-28 20:47:15.086907156 +0000 UTC m=+0.396724444,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-221.ec2.internal,}" Jul 28 20:47:15.099360 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.099326 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 20:47:15.099360 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.099326 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 20:47:15.100389 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.100370 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 20:47:15.100389 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.100381 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 20:47:15.100542 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.100497 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:15.101215 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101195 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 20:47:15.101215 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101200 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 20:47:15.101355 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101226 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 20:47:15.101355 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101351 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 28 20:47:15.101463 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101359 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 28 20:47:15.101564 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101546 2568 factory.go:55] Registering systemd factory Jul 28 20:47:15.101747 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101725 2568 factory.go:223] Registration of the systemd container factory successfully Jul 28 20:47:15.101988 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101975 2568 factory.go:153] Registering CRI-O factory Jul 28 20:47:15.102032 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.101992 2568 factory.go:223] Registration of the crio container factory successfully Jul 28 20:47:15.102071 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.102046 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 20:47:15.102107 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.102076 2568 factory.go:103] Registering Raw factory Jul 28 20:47:15.102107 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.102097 2568 manager.go:1196] Started watching for new ooms in manager Jul 28 20:47:15.102517 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.102505 2568 manager.go:349] Starting recovery of all containers Jul 28 20:47:15.104618 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.104590 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 20:47:15.104727 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.104710 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 20:47:15.111443 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.111417 2568 manager.go:354] Recovery completed Jul 28 20:47:15.115780 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.115760 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmdmk" Jul 28 20:47:15.118484 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.118471 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.120778 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.120761 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.120840 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.120790 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.120840 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.120801 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.121432 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.121416 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 20:47:15.121432 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.121423 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.121432 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.121431 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 20:47:15.121597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.121449 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 28 20:47:15.123047 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.123025 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.123137 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.123057 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.123137 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.123070 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.124466 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.124449 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gmdmk" Jul 28 20:47:15.126366 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.126352 2568 policy_none.go:49] "None policy: Start" Jul 28 20:47:15.126423 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.126371 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 20:47:15.126423 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.126382 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 20:47:15.128347 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.128335 2568 policy_none.go:47] "Start" Jul 28 20:47:15.201609 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.201447 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:15.204401 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.204378 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 20:47:15.205616 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.205594 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 20:47:15.205701 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.205628 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 20:47:15.205701 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.205649 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 20:47:15.205701 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.205688 2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 28 20:47:15.207835 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.207820 2568 manager.go:337] "Starting Device Plugin manager" Jul 28 20:47:15.207914 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.207856 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 20:47:15.207914 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.207870 2568 server.go:87] "Starting device plugin registration server" Jul 28 20:47:15.208188 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.208172 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 20:47:15.208290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.208196 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 20:47:15.208360 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.208341 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 20:47:15.208622 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.208398 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 20:47:15.208622 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.208426 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 20:47:15.208622 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.208436 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 20:47:15.209046 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.209026 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 20:47:15.209117 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.209084 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:15.305842 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.305757 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"] Jul 28 20:47:15.305842 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.305837 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.307469 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.307451 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.307548 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.307488 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.307548 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.307501 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.308303 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.308285 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.309003 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.308988 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.309060 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.309015 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.309060 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.309025 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.309060 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.309049 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.309921 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.309909 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.310020 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310008 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.310065 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310033 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.310566 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310550 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.310643 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310577 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.310643 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310588 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.310643 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310557 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.310643 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310619 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.310643 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.310633 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.311528 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.311514 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.312883 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.312869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.312947 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.312894 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 20:47:15.313584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.313569 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 28 20:47:15.313652 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.313593 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 20:47:15.313652 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.313602 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 28 20:47:15.318119 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.318106 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.318206 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.318124 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-221.ec2.internal\": node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:15.342049 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.342019 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.343329 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.343313 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:15.346623 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.346604 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.402507 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.402480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34767be75f7bfcb613a9de6d7fedac1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"34767be75f7bfcb613a9de6d7fedac1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.402507 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.402509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34767be75f7bfcb613a9de6d7fedac1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"34767be75f7bfcb613a9de6d7fedac1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.402669 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:15.402527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de661c76ba7bc5e0e4094110dc9768c0-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"de661c76ba7bc5e0e4094110dc9768c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 28 20:47:15.443956 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:15.443918 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:16.667107 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.667087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34767be75f7bfcb613a9de6d7fedac1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"34767be75f7bfcb613a9de6d7fedac1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.667192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.667114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34767be75f7bfcb613a9de6d7fedac1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"34767be75f7bfcb613a9de6d7fedac1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.667192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.667133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de661c76ba7bc5e0e4094110dc9768c0-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"de661c76ba7bc5e0e4094110dc9768c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.667192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.667161 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de661c76ba7bc5e0e4094110dc9768c0-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"de661c76ba7bc5e0e4094110dc9768c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.667192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.667186 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34767be75f7bfcb613a9de6d7fedac1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"34767be75f7bfcb613a9de6d7fedac1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.667314 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.667189 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34767be75f7bfcb613a9de6d7fedac1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"34767be75f7bfcb613a9de6d7fedac1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.708390 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:16.708359 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:16.809075 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:16.809000 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:16.810107 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.810094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.813731 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:16.813709 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 28 20:47:16.909629 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:16.909590 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:17.010172 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:17.010137 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:17.110675 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:17.110604 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:17.191185 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.191158 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 20:47:17.191654 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.191325 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 20:47:17.211413 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:17.211387 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:17.271911 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.271889 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 20:47:17.294375 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.294336 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 20:42:16 +0000 UTC" deadline="2028-04-27 00:26:48.920755826 +0000 UTC" Jul 28 20:47:17.294375 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.294371 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15315h39m31.626389179s" Jul 28 20:47:17.312504 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:17.312471 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 28 20:47:17.391588 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:17.391542 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34767be75f7bfcb613a9de6d7fedac1d.slice/crio-82ac32ffa8f97aa9f1f5df7b6f61ef140a65d00b8ae97ea2dde13b3a65125c2f WatchSource:0}: Error finding container 82ac32ffa8f97aa9f1f5df7b6f61ef140a65d00b8ae97ea2dde13b3a65125c2f: Status 404 returned error can't find the container with id 82ac32ffa8f97aa9f1f5df7b6f61ef140a65d00b8ae97ea2dde13b3a65125c2f Jul 28 20:47:17.392193 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:17.392170 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde661c76ba7bc5e0e4094110dc9768c0.slice/crio-a25583b7fbe67d26dbd323df4196986699d5ab6cfd17bf95aadf2981afcfc6e5 WatchSource:0}: Error finding container a25583b7fbe67d26dbd323df4196986699d5ab6cfd17bf95aadf2981afcfc6e5: Status 404 returned error can't find the container with id a25583b7fbe67d26dbd323df4196986699d5ab6cfd17bf95aadf2981afcfc6e5 Jul 28 20:47:17.397731 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.397716 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 20:47:17.404965 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.404935 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 20:47:17.465327 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.465282 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 28 20:47:17.484549 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.484526 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 20:47:17.486101 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.486086 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 28 20:47:17.502260 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.502242 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 20:47:17.637263 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:17.637187 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 20:47:18.103652 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.103566 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 20:47:18.236523 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.236495 2568 apiserver.go:52] "Watching apiserver" Jul 28 20:47:18.245945 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.245910 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 20:47:18.247278 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.247244 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-ltssv","openshift-network-diagnostics/network-check-target-z4dfs","openshift-network-operator/iptables-alerter-kw942","openshift-ovn-kubernetes/ovnkube-node-mvjnh","kube-system/global-pull-secret-syncer-jqcjf","kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ph26j","openshift-dns/node-resolver-6n4w5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal","openshift-multus/multus-additional-cni-plugins-vmh88","openshift-multus/multus-nzp2d","openshift-multus/network-metrics-daemon-knwvn","kube-system/konnectivity-agent-pk6jt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd"] Jul 28 20:47:18.249968 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.249862 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.252686 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.252553 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7pqxd\"" Jul 28 20:47:18.252686 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.252564 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.252686 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.252599 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.252895 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.252842 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.255134 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.255091 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 20:47:18.255407 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.255389 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.256226 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.256208 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 20:47:18.256427 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.256399 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xhbxj\"" Jul 28 20:47:18.258687 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.258668 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.259809 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.259789 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.260332 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.259866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:18.260332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.260201 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lwhv4\"" Jul 28 20:47:18.260332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.260217 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.260332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.260290 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 20:47:18.260332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.260221 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.262153 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.261822 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 20:47:18.262332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.262316 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.264005 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.263436 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 20:47:18.264005 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.263643 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9nkz8\"" Jul 28 20:47:18.264005 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.263885 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.264005 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.263896 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 20:47:18.264005 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.263903 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.264347 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.264259 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 20:47:18.265501 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.264711 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zzdfw\"" Jul 28 20:47:18.265501 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.264729 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.265501 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.264834 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.265501 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.264994 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 20:47:18.265501 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.265037 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.265501 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.265184 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 20:47:18.268003 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.267985 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.268146 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.268038 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.268318 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.268297 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jk7m9\"" Jul 28 20:47:18.269049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.268565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.271057 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.270805 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.271160 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.271115 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2mn7n\"" Jul 28 20:47:18.271693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.271297 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:18.271693 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.271363 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:18.271693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.271375 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.271693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.271451 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 20:47:18.274849 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.274829 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.276208 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-kubernetes\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276310 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-run\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276310 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-socket-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.276310 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276269 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-registration-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.276310 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-etc-selinux\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c5b9c53-c6e9-4668-863a-9b8887e3262f-agent-certs\") pod \"konnectivity-agent-pk6jt\" (UID: \"9c5b9c53-c6e9-4668-863a-9b8887e3262f\") " pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-systemd-units\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-run-netns\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysctl-d\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-env-overrides\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276466 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysconfig\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmqw\" (UniqueName: \"kubernetes.io/projected/000091c6-9bbc-4e25-b338-bef4dc6c6111-kube-api-access-rzmqw\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.276528 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-lib-modules\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c7lc\" (UniqueName: \"kubernetes.io/projected/14a0986e-5828-4fb4-940b-99949f5f0416-kube-api-access-5c7lc\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b9e9030-a744-42c2-b403-31f36b966e7a-ovn-node-metrics-cert\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276688 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-host\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15b803eb-bef5-4f43-95ff-be78542a558b-host\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-log-socket\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14a0986e-5828-4fb4-940b-99949f5f0416-etc-tuned\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-device-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-tmp-dir\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15b803eb-bef5-4f43-95ff-be78542a558b-serviceca\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.276893 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-systemd\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-etc-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-cni-bin\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.276990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-ovnkube-script-lib\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n829\" (UniqueName: \"kubernetes.io/projected/8b9e9030-a744-42c2-b403-31f36b966e7a-kube-api-access-4n829\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysctl-conf\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277090 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-sys\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277144 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-slash\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b9c53-c6e9-4668-863a-9b8887e3262f-konnectivity-ca\") pod \"konnectivity-agent-pk6jt\" (UID: \"9c5b9c53-c6e9-4668-863a-9b8887e3262f\") " pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-var-lib-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcffj\" (UniqueName: \"kubernetes.io/projected/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-kube-api-access-lcffj\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277321 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-hosts-file\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-kubelet\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-ovn\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-cni-netd\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.277582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277466 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-ovnkube-config\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277490 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-modprobe-d\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-var-lib-kubelet\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7tgt\" (UniqueName: \"kubernetes.io/projected/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-kube-api-access-x7tgt\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-sys-fs\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277609 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpnn8\" (UniqueName: \"kubernetes.io/projected/15b803eb-bef5-4f43-95ff-be78542a558b-kube-api-access-jpnn8\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a0986e-5828-4fb4-940b-99949f5f0416-tmp\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-node-log\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-systemd\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-iptables-alerter-script\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277758 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-host-slash\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277777 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277784 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5971d7f-c363-407b-8f3a-09619a3219e1-kubelet-config\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277885 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5971d7f-c363-407b-8f3a-09619a3219e1-dbus\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277778 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8bzpb\"" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.277998 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.278039 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 20:47:18.278527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.278046 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.281796 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.280138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.281796 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.280327 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:18.284189 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.284170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8z4lv\"" Jul 28 20:47:18.284390 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.284375 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 20:47:18.285756 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.285735 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 20:47:18.303153 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.303128 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5l6d8" Jul 28 20:47:18.309516 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.309494 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5l6d8" Jul 28 20:47:18.366301 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.366212 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 20:47:18.375374 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.375317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"34767be75f7bfcb613a9de6d7fedac1d","Type":"ContainerStarted","Data":"82ac32ffa8f97aa9f1f5df7b6f61ef140a65d00b8ae97ea2dde13b3a65125c2f"} Jul 28 20:47:18.376794 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.376764 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" event={"ID":"de661c76ba7bc5e0e4094110dc9768c0","Type":"ContainerStarted","Data":"a25583b7fbe67d26dbd323df4196986699d5ab6cfd17bf95aadf2981afcfc6e5"} Jul 28 20:47:18.378119 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378091 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-os-release\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378225 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-socket-dir-parent\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378225 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-cni-multus\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378225 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378218 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cnibin\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcffj\" (UniqueName: \"kubernetes.io/projected/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-kube-api-access-lcffj\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-hosts-file\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-kubelet\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-ovn\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-cni-netd\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.378453 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378424 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-kubelet\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378445 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-ovn\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-ovnkube-config\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c7c22ba-252a-40df-9d10-8c53ed13f327-cni-binary-copy\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378502 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-cni-netd\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-multus-certs\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-modprobe-d\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.378593 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-var-lib-kubelet\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7tgt\" (UniqueName: \"kubernetes.io/projected/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-kube-api-access-x7tgt\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.378666 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:18.878645167 +0000 UTC m=+3.024675384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-netns\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdx45\" (UniqueName: \"kubernetes.io/projected/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-kube-api-access-zdx45\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-sys-fs\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpnn8\" (UniqueName: \"kubernetes.io/projected/15b803eb-bef5-4f43-95ff-be78542a558b-kube-api-access-jpnn8\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-cnibin\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378802 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-modprobe-d\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.378831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378811 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-conf-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq6pp\" (UniqueName: \"kubernetes.io/projected/1c7c22ba-252a-40df-9d10-8c53ed13f327-kube-api-access-cq6pp\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a0986e-5828-4fb4-940b-99949f5f0416-tmp\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-node-log\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378937 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-var-lib-kubelet\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378413 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-hosts-file\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.378991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-systemd\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379031 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-sys-fs\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-iptables-alerter-script\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379042 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-systemd\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-host-slash\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379089 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-ovnkube-config\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379098 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-node-log\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5971d7f-c363-407b-8f3a-09619a3219e1-kubelet-config\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-host-slash\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.379597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5971d7f-c363-407b-8f3a-09619a3219e1-dbus\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379201 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379218 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5971d7f-c363-407b-8f3a-09619a3219e1-kubelet-config\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-kubernetes\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-run\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-socket-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-registration-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-etc-selinux\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379331 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-kubernetes\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379346 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c5b9c53-c6e9-4668-863a-9b8887e3262f-agent-certs\") pod \"konnectivity-agent-pk6jt\" (UID: \"9c5b9c53-c6e9-4668-863a-9b8887e3262f\") " pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-systemd-units\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379381 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-registration-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-run-netns\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379398 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5971d7f-c363-407b-8f3a-09619a3219e1-dbus\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379398 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysctl-d\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.380311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-systemd-units\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-env-overrides\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379394 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-run\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379478 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-socket-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379486 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-run-netns\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379489 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-etc-selinux\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-k8s-cni-cncf-io\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-hostroot\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-etc-kubernetes\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379520 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-iptables-alerter-script\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysconfig\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379603 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysctl-d\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmqw\" (UniqueName: \"kubernetes.io/projected/000091c6-9bbc-4e25-b338-bef4dc6c6111-kube-api-access-rzmqw\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379664 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysconfig\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379704 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.381128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379730 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-system-cni-dir\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379790 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-os-release\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379811 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-lib-modules\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-env-overrides\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7lc\" (UniqueName: \"kubernetes.io/projected/14a0986e-5828-4fb4-940b-99949f5f0416-kube-api-access-5c7lc\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379864 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379876 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b9e9030-a744-42c2-b403-31f36b966e7a-ovn-node-metrics-cert\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-daemon-config\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xhsb\" (UniqueName: \"kubernetes.io/projected/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-kube-api-access-5xhsb\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379990 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-lib-modules\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.379988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-host\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15b803eb-bef5-4f43-95ff-be78542a558b-host\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380037 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380056 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-log-socket\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.381925 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14a0986e-5828-4fb4-940b-99949f5f0416-etc-tuned\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-host\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-device-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380161 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-log-socket\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380182 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15b803eb-bef5-4f43-95ff-be78542a558b-host\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-tmp-dir\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15b803eb-bef5-4f43-95ff-be78542a558b-serviceca\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/000091c6-9bbc-4e25-b338-bef4dc6c6111-device-dir\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-system-cni-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380297 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-cni-bin\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380417 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-kubelet\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380456 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-systemd\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380490 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-tmp-dir\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-etc-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380510 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-run-systemd\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-cni-bin\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-etc-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.382746 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-ovnkube-script-lib\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n829\" (UniqueName: \"kubernetes.io/projected/8b9e9030-a744-42c2-b403-31f36b966e7a-kube-api-access-4n829\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysctl-conf\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-sys\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380691 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15b803eb-bef5-4f43-95ff-be78542a558b-serviceca\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-slash\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b9c53-c6e9-4668-863a-9b8887e3262f-konnectivity-ca\") pod \"konnectivity-agent-pk6jt\" (UID: \"9c5b9c53-c6e9-4668-863a-9b8887e3262f\") " pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-var-lib-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-etc-sysctl-conf\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380828 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-cni-bin\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-cni-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380867 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-host-slash\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14a0986e-5828-4fb4-940b-99949f5f0416-sys\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.380907 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b9e9030-a744-42c2-b403-31f36b966e7a-var-lib-openvswitch\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.381082 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b9e9030-a744-42c2-b403-31f36b966e7a-ovnkube-script-lib\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.383584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.381485 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c5b9c53-c6e9-4668-863a-9b8887e3262f-konnectivity-ca\") pod \"konnectivity-agent-pk6jt\" (UID: \"9c5b9c53-c6e9-4668-863a-9b8887e3262f\") " pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.385015 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.384990 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/14a0986e-5828-4fb4-940b-99949f5f0416-etc-tuned\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.385117 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.385014 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a0986e-5828-4fb4-940b-99949f5f0416-tmp\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.386908 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.386835 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b9e9030-a744-42c2-b403-31f36b966e7a-ovn-node-metrics-cert\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.387018 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.386982 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c5b9c53-c6e9-4668-863a-9b8887e3262f-agent-certs\") pod \"konnectivity-agent-pk6jt\" (UID: \"9c5b9c53-c6e9-4668-863a-9b8887e3262f\") " pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.395877 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.395790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7tgt\" (UniqueName: \"kubernetes.io/projected/4bc1c089-2ca9-4754-b1c4-bac63ab3145e-kube-api-access-x7tgt\") pod \"iptables-alerter-kw942\" (UID: \"4bc1c089-2ca9-4754-b1c4-bac63ab3145e\") " pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.396006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.395962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmqw\" (UniqueName: \"kubernetes.io/projected/000091c6-9bbc-4e25-b338-bef4dc6c6111-kube-api-access-rzmqw\") pod \"aws-ebs-csi-driver-node-wk2bd\" (UID: \"000091c6-9bbc-4e25-b338-bef4dc6c6111\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.396507 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.396463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcffj\" (UniqueName: \"kubernetes.io/projected/eedf6297-a6a5-4015-ab30-f37a8a4b17d2-kube-api-access-lcffj\") pod \"node-resolver-6n4w5\" (UID: \"eedf6297-a6a5-4015-ab30-f37a8a4b17d2\") " pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.397587 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.397561 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c7lc\" (UniqueName: \"kubernetes.io/projected/14a0986e-5828-4fb4-940b-99949f5f0416-kube-api-access-5c7lc\") pod \"tuned-ph26j\" (UID: \"14a0986e-5828-4fb4-940b-99949f5f0416\") " pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.398672 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.398613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpnn8\" (UniqueName: \"kubernetes.io/projected/15b803eb-bef5-4f43-95ff-be78542a558b-kube-api-access-jpnn8\") pod \"node-ca-ltssv\" (UID: \"15b803eb-bef5-4f43-95ff-be78542a558b\") " pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.400943 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.400920 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n829\" (UniqueName: \"kubernetes.io/projected/8b9e9030-a744-42c2-b403-31f36b966e7a-kube-api-access-4n829\") pod \"ovnkube-node-mvjnh\" (UID: \"8b9e9030-a744-42c2-b403-31f36b966e7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.482141 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-cni-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482150 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-os-release\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482178 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-socket-dir-parent\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-cni-multus\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cnibin\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482292 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c7c22ba-252a-40df-9d10-8c53ed13f327-cni-binary-copy\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-multus-certs\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-netns\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdx45\" (UniqueName: \"kubernetes.io/projected/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-kube-api-access-zdx45\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-cnibin\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-conf-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq6pp\" (UniqueName: \"kubernetes.io/projected/1c7c22ba-252a-40df-9d10-8c53ed13f327-kube-api-access-cq6pp\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.482461 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482499 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.482515 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:18.982500359 +0000 UTC m=+3.128530559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482548 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-k8s-cni-cncf-io\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482567 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-hostroot\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-etc-kubernetes\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.482653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-system-cni-dir\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482687 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-os-release\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482706 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-daemon-config\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482722 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xhsb\" (UniqueName: \"kubernetes.io/projected/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-kube-api-access-5xhsb\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-system-cni-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-cni-bin\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-kubelet\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482769 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cnibin\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-cni-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482913 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-os-release\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482942 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-socket-dir-parent\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.482983 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-cni-multus\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483119 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-multus-certs\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-k8s-cni-cncf-io\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483172 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-run-netns\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483186 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-hostroot\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483236 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-cnibin\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.483376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483274 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-conf-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-etc-kubernetes\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483568 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.483994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c7c22ba-252a-40df-9d10-8c53ed13f327-cni-binary-copy\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484009 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c7c22ba-252a-40df-9d10-8c53ed13f327-multus-daemon-config\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-system-cni-dir\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-system-cni-dir\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484095 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-os-release\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.484290 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484137 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-kubelet\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484710 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484327 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c7c22ba-252a-40df-9d10-8c53ed13f327-host-var-lib-cni-bin\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.484710 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484492 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.484710 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.484571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.492537 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.492513 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:18.492537 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.492541 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:18.492728 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.492556 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:18.492728 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.492612 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:18.992595855 +0000 UTC m=+3.138626068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:18.495378 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.495356 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq6pp\" (UniqueName: \"kubernetes.io/projected/1c7c22ba-252a-40df-9d10-8c53ed13f327-kube-api-access-cq6pp\") pod \"multus-nzp2d\" (UID: \"1c7c22ba-252a-40df-9d10-8c53ed13f327\") " pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.495853 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.495832 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdx45\" (UniqueName: \"kubernetes.io/projected/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-kube-api-access-zdx45\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.496224 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.496202 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xhsb\" (UniqueName: \"kubernetes.io/projected/bfa9e9f3-4951-41e6-a3d6-d2d10787ab97-kube-api-access-5xhsb\") pod \"multus-additional-cni-plugins-vmh88\" (UID: \"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97\") " pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.566053 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.566011 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ph26j" Jul 28 20:47:18.574137 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.574109 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:18.586118 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.586086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kw942" Jul 28 20:47:18.591880 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.591859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:18.600708 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.600685 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" Jul 28 20:47:18.609533 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.609511 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6n4w5" Jul 28 20:47:18.617121 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.617072 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ltssv" Jul 28 20:47:18.626721 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.626700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmh88" Jul 28 20:47:18.632919 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.632898 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzp2d" Jul 28 20:47:18.884972 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.884874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:18.885129 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.885061 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:18.885187 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.885144 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:19.885122452 +0000 UTC m=+4.031152675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:18.985921 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:18.985884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:18.986109 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.986048 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:18.986155 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:18.986123 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:19.986107914 +0000 UTC m=+4.132138114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:19.086563 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:19.086520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:19.086730 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.086656 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:19.086730 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.086683 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:19.086730 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.086698 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:19.086903 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.086759 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:20.086738178 +0000 UTC m=+4.232768381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:19.313405 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:19.313321 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:42:18 +0000 UTC" deadline="2028-01-27 00:03:25.509550407 +0000 UTC" Jul 28 20:47:19.313405 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:19.313357 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13131h16m6.196196383s" Jul 28 20:47:19.462632 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.462600 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a0986e_5828_4fb4_940b_99949f5f0416.slice/crio-f5ce85ced467c35f3a9f4a200885161047b9968760f6a395f0fa2d921983ff1d WatchSource:0}: Error finding container f5ce85ced467c35f3a9f4a200885161047b9968760f6a395f0fa2d921983ff1d: Status 404 returned error can't find the container with id f5ce85ced467c35f3a9f4a200885161047b9968760f6a395f0fa2d921983ff1d Jul 28 20:47:19.463417 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.463330 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc1c089_2ca9_4754_b1c4_bac63ab3145e.slice/crio-3f37bb5ee15a6e6f9bd88ddb1dfce11c270ed37476abd652777af08cd51f75ba WatchSource:0}: Error finding container 3f37bb5ee15a6e6f9bd88ddb1dfce11c270ed37476abd652777af08cd51f75ba: Status 404 returned error can't find the container with id 3f37bb5ee15a6e6f9bd88ddb1dfce11c270ed37476abd652777af08cd51f75ba Jul 28 20:47:19.465789 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.465765 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedf6297_a6a5_4015_ab30_f37a8a4b17d2.slice/crio-faf3de64d8124638eed040e74aace5870aad716310eade99a5adebbf8176c37e WatchSource:0}: Error finding container faf3de64d8124638eed040e74aace5870aad716310eade99a5adebbf8176c37e: Status 404 returned error can't find the container with id faf3de64d8124638eed040e74aace5870aad716310eade99a5adebbf8176c37e Jul 28 20:47:19.487983 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.487945 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa9e9f3_4951_41e6_a3d6_d2d10787ab97.slice/crio-85c8e0192bf9985df083fa1ca406e16040212abadf3f1fddf962bc83eef14d71 WatchSource:0}: Error finding container 85c8e0192bf9985df083fa1ca406e16040212abadf3f1fddf962bc83eef14d71: Status 404 returned error can't find the container with id 85c8e0192bf9985df083fa1ca406e16040212abadf3f1fddf962bc83eef14d71 Jul 28 20:47:19.488813 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.488792 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7c22ba_252a_40df_9d10_8c53ed13f327.slice/crio-591aaafdfe2dc1ed6e3b966bb36acd5dbd3cb72503a0118b821f53471eefea94 WatchSource:0}: Error finding container 591aaafdfe2dc1ed6e3b966bb36acd5dbd3cb72503a0118b821f53471eefea94: Status 404 returned error can't find the container with id 591aaafdfe2dc1ed6e3b966bb36acd5dbd3cb72503a0118b821f53471eefea94 Jul 28 20:47:19.489831 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.489804 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5b9c53_c6e9_4668_863a_9b8887e3262f.slice/crio-2509c1362ff215f8f6b819f63f2dbd6181bd5a7479cbded317dbee4a0d56095f WatchSource:0}: Error finding container 2509c1362ff215f8f6b819f63f2dbd6181bd5a7479cbded317dbee4a0d56095f: Status 404 returned error can't find the container with id 2509c1362ff215f8f6b819f63f2dbd6181bd5a7479cbded317dbee4a0d56095f Jul 28 20:47:19.491338 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.491242 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b803eb_bef5_4f43_95ff_be78542a558b.slice/crio-97e4ced663cbbe81027c5499ad2957e2dbd924310e081b266a505e010eaedcb5 WatchSource:0}: Error finding container 97e4ced663cbbe81027c5499ad2957e2dbd924310e081b266a505e010eaedcb5: Status 404 returned error can't find the container with id 97e4ced663cbbe81027c5499ad2957e2dbd924310e081b266a505e010eaedcb5 Jul 28 20:47:19.492595 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:19.492087 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9e9030_a744_42c2_b403_31f36b966e7a.slice/crio-140a60f8c4094477d19288efde259564dd19d8d000c5909a5e0d48494e3cd4df WatchSource:0}: Error finding container 140a60f8c4094477d19288efde259564dd19d8d000c5909a5e0d48494e3cd4df: Status 404 returned error can't find the container with id 140a60f8c4094477d19288efde259564dd19d8d000c5909a5e0d48494e3cd4df Jul 28 20:47:19.891870 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:19.891532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:19.891870 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.891675 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:19.892125 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.891881 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:21.891858132 +0000 UTC m=+6.037888338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:19.992436 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:19.992393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:19.992632 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.992594 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:19.992694 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:19.992663 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:21.992641881 +0000 UTC m=+6.138672093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:20.092883 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.092843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:20.093080 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.093037 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:20.093080 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.093057 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:20.093080 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.093070 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:20.093245 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.093131 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:22.093113616 +0000 UTC m=+6.239143836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:20.314153 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.314030 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:42:18 +0000 UTC" deadline="2027-12-28 09:03:57.033409505 +0000 UTC" Jul 28 20:47:20.314153 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.314095 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12420h16m36.719318967s" Jul 28 20:47:20.371597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.371563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:20.371784 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.371603 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:20.371784 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.371552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:20.371784 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.371690 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:20.371941 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.371801 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:20.371941 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:20.371913 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:20.404679 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.404635 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6n4w5" event={"ID":"eedf6297-a6a5-4015-ab30-f37a8a4b17d2","Type":"ContainerStarted","Data":"faf3de64d8124638eed040e74aace5870aad716310eade99a5adebbf8176c37e"} Jul 28 20:47:20.414904 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.414816 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kw942" event={"ID":"4bc1c089-2ca9-4754-b1c4-bac63ab3145e","Type":"ContainerStarted","Data":"3f37bb5ee15a6e6f9bd88ddb1dfce11c270ed37476abd652777af08cd51f75ba"} Jul 28 20:47:20.418344 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.418254 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ph26j" event={"ID":"14a0986e-5828-4fb4-940b-99949f5f0416","Type":"ContainerStarted","Data":"f5ce85ced467c35f3a9f4a200885161047b9968760f6a395f0fa2d921983ff1d"} Jul 28 20:47:20.437986 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.437934 2568 generic.go:356] "Generic (PLEG): container finished" podID="34767be75f7bfcb613a9de6d7fedac1d" containerID="06d63dee7bd77b167cf9ea612c33f846c1e1f2c69e176bf484e27615c0f0902a" exitCode=0 Jul 28 20:47:20.438415 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.438348 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"34767be75f7bfcb613a9de6d7fedac1d","Type":"ContainerDied","Data":"06d63dee7bd77b167cf9ea612c33f846c1e1f2c69e176bf484e27615c0f0902a"} Jul 28 20:47:20.455621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.455586 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" event={"ID":"de661c76ba7bc5e0e4094110dc9768c0","Type":"ContainerStarted","Data":"78abc4aed5dc09d90567ff60c144e66177b521ccd1eaad6afe5dd1ccc4e8d188"} Jul 28 20:47:20.471655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.469489 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ltssv" event={"ID":"15b803eb-bef5-4f43-95ff-be78542a558b","Type":"ContainerStarted","Data":"97e4ced663cbbe81027c5499ad2957e2dbd924310e081b266a505e010eaedcb5"} Jul 28 20:47:20.481720 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.481689 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerStarted","Data":"85c8e0192bf9985df083fa1ca406e16040212abadf3f1fddf962bc83eef14d71"} Jul 28 20:47:20.494268 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.494133 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" event={"ID":"000091c6-9bbc-4e25-b338-bef4dc6c6111","Type":"ContainerStarted","Data":"206024b400a12ac6e5014b99cbe094e2db2d223f2b68eb3e629bf97e10cd4863"} Jul 28 20:47:20.520032 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.519986 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"140a60f8c4094477d19288efde259564dd19d8d000c5909a5e0d48494e3cd4df"} Jul 28 20:47:20.533244 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.533208 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk6jt" event={"ID":"9c5b9c53-c6e9-4668-863a-9b8887e3262f","Type":"ContainerStarted","Data":"2509c1362ff215f8f6b819f63f2dbd6181bd5a7479cbded317dbee4a0d56095f"} Jul 28 20:47:20.555856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:20.555767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzp2d" event={"ID":"1c7c22ba-252a-40df-9d10-8c53ed13f327","Type":"ContainerStarted","Data":"591aaafdfe2dc1ed6e3b966bb36acd5dbd3cb72503a0118b821f53471eefea94"} Jul 28 20:47:21.564610 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:21.564548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"34767be75f7bfcb613a9de6d7fedac1d","Type":"ContainerStarted","Data":"bdd59dc5ffc45b01e60abfc19f6dab5621c11016f323749d01003e7edc086f4b"} Jul 28 20:47:21.581780 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:21.581191 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" podStartSLOduration=4.581169611 podStartE2EDuration="4.581169611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:20.480210793 +0000 UTC m=+4.626241046" watchObservedRunningTime="2026-07-28 20:47:21.581169611 +0000 UTC m=+5.727199834" Jul 28 20:47:21.581780 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:21.581429 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" podStartSLOduration=4.581416338 podStartE2EDuration="4.581416338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:21.580547831 +0000 UTC m=+5.726578053" watchObservedRunningTime="2026-07-28 20:47:21.581416338 +0000 UTC m=+5.727446561" Jul 28 20:47:21.907014 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:21.906863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:21.907180 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:21.907091 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:21.907180 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:21.907154 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:25.90713655 +0000 UTC m=+10.053166762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:22.007458 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:22.007421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:22.007648 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.007584 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:22.007714 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.007652 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:26.007632575 +0000 UTC m=+10.153662790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:22.108780 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:22.108745 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:22.108988 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.108919 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:22.108988 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.108944 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:22.108988 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.108973 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:22.109394 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.109371 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:26.109347831 +0000 UTC m=+10.255378044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:22.370636 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:22.370513 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:22.370636 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:22.370521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:22.370843 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.370639 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:22.370843 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:22.370680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:22.370843 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.370797 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:22.370996 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:22.370975 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:24.371079 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:24.371045 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:24.371510 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:24.371173 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:24.371588 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:24.371552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:24.371658 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:24.371634 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:24.373515 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:24.373371 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:24.373515 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:24.373475 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:25.939710 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:25.939032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:25.939710 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:25.939236 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:25.939710 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:25.939314 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:33.939294509 +0000 UTC m=+18.085324710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:26.040348 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:26.039776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:26.040348 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.039921 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:26.040348 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.039998 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:34.039979122 +0000 UTC m=+18.186009338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:26.140903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:26.140862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:26.141103 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.141047 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:26.141103 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.141066 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:26.141103 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.141078 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:26.141266 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.141134 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:34.141116258 +0000 UTC m=+18.287146467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:26.371697 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:26.371389 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:26.371697 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.371512 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:26.371697 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:26.371537 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:26.371697 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.371610 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:26.371697 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:26.371644 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:26.372052 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:26.371804 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:28.370610 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:28.370201 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:28.370610 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:28.370352 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:28.370610 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:28.370432 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:28.370610 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:28.370532 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:28.370610 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:28.370201 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:28.370610 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:28.370615 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:30.369669 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:30.369587 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:30.369669 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:30.369623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:30.370196 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:30.369587 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:30.370196 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:30.369728 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:30.370196 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:30.369801 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:30.370196 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:30.369872 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:32.370594 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:32.370554 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:32.371081 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:32.370554 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:32.371081 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:32.370701 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:32.371081 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:32.370769 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:32.371081 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:32.370559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:32.371081 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:32.370904 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:34.002322 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:34.002283 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:34.002715 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.002395 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:34.002715 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.002447 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:50.002433855 +0000 UTC m=+34.148464056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:34.102898 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:34.102856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:34.103062 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.103030 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:34.103129 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.103114 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:50.103091694 +0000 UTC m=+34.249121913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:34.204271 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:34.204227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:34.204455 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.204357 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:34.204455 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.204382 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:34.204455 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.204396 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:34.204610 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.204463 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:50.204444965 +0000 UTC m=+34.350475181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:34.370365 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:34.370289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:34.370515 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:34.370289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:34.370515 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.370405 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:34.370515 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.370487 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:34.370515 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:34.370296 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:34.370753 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:34.370631 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:36.372623 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:36.372591 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:36.372623 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:36.372609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:36.373094 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:36.372609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:36.373094 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:36.372709 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:36.373094 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:36.372761 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:36.373094 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:36.372834 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:38.370881 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.370465 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:38.370881 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:38.370586 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:38.371353 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.370935 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:38.371353 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:38.371058 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:38.371353 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.371115 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:38.371353 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:38.371194 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:38.599556 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.599186 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"fde6f04bbaf216780ee3d8ba67a9ff7711b93950bfd5bfab7fce0da4da2b2956"} Jul 28 20:47:38.599685 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.599636 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"e04b30549e5d2256ab319bc0ba52310423cb00da22d083fbd7072459d6aebf6c"} Jul 28 20:47:38.600502 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.600475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk6jt" event={"ID":"9c5b9c53-c6e9-4668-863a-9b8887e3262f","Type":"ContainerStarted","Data":"3d30dad0ab7cd05afd9238c0f391147f766773dd0787b70b159a446938c326eb"} Jul 28 20:47:38.601975 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.601928 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzp2d" event={"ID":"1c7c22ba-252a-40df-9d10-8c53ed13f327","Type":"ContainerStarted","Data":"e3ca1dce811aacb9b61af56df87d4cac1227403c2879dc3f0fd034e9752c5aaa"} Jul 28 20:47:38.603328 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.603306 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6n4w5" event={"ID":"eedf6297-a6a5-4015-ab30-f37a8a4b17d2","Type":"ContainerStarted","Data":"60e36a986135ebcad3d7b4e4343f0049e47b140e57d9a7eacd67eb272ceb47c6"} Jul 28 20:47:38.604909 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.604886 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ph26j" event={"ID":"14a0986e-5828-4fb4-940b-99949f5f0416","Type":"ContainerStarted","Data":"9dced882ae6eeea6aec9c8837b680398e7f1e55ff36c087d1cd411363c7cb1a4"} Jul 28 20:47:38.606379 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.606357 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ltssv" event={"ID":"15b803eb-bef5-4f43-95ff-be78542a558b","Type":"ContainerStarted","Data":"e1eb47c5834e9ccbb7d0051052b4036dd5a8c17ee8e869c2685e2e7c65ece630"} Jul 28 20:47:38.607833 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.607811 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfa9e9f3-4951-41e6-a3d6-d2d10787ab97" containerID="9bf7fe9bc1616aa6b805568d96e133eb0687101b3d7c1ad394f41435dbb490b9" exitCode=0 Jul 28 20:47:38.607924 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.607891 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerDied","Data":"9bf7fe9bc1616aa6b805568d96e133eb0687101b3d7c1ad394f41435dbb490b9"} Jul 28 20:47:38.609464 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.609395 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" event={"ID":"000091c6-9bbc-4e25-b338-bef4dc6c6111","Type":"ContainerStarted","Data":"afb2e0dbb7a8e05aa1c03df634dfce1c3f8a8f57718e48b3e3ad03e9643b7322"} Jul 28 20:47:38.619282 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.619233 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pk6jt" podStartSLOduration=11.955340771 podStartE2EDuration="22.61921931s" totalImagesPullingTime="10.663878539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:38.619166212 +0000 UTC m=+22.765196447" watchObservedRunningTime="2026-07-28 20:47:38.61921931 +0000 UTC m=+22.765249531" Jul 28 20:47:38.641344 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.641290 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ph26j" podStartSLOduration=3.832112111 podStartE2EDuration="22.64127684s" totalImagesPullingTime="18.809164729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:38.641159063 +0000 UTC m=+22.787189285" watchObservedRunningTime="2026-07-28 20:47:38.64127684 +0000 UTC m=+22.787307115" Jul 28 20:47:38.657509 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.657465 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6n4w5" podStartSLOduration=3.869362248 podStartE2EDuration="22.657448754s" totalImagesPullingTime="18.788086506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:38.65709217 +0000 UTC m=+22.803122391" watchObservedRunningTime="2026-07-28 20:47:38.657448754 +0000 UTC m=+22.803478975" Jul 28 20:47:38.728642 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.728601 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ltssv" podStartSLOduration=3.951703958 podStartE2EDuration="22.728582181s" totalImagesPullingTime="18.776878223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:38.677869077 +0000 UTC m=+22.823899298" watchObservedRunningTime="2026-07-28 20:47:38.728582181 +0000 UTC m=+22.874612403" Jul 28 20:47:38.754129 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:38.754074 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nzp2d" podStartSLOduration=3.903311888 podStartE2EDuration="22.754058461s" totalImagesPullingTime="18.850746573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:38.753694539 +0000 UTC m=+22.899724898" watchObservedRunningTime="2026-07-28 20:47:38.754058461 +0000 UTC m=+22.900088683" Jul 28 20:47:39.046554 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.046520 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:39.047184 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.047167 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:39.615096 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.615061 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"3dd08787e40ebe0df3034c97ffdfd15ba2a395d53b2852b9ba64ba615f4b3242"} Jul 28 20:47:39.615913 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.615195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"815331444be7c959073ff82cc4569acb4b4a09673f0a9b3b8e10207209ba8320"} Jul 28 20:47:39.615913 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.615255 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"8ff66437ef8ca19e1c5f7b504ffac4a8bacdd4a390a3567945b30c85494b7767"} Jul 28 20:47:39.615913 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.615302 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"c492ec1056d2c6ea3c3ca0b42f15b1486f51c5cdfa0e060be4f2bbb92b24e965"} Jul 28 20:47:39.617624 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.617593 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:39.617926 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.617897 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pk6jt" Jul 28 20:47:39.761074 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:39.761031 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 20:47:40.370487 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.370452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:40.370789 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.370452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:40.370789 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:40.370593 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:40.370789 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.370625 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:40.370789 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:40.370727 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:40.371050 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:40.370803 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:40.382800 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.382685 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T20:47:39.761053941Z","UUID":"440598c4-17e3-4996-ad55-25807a773ff4","Handler":null,"Name":"","Endpoint":""} Jul 28 20:47:40.384562 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.384520 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 20:47:40.384562 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.384565 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 20:47:40.621751 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.621661 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kw942" event={"ID":"4bc1c089-2ca9-4754-b1c4-bac63ab3145e","Type":"ContainerStarted","Data":"43a63514dd07ba9deb62686a22ee50ba24d8219aba5b55a7d37af89c414c633f"} Jul 28 20:47:40.624202 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.624174 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" event={"ID":"000091c6-9bbc-4e25-b338-bef4dc6c6111","Type":"ContainerStarted","Data":"f1330dbe793ffb07d9ee47465da0294b6513dc34d2c168574b17d874b8ae1ab3"} Jul 28 20:47:40.640457 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:40.640397 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kw942" podStartSLOduration=5.854109198 podStartE2EDuration="24.640376409s" totalImagesPullingTime="18.786267211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:40.640208448 +0000 UTC m=+24.786238673" watchObservedRunningTime="2026-07-28 20:47:40.640376409 +0000 UTC m=+24.786406632" Jul 28 20:47:41.628735 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:41.628697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" event={"ID":"000091c6-9bbc-4e25-b338-bef4dc6c6111","Type":"ContainerStarted","Data":"f05d621a200b45e5080ca433ee0cb227439f8e332844342d8063ebb2abd90f94"} Jul 28 20:47:41.632301 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:41.632271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"4513f857d9495feecc8c058da67fe1cac35928658a5828a4f0f3caf2a9183656"} Jul 28 20:47:41.653756 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:41.653695 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk2bd" podStartSLOduration=4.61936515 podStartE2EDuration="25.653677316s" totalImagesPullingTime="21.034312166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:41.653114911 +0000 UTC m=+25.799145157" watchObservedRunningTime="2026-07-28 20:47:41.653677316 +0000 UTC m=+25.799707537" Jul 28 20:47:42.370738 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:42.370517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:42.370960 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:42.370517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:42.370960 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:42.370831 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:42.370960 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:42.370888 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:42.370960 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:42.370563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:42.371149 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:42.371045 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:43.638480 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.638217 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfa9e9f3-4951-41e6-a3d6-d2d10787ab97" containerID="979991897ead672b305a63c6bb9e117c372a58cb8359d79dc1eeebfeae9272ea" exitCode=0 Jul 28 20:47:43.639320 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.638277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerDied","Data":"979991897ead672b305a63c6bb9e117c372a58cb8359d79dc1eeebfeae9272ea"} Jul 28 20:47:43.642279 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.642236 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" event={"ID":"8b9e9030-a744-42c2-b403-31f36b966e7a","Type":"ContainerStarted","Data":"1f52da4f246a6faaf763a5c449750560ec14ac9efe7b8396fae72c5b2ec7474e"} Jul 28 20:47:43.642532 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.642509 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:43.642625 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.642579 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:43.642693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.642628 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:43.658221 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.658196 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:43.658383 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.658363 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:47:43.713098 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:43.713051 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" podStartSLOduration=8.875089221 podStartE2EDuration="27.713035917s" totalImagesPullingTime="18.837946696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:43.713020359 +0000 UTC m=+27.859050580" watchObservedRunningTime="2026-07-28 20:47:43.713035917 +0000 UTC m=+27.859066139" Jul 28 20:47:44.369830 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:44.369795 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:44.370070 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:44.369851 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:44.370070 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:44.369795 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:44.370070 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:44.369964 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:44.370070 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:44.370042 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:44.370279 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:44.370131 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:45.435722 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.435688 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jqcjf"] Jul 28 20:47:45.436234 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.435791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:45.436234 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:45.435875 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:45.438677 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.438653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knwvn"] Jul 28 20:47:45.438811 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.438762 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:45.438872 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:45.438853 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:45.442027 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.442004 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4dfs"] Jul 28 20:47:45.442132 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.442088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:45.442202 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:45.442176 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:45.648653 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.648615 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfa9e9f3-4951-41e6-a3d6-d2d10787ab97" containerID="8a9157d1077a7d8a3677ba3fd947df71665473f9d4ec7b1b236e482569e68b8c" exitCode=0 Jul 28 20:47:45.648845 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:45.648699 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerDied","Data":"8a9157d1077a7d8a3677ba3fd947df71665473f9d4ec7b1b236e482569e68b8c"} Jul 28 20:47:47.370480 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:47.370290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:47.370863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:47.370290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:47.370863 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:47.370559 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:47.370863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:47.370290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:47.370863 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:47.370627 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:47.370863 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:47.370706 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:47.655459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:47.655416 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfa9e9f3-4951-41e6-a3d6-d2d10787ab97" containerID="b470c7c7222ac5a789c7a8189cb6b75c0b2487da9fd7ed6ec931cf8b72b719bd" exitCode=0 Jul 28 20:47:47.655604 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:47.655478 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerDied","Data":"b470c7c7222ac5a789c7a8189cb6b75c0b2487da9fd7ed6ec931cf8b72b719bd"} Jul 28 20:47:49.369796 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:49.369766 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:49.370504 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:49.369766 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:49.370504 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:49.369893 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:49.370504 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:49.369766 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:49.370504 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:49.369963 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:49.370504 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:49.370092 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:50.017197 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:50.017156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:50.017384 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.017326 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:50.017452 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.017404 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret podName:c5971d7f-c363-407b-8f3a-09619a3219e1 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:22.017384302 +0000 UTC m=+66.163414503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret") pod "global-pull-secret-syncer-jqcjf" (UID: "c5971d7f-c363-407b-8f3a-09619a3219e1") : object "kube-system"/"original-pull-secret" not registered Jul 28 20:47:50.117853 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:50.117821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:50.118061 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.118001 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:50.118129 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.118075 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:22.118054437 +0000 UTC m=+66.264084651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 20:47:50.218463 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:50.218373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:50.218592 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.218566 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 20:47:50.218592 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.218588 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 20:47:50.218692 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.218597 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f5d46 for pod openshift-network-diagnostics/network-check-target-z4dfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:50.218692 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:50.218660 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46 podName:d9946582-d16b-422b-91a5-67c0961aef07 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:22.218641636 +0000 UTC m=+66.364671841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5d46" (UniqueName: "kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46") pod "network-check-target-z4dfs" (UID: "d9946582-d16b-422b-91a5-67c0961aef07") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 20:47:51.370398 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:51.370358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:51.371006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:51.370358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:51.371006 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:51.370470 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4dfs" podUID="d9946582-d16b-422b-91a5-67c0961aef07" Jul 28 20:47:51.371006 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:51.370579 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knwvn" podUID="5e3b510d-1dde-47f4-9510-2cf8c0b6e619" Jul 28 20:47:51.371006 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:51.370359 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:51.371006 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:51.370661 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqcjf" podUID="c5971d7f-c363-407b-8f3a-09619a3219e1" Jul 28 20:47:52.215119 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.215099 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeReady" Jul 28 20:47:52.215235 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.215225 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 20:47:52.259488 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.259458 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65655f5f66-nkj6w"] Jul 28 20:47:52.291258 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.291233 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65655f5f66-nkj6w"] Jul 28 20:47:52.291258 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.291264 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tvgbf"] Jul 28 20:47:52.291449 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.291364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.294543 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.294522 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 20:47:52.294666 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.294562 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-52n7n\"" Jul 28 20:47:52.294820 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.294804 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 20:47:52.294935 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.294918 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 20:47:52.300936 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.300914 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 20:47:52.305208 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.305181 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gzxjl"] Jul 28 20:47:52.305386 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.305368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.307964 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.307932 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ghnpw\"" Jul 28 20:47:52.308058 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.307964 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 20:47:52.308058 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.307933 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 20:47:52.320267 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.320244 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzxjl"] Jul 28 20:47:52.320348 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.320284 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvgbf"] Jul 28 20:47:52.320348 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.320335 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.322768 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.322751 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 20:47:52.322896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.322752 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 20:47:52.322896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.322818 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 20:47:52.322896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.322837 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m4gqb\"" Jul 28 20:47:52.433559 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-installation-pull-secrets\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-certificates\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvnn\" (UniqueName: \"kubernetes.io/projected/58409041-4cb3-4f20-8e8d-5ae8142435a0-kube-api-access-6gvnn\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12372d67-ea1e-4e88-8e3a-594da50417ea-ca-trust-extracted\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrl5\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-kube-api-access-csrl5\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-image-registry-private-configuration\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-bound-sa-token\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/872957ee-58fc-4ff7-b7b0-24e61a2b4419-cert\") pod \"ingress-canary-gzxjl\" (UID: \"872957ee-58fc-4ff7-b7b0-24e61a2b4419\") " pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-trusted-ca\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.433904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58409041-4cb3-4f20-8e8d-5ae8142435a0-tmp-dir\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.434003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58409041-4cb3-4f20-8e8d-5ae8142435a0-config-volume\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.434138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.434028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wml8\" (UniqueName: \"kubernetes.io/projected/872957ee-58fc-4ff7-b7b0-24e61a2b4419-kube-api-access-9wml8\") pod \"ingress-canary-gzxjl\" (UID: \"872957ee-58fc-4ff7-b7b0-24e61a2b4419\") " pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.535450 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535367 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.535450 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.535450 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-trusted-ca\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:52.535528 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:52.535540 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58409041-4cb3-4f20-8e8d-5ae8142435a0-tmp-dir\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:52.535549 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:52.535610 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:53.035588835 +0000 UTC m=+37.181619053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:52.535634 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:47:53.03562318 +0000 UTC m=+37.181653394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:47:52.535689 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58409041-4cb3-4f20-8e8d-5ae8142435a0-config-volume\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wml8\" (UniqueName: \"kubernetes.io/projected/872957ee-58fc-4ff7-b7b0-24e61a2b4419-kube-api-access-9wml8\") pod \"ingress-canary-gzxjl\" (UID: \"872957ee-58fc-4ff7-b7b0-24e61a2b4419\") " pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-installation-pull-secrets\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-certificates\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvnn\" (UniqueName: \"kubernetes.io/projected/58409041-4cb3-4f20-8e8d-5ae8142435a0-kube-api-access-6gvnn\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12372d67-ea1e-4e88-8e3a-594da50417ea-ca-trust-extracted\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535832 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrl5\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-kube-api-access-csrl5\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-image-registry-private-configuration\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-bound-sa-token\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58409041-4cb3-4f20-8e8d-5ae8142435a0-tmp-dir\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.536063 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.535909 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/872957ee-58fc-4ff7-b7b0-24e61a2b4419-cert\") pod \"ingress-canary-gzxjl\" (UID: \"872957ee-58fc-4ff7-b7b0-24e61a2b4419\") " pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.536537 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.536506 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-trusted-ca\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536591 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.536553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-certificates\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.536806 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.536787 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12372d67-ea1e-4e88-8e3a-594da50417ea-ca-trust-extracted\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.537029 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.537000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58409041-4cb3-4f20-8e8d-5ae8142435a0-config-volume\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.539945 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.539925 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-image-registry-private-configuration\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.540051 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.539933 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/872957ee-58fc-4ff7-b7b0-24e61a2b4419-cert\") pod \"ingress-canary-gzxjl\" (UID: \"872957ee-58fc-4ff7-b7b0-24e61a2b4419\") " pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.540051 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.539986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-installation-pull-secrets\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.549017 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.548993 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrl5\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-kube-api-access-csrl5\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.549138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.549090 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wml8\" (UniqueName: \"kubernetes.io/projected/872957ee-58fc-4ff7-b7b0-24e61a2b4419-kube-api-access-9wml8\") pod \"ingress-canary-gzxjl\" (UID: \"872957ee-58fc-4ff7-b7b0-24e61a2b4419\") " pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.549138 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.549123 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-bound-sa-token\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:52.549210 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.549164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvnn\" (UniqueName: \"kubernetes.io/projected/58409041-4cb3-4f20-8e8d-5ae8142435a0-kube-api-access-6gvnn\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:52.631419 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.631366 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzxjl" Jul 28 20:47:52.671790 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.671604 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfa9e9f3-4951-41e6-a3d6-d2d10787ab97" containerID="cda933b7d0f3af31f72af0c4622c035be91588edd0591f927b3d44a34ee7bec3" exitCode=0 Jul 28 20:47:52.671991 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.671698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerDied","Data":"cda933b7d0f3af31f72af0c4622c035be91588edd0591f927b3d44a34ee7bec3"} Jul 28 20:47:52.773543 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:52.773514 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzxjl"] Jul 28 20:47:52.778478 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:47:52.778455 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872957ee_58fc_4ff7_b7b0_24e61a2b4419.slice/crio-ef23bef3ca3794f4553b32ce2214b6e5e8ad25119d3e61c65acfb2d270405a64 WatchSource:0}: Error finding container ef23bef3ca3794f4553b32ce2214b6e5e8ad25119d3e61c65acfb2d270405a64: Status 404 returned error can't find the container with id ef23bef3ca3794f4553b32ce2214b6e5e8ad25119d3e61c65acfb2d270405a64 Jul 28 20:47:53.040604 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.040497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:53.040604 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.040545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:53.040826 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:53.040649 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:47:53.040826 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:53.040664 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:47:53.040826 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:53.040671 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:47:53.040826 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:53.040730 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:54.040710974 +0000 UTC m=+38.186741180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:47:53.040826 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:53.040751 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:47:54.040741253 +0000 UTC m=+38.186771452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:47:53.370038 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.369937 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:47:53.370038 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.369982 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:47:53.370038 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.369996 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:47:53.374185 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.374156 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 20:47:53.374360 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.374164 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j52pw\"" Jul 28 20:47:53.374360 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.374273 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 20:47:53.374360 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.374165 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 20:47:53.374558 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.374392 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 20:47:53.374558 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.374450 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvjsj\"" Jul 28 20:47:53.678233 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.678200 2568 generic.go:356] "Generic (PLEG): container finished" podID="bfa9e9f3-4951-41e6-a3d6-d2d10787ab97" containerID="36c79ca5effeef34bffb93edba7ec9ff338f7027d833896ce9aa911069ba6ec3" exitCode=0 Jul 28 20:47:53.678686 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.678276 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerDied","Data":"36c79ca5effeef34bffb93edba7ec9ff338f7027d833896ce9aa911069ba6ec3"} Jul 28 20:47:53.679508 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:53.679487 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzxjl" event={"ID":"872957ee-58fc-4ff7-b7b0-24e61a2b4419","Type":"ContainerStarted","Data":"ef23bef3ca3794f4553b32ce2214b6e5e8ad25119d3e61c65acfb2d270405a64"} Jul 28 20:47:54.049819 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:54.049536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:54.049819 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:54.049796 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:54.050063 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:54.049722 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:47:54.050063 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:54.049874 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:47:54.050063 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:54.049934 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:47:54.050063 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:54.049999 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:47:56.049974247 +0000 UTC m=+40.196004458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:47:54.050063 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:54.050020 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:47:56.050010441 +0000 UTC m=+40.196040647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:47:54.685979 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:54.685923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmh88" event={"ID":"bfa9e9f3-4951-41e6-a3d6-d2d10787ab97","Type":"ContainerStarted","Data":"6f7268b06c7de8655d24653900b0b941242255590197654f5a61c0829dab3e6a"} Jul 28 20:47:55.690029 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:55.689988 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzxjl" event={"ID":"872957ee-58fc-4ff7-b7b0-24e61a2b4419","Type":"ContainerStarted","Data":"33b6d5bc259ed77023a68c49f0ab7d12189b815c5b333b4f88d0e5b54af290e1"} Jul 28 20:47:55.710419 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:55.710371 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmh88" podStartSLOduration=9.720598501 podStartE2EDuration="39.710355346s" totalImagesPullingTime="29.989756845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:54.715796104 +0000 UTC m=+38.861826327" watchObservedRunningTime="2026-07-28 20:47:55.710355346 +0000 UTC m=+39.856385567" Jul 28 20:47:55.710554 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:55.710474 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gzxjl" podStartSLOduration=1.511865803 podStartE2EDuration="3.710470718s" totalImagesPullingTime="2.198604915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:55.708872638 +0000 UTC m=+39.854902879" watchObservedRunningTime="2026-07-28 20:47:55.710470718 +0000 UTC m=+39.856500939" Jul 28 20:47:56.064490 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:56.064376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:47:56.064490 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:47:56.064431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:47:56.064687 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:56.064530 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:47:56.064687 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:56.064539 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:47:56.064687 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:56.064561 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:47:56.064687 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:56.064584 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:00.064569931 +0000 UTC m=+44.210600134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:47:56.064687 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:47:56.064608 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:48:00.064594595 +0000 UTC m=+44.210624795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:48:00.093841 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:00.093802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:00.093841 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:00.093843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:48:00.094302 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:00.093989 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:48:00.094302 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:00.093992 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:48:00.094302 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:00.094016 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:48:00.094302 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:00.094044 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:08.094028554 +0000 UTC m=+52.240058758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:48:00.094302 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:00.094073 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:48:08.094058079 +0000 UTC m=+52.240088278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:48:08.146496 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:08.146450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:08.146496 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:08.146494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:48:08.147133 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:08.146610 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:48:08.147133 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:08.146618 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:48:08.147133 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:08.146641 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:48:08.147133 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:08.146667 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:24.146651345 +0000 UTC m=+68.292681549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:48:08.147133 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:08.146697 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:48:24.14668236 +0000 UTC m=+68.292712564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:48:15.659106 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:15.659075 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mvjnh" Jul 28 20:48:20.933187 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.932792 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d"] Jul 28 20:48:20.938780 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.938759 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-djc6f"] Jul 28 20:48:20.938904 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.938873 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:20.941704 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.941679 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pwxg8\"" Jul 28 20:48:20.941831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.941716 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 20:48:20.941931 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.941914 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 20:48:20.942136 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.942112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 20:48:20.942245 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.942150 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 20:48:20.942459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.942443 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6"] Jul 28 20:48:20.942849 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.942827 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:20.946483 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.946454 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 20:48:20.946592 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.946518 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 20:48:20.946592 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.946555 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 20:48:20.946701 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.946654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-w52k7\"" Jul 28 20:48:20.946865 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.946844 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 20:48:20.948010 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.947990 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:20.950213 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.950190 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 20:48:20.950521 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.950502 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 20:48:20.950891 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.950872 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d"] Jul 28 20:48:20.951029 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.951009 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 20:48:20.951863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.951273 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bpx8s\"" Jul 28 20:48:20.951863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.951845 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-djc6f"] Jul 28 20:48:20.952032 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.951303 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 20:48:20.952867 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.952844 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 20:48:20.963841 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:20.963817 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6"] Jul 28 20:48:21.041661 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcgm\" (UniqueName: \"kubernetes.io/projected/37918386-fb9c-47d9-8d2a-b28de84c0bab-kube-api-access-nlcgm\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.041661 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37918386-fb9c-47d9-8d2a-b28de84c0bab-config\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.041880 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041706 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37918386-fb9c-47d9-8d2a-b28de84c0bab-trusted-ca\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.041880 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dfdr\" (UniqueName: \"kubernetes.io/projected/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-kube-api-access-7dfdr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.041880 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.041880 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.041880 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-config\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.042086 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.042086 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtpw\" (UniqueName: \"kubernetes.io/projected/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-kube-api-access-2vtpw\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.042086 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.041930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37918386-fb9c-47d9-8d2a-b28de84c0bab-serving-cert\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.143286 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.143286 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-config\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.143489 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.143489 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtpw\" (UniqueName: \"kubernetes.io/projected/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-kube-api-access-2vtpw\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.143586 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143491 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37918386-fb9c-47d9-8d2a-b28de84c0bab-serving-cert\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.143586 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcgm\" (UniqueName: \"kubernetes.io/projected/37918386-fb9c-47d9-8d2a-b28de84c0bab-kube-api-access-nlcgm\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.143679 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37918386-fb9c-47d9-8d2a-b28de84c0bab-config\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.143760 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143741 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37918386-fb9c-47d9-8d2a-b28de84c0bab-trusted-ca\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.143821 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dfdr\" (UniqueName: \"kubernetes.io/projected/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-kube-api-access-7dfdr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.143821 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.143920 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.143876 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-config\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.144059 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.144039 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.144394 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.144369 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37918386-fb9c-47d9-8d2a-b28de84c0bab-config\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.144712 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.144694 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37918386-fb9c-47d9-8d2a-b28de84c0bab-trusted-ca\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.147206 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.147179 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.147297 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.147216 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.147297 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.147250 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37918386-fb9c-47d9-8d2a-b28de84c0bab-serving-cert\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.151928 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.151900 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtpw\" (UniqueName: \"kubernetes.io/projected/6cda6ef2-61d7-4c16-b68b-f91652d1cb92-kube-api-access-2vtpw\") pod \"service-ca-operator-5d6c75f84f-ftr5d\" (UID: \"6cda6ef2-61d7-4c16-b68b-f91652d1cb92\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.152246 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.152225 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dfdr\" (UniqueName: \"kubernetes.io/projected/9e1433ce-7054-4faa-9500-eaf7e4ba6f99-kube-api-access-7dfdr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6\" (UID: \"9e1433ce-7054-4faa-9500-eaf7e4ba6f99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.153317 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.153296 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcgm\" (UniqueName: \"kubernetes.io/projected/37918386-fb9c-47d9-8d2a-b28de84c0bab-kube-api-access-nlcgm\") pod \"console-operator-584dcb6b54-djc6f\" (UID: \"37918386-fb9c-47d9-8d2a-b28de84c0bab\") " pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.255380 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.255293 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" Jul 28 20:48:21.260344 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.260317 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:21.264585 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.264565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" Jul 28 20:48:21.402054 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.402018 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-djc6f"] Jul 28 20:48:21.405656 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:21.405629 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37918386_fb9c_47d9_8d2a_b28de84c0bab.slice/crio-e4d349ad3f8176530de9297c799ab8526c01b80e15460e4bb00b3a1b34010bf0 WatchSource:0}: Error finding container e4d349ad3f8176530de9297c799ab8526c01b80e15460e4bb00b3a1b34010bf0: Status 404 returned error can't find the container with id e4d349ad3f8176530de9297c799ab8526c01b80e15460e4bb00b3a1b34010bf0 Jul 28 20:48:21.623686 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.623613 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6"] Jul 28 20:48:21.626825 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.626797 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d"] Jul 28 20:48:21.627495 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:21.627406 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1433ce_7054_4faa_9500_eaf7e4ba6f99.slice/crio-87ed7c52aaca98b7d93f254fd47f71b9a72ece1268ec5ffb6f55c830755fb610 WatchSource:0}: Error finding container 87ed7c52aaca98b7d93f254fd47f71b9a72ece1268ec5ffb6f55c830755fb610: Status 404 returned error can't find the container with id 87ed7c52aaca98b7d93f254fd47f71b9a72ece1268ec5ffb6f55c830755fb610 Jul 28 20:48:21.629458 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:21.629436 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cda6ef2_61d7_4c16_b68b_f91652d1cb92.slice/crio-a8899a52ef01451d59afa9bd14ba21256aa5e1c1c134c17e8e4a756942f086a7 WatchSource:0}: Error finding container a8899a52ef01451d59afa9bd14ba21256aa5e1c1c134c17e8e4a756942f086a7: Status 404 returned error can't find the container with id a8899a52ef01451d59afa9bd14ba21256aa5e1c1c134c17e8e4a756942f086a7 Jul 28 20:48:21.748963 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.748915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" event={"ID":"37918386-fb9c-47d9-8d2a-b28de84c0bab","Type":"ContainerStarted","Data":"e4d349ad3f8176530de9297c799ab8526c01b80e15460e4bb00b3a1b34010bf0"} Jul 28 20:48:21.749924 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.749902 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" event={"ID":"6cda6ef2-61d7-4c16-b68b-f91652d1cb92","Type":"ContainerStarted","Data":"a8899a52ef01451d59afa9bd14ba21256aa5e1c1c134c17e8e4a756942f086a7"} Jul 28 20:48:21.750896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:21.750879 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" event={"ID":"9e1433ce-7054-4faa-9500-eaf7e4ba6f99","Type":"ContainerStarted","Data":"87ed7c52aaca98b7d93f254fd47f71b9a72ece1268ec5ffb6f55c830755fb610"} Jul 28 20:48:22.049920 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.049873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:48:22.052874 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.052846 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 20:48:22.062887 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.062858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5971d7f-c363-407b-8f3a-09619a3219e1-original-pull-secret\") pod \"global-pull-secret-syncer-jqcjf\" (UID: \"c5971d7f-c363-407b-8f3a-09619a3219e1\") " pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:48:22.150896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.150857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:48:22.154073 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.154045 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 20:48:22.161894 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:22.161763 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 20:48:22.161894 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:22.161846 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs podName:5e3b510d-1dde-47f4-9510-2cf8c0b6e619 nodeName:}" failed. No retries permitted until 2026-07-28 20:49:26.161821345 +0000 UTC m=+130.307851563 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs") pod "network-metrics-daemon-knwvn" (UID: "5e3b510d-1dde-47f4-9510-2cf8c0b6e619") : secret "metrics-daemon-secret" not found Jul 28 20:48:22.181313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.181248 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqcjf" Jul 28 20:48:22.251845 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.251809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:48:22.256335 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.256237 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 20:48:22.266212 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.266184 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 20:48:22.278585 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.278555 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5d46\" (UniqueName: \"kubernetes.io/projected/d9946582-d16b-422b-91a5-67c0961aef07-kube-api-access-f5d46\") pod \"network-check-target-z4dfs\" (UID: \"d9946582-d16b-422b-91a5-67c0961aef07\") " pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:48:22.346303 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.346217 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jqcjf"] Jul 28 20:48:22.351242 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:22.351207 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5971d7f_c363_407b_8f3a_09619a3219e1.slice/crio-ad0284383927d33f5def26fee40c4aaf38b6f67a842aa8e759e99c5746ed3e71 WatchSource:0}: Error finding container ad0284383927d33f5def26fee40c4aaf38b6f67a842aa8e759e99c5746ed3e71: Status 404 returned error can't find the container with id ad0284383927d33f5def26fee40c4aaf38b6f67a842aa8e759e99c5746ed3e71 Jul 28 20:48:22.496827 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.496789 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j52pw\"" Jul 28 20:48:22.505298 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.505263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:48:22.668270 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.668231 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4dfs"] Jul 28 20:48:22.673070 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:22.673031 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9946582_d16b_422b_91a5_67c0961aef07.slice/crio-ef0f9662bca7fc6e4f206aed9e14c38f598d10324b74609f652b214bb0c30f41 WatchSource:0}: Error finding container ef0f9662bca7fc6e4f206aed9e14c38f598d10324b74609f652b214bb0c30f41: Status 404 returned error can't find the container with id ef0f9662bca7fc6e4f206aed9e14c38f598d10324b74609f652b214bb0c30f41 Jul 28 20:48:22.755597 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.755558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jqcjf" event={"ID":"c5971d7f-c363-407b-8f3a-09619a3219e1","Type":"ContainerStarted","Data":"ad0284383927d33f5def26fee40c4aaf38b6f67a842aa8e759e99c5746ed3e71"} Jul 28 20:48:22.757376 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:22.757344 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4dfs" event={"ID":"d9946582-d16b-422b-91a5-67c0961aef07","Type":"ContainerStarted","Data":"ef0f9662bca7fc6e4f206aed9e14c38f598d10324b74609f652b214bb0c30f41"} Jul 28 20:48:24.168421 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:24.168377 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:24.168833 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:24.168434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:48:24.168833 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:24.168549 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 20:48:24.168833 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:24.168573 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65655f5f66-nkj6w: secret "image-registry-tls" not found Jul 28 20:48:24.168833 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:24.168576 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 20:48:24.168833 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:24.168641 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls podName:12372d67-ea1e-4e88-8e3a-594da50417ea nodeName:}" failed. No retries permitted until 2026-07-28 20:48:56.168621091 +0000 UTC m=+100.314651306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls") pod "image-registry-65655f5f66-nkj6w" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea") : secret "image-registry-tls" not found Jul 28 20:48:24.168833 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:24.168718 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls podName:58409041-4cb3-4f20-8e8d-5ae8142435a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:56.168691498 +0000 UTC m=+100.314721711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls") pod "dns-default-tvgbf" (UID: "58409041-4cb3-4f20-8e8d-5ae8142435a0") : secret "dns-default-metrics-tls" not found Jul 28 20:48:25.767474 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.767287 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jjvck"] Jul 28 20:48:25.769588 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.769537 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/0.log" Jul 28 20:48:25.769588 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.769582 2568 generic.go:356] "Generic (PLEG): container finished" podID="37918386-fb9c-47d9-8d2a-b28de84c0bab" containerID="1717f636072e507521238a974d37146ae2a3967948bc1dd5c83c07542ed285a8" exitCode=255 Jul 28 20:48:25.770003 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.769985 2568 scope.go:117] "RemoveContainer" containerID="1717f636072e507521238a974d37146ae2a3967948bc1dd5c83c07542ed285a8" Jul 28 20:48:25.789387 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.789078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" event={"ID":"37918386-fb9c-47d9-8d2a-b28de84c0bab","Type":"ContainerDied","Data":"1717f636072e507521238a974d37146ae2a3967948bc1dd5c83c07542ed285a8"} Jul 28 20:48:25.789387 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.789128 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" event={"ID":"6cda6ef2-61d7-4c16-b68b-f91652d1cb92","Type":"ContainerStarted","Data":"ace5fc0f1e630d1eddb463153f6e4f7c1a8fb68b9910e09ae194fa8d68737b2b"} Jul 28 20:48:25.789387 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.789150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" event={"ID":"9e1433ce-7054-4faa-9500-eaf7e4ba6f99","Type":"ContainerStarted","Data":"3fc843a829d3ec218c78e380f17281e27027a952a409ec8c9e2b58bdd73fe76c"} Jul 28 20:48:25.789387 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.789245 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.792661 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.792637 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 20:48:25.792822 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.792726 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9jg6j\"" Jul 28 20:48:25.792902 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.792841 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 20:48:25.793031 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.793008 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 20:48:25.793629 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.793467 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 20:48:25.802031 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.801981 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjvck"] Jul 28 20:48:25.865477 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.865423 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" podStartSLOduration=2.594452304 podStartE2EDuration="5.865405478s" totalImagesPullingTime="3.270953174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:25.865126678 +0000 UTC m=+70.011156900" watchObservedRunningTime="2026-07-28 20:48:25.865405478 +0000 UTC m=+70.011435699" Jul 28 20:48:25.883777 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.883728 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/556c2253-0f8d-4d2d-9245-e83ab33d414f-crio-socket\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.883983 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.883806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/556c2253-0f8d-4d2d-9245-e83ab33d414f-data-volume\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.883983 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.883896 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.883983 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.883970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qrkb\" (UniqueName: \"kubernetes.io/projected/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-api-access-2qrkb\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.884558 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.884339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.890872 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.890820 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" podStartSLOduration=2.608977337 podStartE2EDuration="5.890802632s" totalImagesPullingTime="3.281825295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:25.889795385 +0000 UTC m=+70.035825608" watchObservedRunningTime="2026-07-28 20:48:25.890802632 +0000 UTC m=+70.036832856" Jul 28 20:48:25.984843 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.984797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/556c2253-0f8d-4d2d-9245-e83ab33d414f-data-volume\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.985057 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.984877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.985057 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.984916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrkb\" (UniqueName: \"kubernetes.io/projected/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-api-access-2qrkb\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.985057 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.984966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.985057 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.985051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/556c2253-0f8d-4d2d-9245-e83ab33d414f-crio-socket\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.985289 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:25.985050 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 20:48:25.985289 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:25.985123 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 20:48:25.985289 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:25.985161 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:26.485139837 +0000 UTC m=+70.631170057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : configmap "kube-rbac-proxy" not found Jul 28 20:48:25.985289 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:25.985199 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:26.485180271 +0000 UTC m=+70.631210474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : secret "insights-runtime-extractor-tls" not found Jul 28 20:48:25.985289 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.985233 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/556c2253-0f8d-4d2d-9245-e83ab33d414f-data-volume\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.985289 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.985265 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/556c2253-0f8d-4d2d-9245-e83ab33d414f-crio-socket\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:25.995193 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:25.995145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qrkb\" (UniqueName: \"kubernetes.io/projected/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-api-access-2qrkb\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:26.491659 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:26.491617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:26.491845 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:26.491708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:26.491845 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:26.491724 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 20:48:26.491845 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:26.491797 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:27.491775027 +0000 UTC m=+71.637805233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : configmap "kube-rbac-proxy" not found Jul 28 20:48:26.492050 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:26.491868 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 20:48:26.492050 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:26.491935 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:27.491916574 +0000 UTC m=+71.637946792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : secret "insights-runtime-extractor-tls" not found Jul 28 20:48:27.500154 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:27.500111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:27.500154 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:27.500163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:27.500786 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:27.500252 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 20:48:27.500786 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:27.500318 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 20:48:27.500786 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:27.500338 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:29.500312789 +0000 UTC m=+73.646342991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : configmap "kube-rbac-proxy" not found Jul 28 20:48:27.500786 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:27.500372 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:29.500357805 +0000 UTC m=+73.646388007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : secret "insights-runtime-extractor-tls" not found Jul 28 20:48:27.555325 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:27.555293 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6n4w5_eedf6297-a6a5-4015-ab30-f37a8a4b17d2/dns-node-resolver/0.log" Jul 28 20:48:28.784831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.784797 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4dfs" event={"ID":"d9946582-d16b-422b-91a5-67c0961aef07","Type":"ContainerStarted","Data":"fe902a9d7332d6384b74fff5b3b4222ec9430b00372a670c0c86cc11e10f55bd"} Jul 28 20:48:28.785285 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.784913 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:48:28.786307 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.786290 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:48:28.786676 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.786662 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/0.log" Jul 28 20:48:28.786723 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.786696 2568 generic.go:356] "Generic (PLEG): container finished" podID="37918386-fb9c-47d9-8d2a-b28de84c0bab" containerID="92938f8d3106def5ce11bec81ceaf7f15e6c2fa6468107e97ad48ce2fe406db1" exitCode=255 Jul 28 20:48:28.786777 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.786724 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" event={"ID":"37918386-fb9c-47d9-8d2a-b28de84c0bab","Type":"ContainerDied","Data":"92938f8d3106def5ce11bec81ceaf7f15e6c2fa6468107e97ad48ce2fe406db1"} Jul 28 20:48:28.786833 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.786779 2568 scope.go:117] "RemoveContainer" containerID="1717f636072e507521238a974d37146ae2a3967948bc1dd5c83c07542ed285a8" Jul 28 20:48:28.786965 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.786937 2568 scope.go:117] "RemoveContainer" containerID="92938f8d3106def5ce11bec81ceaf7f15e6c2fa6468107e97ad48ce2fe406db1" Jul 28 20:48:28.787133 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:28.787111 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-djc6f_openshift-console-operator(37918386-fb9c-47d9-8d2a-b28de84c0bab)\"" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" podUID="37918386-fb9c-47d9-8d2a-b28de84c0bab" Jul 28 20:48:28.788136 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.788117 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jqcjf" event={"ID":"c5971d7f-c363-407b-8f3a-09619a3219e1","Type":"ContainerStarted","Data":"1bc6e27d798b050eddcf1dc1bb64f7e7e2d47dc13afe56534406d9f4a1cc5476"} Jul 28 20:48:28.806459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.806419 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z4dfs" podStartSLOduration=67.598389773 podStartE2EDuration="1m12.806406724s" totalImagesPullingTime="5.208016951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:28.80560884 +0000 UTC m=+72.951639088" watchObservedRunningTime="2026-07-28 20:48:28.806406724 +0000 UTC m=+72.952436947" Jul 28 20:48:28.951007 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:28.950976 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ltssv_15b803eb-bef5-4f43-95ff-be78542a558b/node-ca/0.log" Jul 28 20:48:29.513277 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:29.513233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:29.513485 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:29.513313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:29.513485 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:29.513377 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 20:48:29.513485 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:29.513465 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:33.513448069 +0000 UTC m=+77.659478268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : configmap "kube-rbac-proxy" not found Jul 28 20:48:29.513485 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:29.513474 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 20:48:29.513643 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:29.513573 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:33.513559191 +0000 UTC m=+77.659589391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : secret "insights-runtime-extractor-tls" not found Jul 28 20:48:29.551927 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:29.551893 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzxjl_872957ee-58fc-4ff7-b7b0-24e61a2b4419/serve-healthcheck-canary/0.log" Jul 28 20:48:29.793049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:29.792965 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:48:29.793486 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:29.793352 2568 scope.go:117] "RemoveContainer" containerID="92938f8d3106def5ce11bec81ceaf7f15e6c2fa6468107e97ad48ce2fe406db1" Jul 28 20:48:29.793553 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:29.793523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-djc6f_openshift-console-operator(37918386-fb9c-47d9-8d2a-b28de84c0bab)\"" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" podUID="37918386-fb9c-47d9-8d2a-b28de84c0bab" Jul 28 20:48:29.820964 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:29.820902 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jqcjf" podStartSLOduration=68.286536756 podStartE2EDuration="1m13.820887249s" totalImagesPullingTime="5.534350493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:28.846063921 +0000 UTC m=+72.992094154" watchObservedRunningTime="2026-07-28 20:48:29.820887249 +0000 UTC m=+73.966917531" Jul 28 20:48:30.042716 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.042680 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-swn74"] Jul 28 20:48:30.046768 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.046727 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.050973 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.050937 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 20:48:30.050973 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.050963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-trb6l\"" Jul 28 20:48:30.051148 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.051003 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 20:48:30.051148 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.050963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 20:48:30.053920 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.053892 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 20:48:30.060891 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.060872 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-swn74"] Jul 28 20:48:30.117934 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.117900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f769862d-aa48-4d4e-9bc8-e8c671dadad4-signing-cabundle\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.118110 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.117976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqg8\" (UniqueName: \"kubernetes.io/projected/f769862d-aa48-4d4e-9bc8-e8c671dadad4-kube-api-access-lhqg8\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.118153 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.118105 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f769862d-aa48-4d4e-9bc8-e8c671dadad4-signing-key\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.218593 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.218549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f769862d-aa48-4d4e-9bc8-e8c671dadad4-signing-cabundle\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.218749 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.218616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqg8\" (UniqueName: \"kubernetes.io/projected/f769862d-aa48-4d4e-9bc8-e8c671dadad4-kube-api-access-lhqg8\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.218749 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.218700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f769862d-aa48-4d4e-9bc8-e8c671dadad4-signing-key\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.219256 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.219223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f769862d-aa48-4d4e-9bc8-e8c671dadad4-signing-cabundle\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.221034 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.221015 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f769862d-aa48-4d4e-9bc8-e8c671dadad4-signing-key\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.229929 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.229900 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqg8\" (UniqueName: \"kubernetes.io/projected/f769862d-aa48-4d4e-9bc8-e8c671dadad4-kube-api-access-lhqg8\") pod \"service-ca-658d7b7c78-swn74\" (UID: \"f769862d-aa48-4d4e-9bc8-e8c671dadad4\") " pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.354767 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.354677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-swn74" Jul 28 20:48:30.486704 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.486672 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-swn74"] Jul 28 20:48:30.489750 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:30.489722 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf769862d_aa48_4d4e_9bc8_e8c671dadad4.slice/crio-34d8f1c514b6d256dbdd4293c5c5a080eea8b02fa3387f66b8855004ba82a07f WatchSource:0}: Error finding container 34d8f1c514b6d256dbdd4293c5c5a080eea8b02fa3387f66b8855004ba82a07f: Status 404 returned error can't find the container with id 34d8f1c514b6d256dbdd4293c5c5a080eea8b02fa3387f66b8855004ba82a07f Jul 28 20:48:30.797721 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.797687 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-swn74" event={"ID":"f769862d-aa48-4d4e-9bc8-e8c671dadad4","Type":"ContainerStarted","Data":"cd4d9079b2842dfd532bb1aaa0402f6b3b223968d7cdc802dba66ab5682680da"} Jul 28 20:48:30.798099 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.797734 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-swn74" event={"ID":"f769862d-aa48-4d4e-9bc8-e8c671dadad4","Type":"ContainerStarted","Data":"34d8f1c514b6d256dbdd4293c5c5a080eea8b02fa3387f66b8855004ba82a07f"} Jul 28 20:48:30.819776 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:30.819719 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-swn74" podStartSLOduration=0.819697748 podStartE2EDuration="819.697748ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:30.818615083 +0000 UTC m=+74.964645307" watchObservedRunningTime="2026-07-28 20:48:30.819697748 +0000 UTC m=+74.965727971" Jul 28 20:48:31.261086 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:31.261049 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:31.261272 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:31.261110 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:31.261449 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:31.261436 2568 scope.go:117] "RemoveContainer" containerID="92938f8d3106def5ce11bec81ceaf7f15e6c2fa6468107e97ad48ce2fe406db1" Jul 28 20:48:31.261595 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:31.261578 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-djc6f_openshift-console-operator(37918386-fb9c-47d9-8d2a-b28de84c0bab)\"" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" podUID="37918386-fb9c-47d9-8d2a-b28de84c0bab" Jul 28 20:48:33.545281 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:33.545236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:33.545705 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:33.545304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:33.545705 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:33.545369 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 20:48:33.545705 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:33.545445 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 20:48:33.545705 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:33.545451 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:41.545432213 +0000 UTC m=+85.691462417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : configmap "kube-rbac-proxy" not found Jul 28 20:48:33.545705 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:33.545514 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:41.545500501 +0000 UTC m=+85.691530706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : secret "insights-runtime-extractor-tls" not found Jul 28 20:48:41.610710 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:41.610662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:41.611161 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:41.610724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:41.611161 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:41.610835 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 20:48:41.611161 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:41.610893 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls podName:556c2253-0f8d-4d2d-9245-e83ab33d414f nodeName:}" failed. No retries permitted until 2026-07-28 20:48:57.610879933 +0000 UTC m=+101.756910135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjvck" (UID: "556c2253-0f8d-4d2d-9245-e83ab33d414f") : secret "insights-runtime-extractor-tls" not found Jul 28 20:48:41.611275 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:41.611218 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/556c2253-0f8d-4d2d-9245-e83ab33d414f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:45.370532 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:45.370483 2568 scope.go:117] "RemoveContainer" containerID="92938f8d3106def5ce11bec81ceaf7f15e6c2fa6468107e97ad48ce2fe406db1" Jul 28 20:48:45.851280 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:45.851250 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:48:45.851478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:45.851317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" event={"ID":"37918386-fb9c-47d9-8d2a-b28de84c0bab","Type":"ContainerStarted","Data":"ce818302681154b90acd5e285f54d0c219d65b5797553a6477461626e7ad6167"} Jul 28 20:48:45.851665 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:45.851646 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:45.871932 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:45.871879 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" podStartSLOduration=22.376968136 podStartE2EDuration="25.871865497s" totalImagesPullingTime="3.494897361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:45.87102834 +0000 UTC m=+90.017058561" watchObservedRunningTime="2026-07-28 20:48:45.871865497 +0000 UTC m=+90.017895759" Jul 28 20:48:46.033389 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:46.033360 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-djc6f" Jul 28 20:48:54.513426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.513393 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c"] Jul 28 20:48:54.544527 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.544496 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c"] Jul 28 20:48:54.544666 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.544613 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.548939 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.548913 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jwt2k\"" Jul 28 20:48:54.549128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.549108 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 20:48:54.549211 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.549151 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 20:48:54.549211 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.549169 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 20:48:54.550046 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.550030 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 20:48:54.610648 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.610620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2367f64b-ef7b-460e-a6d6-9b372c09ac03-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cf7456f76-b7q7c\" (UID: \"2367f64b-ef7b-460e-a6d6-9b372c09ac03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.610787 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.610697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7lx4\" (UniqueName: \"kubernetes.io/projected/2367f64b-ef7b-460e-a6d6-9b372c09ac03-kube-api-access-n7lx4\") pod \"managed-serviceaccount-addon-agent-5cf7456f76-b7q7c\" (UID: \"2367f64b-ef7b-460e-a6d6-9b372c09ac03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.712106 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.712074 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7lx4\" (UniqueName: \"kubernetes.io/projected/2367f64b-ef7b-460e-a6d6-9b372c09ac03-kube-api-access-n7lx4\") pod \"managed-serviceaccount-addon-agent-5cf7456f76-b7q7c\" (UID: \"2367f64b-ef7b-460e-a6d6-9b372c09ac03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.712284 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.712137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2367f64b-ef7b-460e-a6d6-9b372c09ac03-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cf7456f76-b7q7c\" (UID: \"2367f64b-ef7b-460e-a6d6-9b372c09ac03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.714668 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.714639 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2367f64b-ef7b-460e-a6d6-9b372c09ac03-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cf7456f76-b7q7c\" (UID: \"2367f64b-ef7b-460e-a6d6-9b372c09ac03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.720638 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.720609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7lx4\" (UniqueName: \"kubernetes.io/projected/2367f64b-ef7b-460e-a6d6-9b372c09ac03-kube-api-access-n7lx4\") pod \"managed-serviceaccount-addon-agent-5cf7456f76-b7q7c\" (UID: \"2367f64b-ef7b-460e-a6d6-9b372c09ac03\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.862200 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.862175 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" Jul 28 20:48:54.996719 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:54.996675 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c"] Jul 28 20:48:55.000314 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:55.000288 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2367f64b_ef7b_460e_a6d6_9b372c09ac03.slice/crio-a09e5db5a536651e0f6c5d508ad57e41a5a437d23de9f30bc055f36dcea5c471 WatchSource:0}: Error finding container a09e5db5a536651e0f6c5d508ad57e41a5a437d23de9f30bc055f36dcea5c471: Status 404 returned error can't find the container with id a09e5db5a536651e0f6c5d508ad57e41a5a437d23de9f30bc055f36dcea5c471 Jul 28 20:48:55.163352 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.163315 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd4b78c87-fb9b6"] Jul 28 20:48:55.185696 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.185661 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd4b78c87-fb9b6"] Jul 28 20:48:55.185844 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.185773 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.188761 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.188736 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 20:48:55.188892 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.188867 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wj57k\"" Jul 28 20:48:55.190270 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.189430 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 20:48:55.190270 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.189509 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 20:48:55.190270 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.189630 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 20:48:55.190270 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.189901 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 20:48:55.190846 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.190825 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 20:48:55.193316 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.191806 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 20:48:55.318179 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.318144 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrcgt\" (UniqueName: \"kubernetes.io/projected/872b166f-131b-4f06-a1be-2210e25e0bb7-kube-api-access-lrcgt\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.318353 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.318203 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-oauth-config\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.318353 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.318255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-service-ca\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.318353 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.318310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-serving-cert\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.318353 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.318340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-oauth-serving-cert\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.318520 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.318403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-console-config\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419062 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.418967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-service-ca\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419062 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-serving-cert\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419283 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-oauth-serving-cert\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419283 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-console-config\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419283 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrcgt\" (UniqueName: \"kubernetes.io/projected/872b166f-131b-4f06-a1be-2210e25e0bb7-kube-api-access-lrcgt\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419441 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-oauth-config\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419716 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419686 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-service-ca\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419806 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419784 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-oauth-serving-cert\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.419866 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.419818 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-console-config\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.421521 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.421490 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-serving-cert\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.421922 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.421905 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-oauth-config\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.428732 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.428712 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrcgt\" (UniqueName: \"kubernetes.io/projected/872b166f-131b-4f06-a1be-2210e25e0bb7-kube-api-access-lrcgt\") pod \"console-6fd4b78c87-fb9b6\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.497437 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.497409 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:48:55.531625 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.531598 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz"] Jul 28 20:48:55.553495 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.553466 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz"] Jul 28 20:48:55.553624 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.553559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:48:55.556302 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.556251 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 20:48:55.556302 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.556278 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qlgvf\"" Jul 28 20:48:55.620703 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.620667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d8b990b-05aa-47c5-8952-dc7cc9b7b223-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-glfcz\" (UID: \"9d8b990b-05aa-47c5-8952-dc7cc9b7b223\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:48:55.653397 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.653367 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd4b78c87-fb9b6"] Jul 28 20:48:55.656201 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:55.656171 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872b166f_131b_4f06_a1be_2210e25e0bb7.slice/crio-0e0ad18bd0db6842820210e7faf00239070dc91f97fdcd1eefbc59450087509b WatchSource:0}: Error finding container 0e0ad18bd0db6842820210e7faf00239070dc91f97fdcd1eefbc59450087509b: Status 404 returned error can't find the container with id 0e0ad18bd0db6842820210e7faf00239070dc91f97fdcd1eefbc59450087509b Jul 28 20:48:55.722142 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.722059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d8b990b-05aa-47c5-8952-dc7cc9b7b223-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-glfcz\" (UID: \"9d8b990b-05aa-47c5-8952-dc7cc9b7b223\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:48:55.722277 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:55.722202 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 20:48:55.722277 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:48:55.722273 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d8b990b-05aa-47c5-8952-dc7cc9b7b223-tls-certificates podName:9d8b990b-05aa-47c5-8952-dc7cc9b7b223 nodeName:}" failed. No retries permitted until 2026-07-28 20:48:56.22225159 +0000 UTC m=+100.368281800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9d8b990b-05aa-47c5-8952-dc7cc9b7b223-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-glfcz" (UID: "9d8b990b-05aa-47c5-8952-dc7cc9b7b223") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 20:48:55.882105 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.882065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" event={"ID":"2367f64b-ef7b-460e-a6d6-9b372c09ac03","Type":"ContainerStarted","Data":"a09e5db5a536651e0f6c5d508ad57e41a5a437d23de9f30bc055f36dcea5c471"} Jul 28 20:48:55.883359 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:55.883335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd4b78c87-fb9b6" event={"ID":"872b166f-131b-4f06-a1be-2210e25e0bb7","Type":"ContainerStarted","Data":"0e0ad18bd0db6842820210e7faf00239070dc91f97fdcd1eefbc59450087509b"} Jul 28 20:48:56.225284 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.225243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:56.225460 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.225303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d8b990b-05aa-47c5-8952-dc7cc9b7b223-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-glfcz\" (UID: \"9d8b990b-05aa-47c5-8952-dc7cc9b7b223\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:48:56.225460 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.225356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:48:56.227692 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.227666 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58409041-4cb3-4f20-8e8d-5ae8142435a0-metrics-tls\") pod \"dns-default-tvgbf\" (UID: \"58409041-4cb3-4f20-8e8d-5ae8142435a0\") " pod="openshift-dns/dns-default-tvgbf" Jul 28 20:48:56.227812 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.227788 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9d8b990b-05aa-47c5-8952-dc7cc9b7b223-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-glfcz\" (UID: \"9d8b990b-05aa-47c5-8952-dc7cc9b7b223\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:48:56.227812 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.227806 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"image-registry-65655f5f66-nkj6w\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:56.463400 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.463365 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:48:56.510483 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.510308 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-52n7n\"" Jul 28 20:48:56.518655 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.518624 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:56.530295 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.530187 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ghnpw\"" Jul 28 20:48:56.538490 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.538447 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvgbf" Jul 28 20:48:56.639336 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.639115 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz"] Jul 28 20:48:56.750886 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.750708 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65655f5f66-nkj6w"] Jul 28 20:48:56.754562 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:56.754530 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12372d67_ea1e_4e88_8e3a_594da50417ea.slice/crio-95a404eeeb3ea0b9d0481f28ce6b6dc041d442baa4695417d28616dbd410a1cd WatchSource:0}: Error finding container 95a404eeeb3ea0b9d0481f28ce6b6dc041d442baa4695417d28616dbd410a1cd: Status 404 returned error can't find the container with id 95a404eeeb3ea0b9d0481f28ce6b6dc041d442baa4695417d28616dbd410a1cd Jul 28 20:48:56.768688 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.768660 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvgbf"] Jul 28 20:48:56.772414 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:56.772382 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58409041_4cb3_4f20_8e8d_5ae8142435a0.slice/crio-403894a102cb08283e391e7dfe04a54b7b522764c650abd247acce066359118c WatchSource:0}: Error finding container 403894a102cb08283e391e7dfe04a54b7b522764c650abd247acce066359118c: Status 404 returned error can't find the container with id 403894a102cb08283e391e7dfe04a54b7b522764c650abd247acce066359118c Jul 28 20:48:56.890776 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.890727 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" event={"ID":"9d8b990b-05aa-47c5-8952-dc7cc9b7b223","Type":"ContainerStarted","Data":"d098e3a97baba0fb2220f37ce3526b953c974298cae3fb444011ee3230ab5c20"} Jul 28 20:48:56.892990 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.892937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" event={"ID":"12372d67-ea1e-4e88-8e3a-594da50417ea","Type":"ContainerStarted","Data":"1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca"} Jul 28 20:48:56.893105 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.893014 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" event={"ID":"12372d67-ea1e-4e88-8e3a-594da50417ea","Type":"ContainerStarted","Data":"95a404eeeb3ea0b9d0481f28ce6b6dc041d442baa4695417d28616dbd410a1cd"} Jul 28 20:48:56.894910 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:56.894882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvgbf" event={"ID":"58409041-4cb3-4f20-8e8d-5ae8142435a0","Type":"ContainerStarted","Data":"403894a102cb08283e391e7dfe04a54b7b522764c650abd247acce066359118c"} Jul 28 20:48:57.639229 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:57.639183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:57.642361 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:57.642333 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/556c2253-0f8d-4d2d-9245-e83ab33d414f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjvck\" (UID: \"556c2253-0f8d-4d2d-9245-e83ab33d414f\") " pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:57.899134 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:57.898995 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:48:57.901335 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:57.901306 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjvck" Jul 28 20:48:58.084146 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:58.084089 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" podStartSLOduration=102.084064973 podStartE2EDuration="1m42.084064973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:57.92330556 +0000 UTC m=+102.069335797" watchObservedRunningTime="2026-07-28 20:48:58.084064973 +0000 UTC m=+102.230095196" Jul 28 20:48:58.084640 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:58.084620 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjvck"] Jul 28 20:48:59.413157 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:48:59.413113 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556c2253_0f8d_4d2d_9245_e83ab33d414f.slice/crio-1a94b007fe926e15a154a0cfd5f69fe9a257230552534d5c5495ebaa34e29097 WatchSource:0}: Error finding container 1a94b007fe926e15a154a0cfd5f69fe9a257230552534d5c5495ebaa34e29097: Status 404 returned error can't find the container with id 1a94b007fe926e15a154a0cfd5f69fe9a257230552534d5c5495ebaa34e29097 Jul 28 20:48:59.796850 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:59.796777 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z4dfs" Jul 28 20:48:59.908554 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:48:59.908521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjvck" event={"ID":"556c2253-0f8d-4d2d-9245-e83ab33d414f","Type":"ContainerStarted","Data":"1a94b007fe926e15a154a0cfd5f69fe9a257230552534d5c5495ebaa34e29097"} Jul 28 20:49:01.921335 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.920851 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvgbf" event={"ID":"58409041-4cb3-4f20-8e8d-5ae8142435a0","Type":"ContainerStarted","Data":"4d656fd7e4c3209825345cc9cc88a4391523277acbc55b76487efa14e1b50615"} Jul 28 20:49:01.921335 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.920984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvgbf" event={"ID":"58409041-4cb3-4f20-8e8d-5ae8142435a0","Type":"ContainerStarted","Data":"d0cbaca49d7252853ca08bebe1de7454f1e51585550ea5af893829152403d56a"} Jul 28 20:49:01.921856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.921743 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tvgbf" Jul 28 20:49:01.923972 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.923931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" event={"ID":"2367f64b-ef7b-460e-a6d6-9b372c09ac03","Type":"ContainerStarted","Data":"ba235cf56a0503693ccddec5a5571c8b17fb2bd58128129c86c767818997e0e5"} Jul 28 20:49:01.926391 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.926333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd4b78c87-fb9b6" event={"ID":"872b166f-131b-4f06-a1be-2210e25e0bb7","Type":"ContainerStarted","Data":"36b76020baedc2f7ff14397ae789fc15e3955d6d796db910b3260087d2ac552e"} Jul 28 20:49:01.928632 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.928388 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" event={"ID":"9d8b990b-05aa-47c5-8952-dc7cc9b7b223","Type":"ContainerStarted","Data":"8b6e94fb6cfc7fa38607a6a7714b75669dc2b166283dffd4c4d65ab4428e2ad2"} Jul 28 20:49:01.928632 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.928437 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:49:01.936146 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.936122 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" Jul 28 20:49:01.942473 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.942375 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tvgbf" podStartSLOduration=66.341382804 podStartE2EDuration="1m9.942361773s" totalImagesPullingTime="3.600978969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:01.94091238 +0000 UTC m=+106.086942622" watchObservedRunningTime="2026-07-28 20:49:01.942361773 +0000 UTC m=+106.088391994" Jul 28 20:49:01.959409 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:01.959212 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd4b78c87-fb9b6" podStartSLOduration=2.246123509 podStartE2EDuration="6.959196557s" totalImagesPullingTime="4.713073048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:01.958921763 +0000 UTC m=+106.104951986" watchObservedRunningTime="2026-07-28 20:49:01.959196557 +0000 UTC m=+106.105226757" Jul 28 20:49:02.026139 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.026084 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cf7456f76-b7q7c" podStartSLOduration=1.250620678 podStartE2EDuration="8.026067575s" totalImagesPullingTime="6.775446897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:01.995393251 +0000 UTC m=+106.141423491" watchObservedRunningTime="2026-07-28 20:49:02.026067575 +0000 UTC m=+106.172097797" Jul 28 20:49:02.026667 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.026635 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-glfcz" podStartSLOduration=3.310907368 podStartE2EDuration="7.026628102s" totalImagesPullingTime="3.715720734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:02.025856861 +0000 UTC m=+106.171887083" watchObservedRunningTime="2026-07-28 20:49:02.026628102 +0000 UTC m=+106.172658324" Jul 28 20:49:02.627296 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.627264 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7hd8h"] Jul 28 20:49:02.639169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.639143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.643379 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.643350 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 20:49:02.643899 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.643700 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 20:49:02.644689 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.644668 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 20:49:02.644781 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.644714 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 20:49:02.644886 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.644871 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vn6rj\"" Jul 28 20:49:02.644969 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.644889 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 20:49:02.649232 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.649210 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7hd8h"] Jul 28 20:49:02.787424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.787391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11d5259f-4cb2-41b5-b18f-4021808cf133-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.787641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.787440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d5259f-4cb2-41b5-b18f-4021808cf133-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.787641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.787487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgx9h\" (UniqueName: \"kubernetes.io/projected/11d5259f-4cb2-41b5-b18f-4021808cf133-kube-api-access-fgx9h\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.787641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.787569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11d5259f-4cb2-41b5-b18f-4021808cf133-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.888323 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.888241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11d5259f-4cb2-41b5-b18f-4021808cf133-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.888323 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.888296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11d5259f-4cb2-41b5-b18f-4021808cf133-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.888545 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.888336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d5259f-4cb2-41b5-b18f-4021808cf133-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.888545 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.888378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgx9h\" (UniqueName: \"kubernetes.io/projected/11d5259f-4cb2-41b5-b18f-4021808cf133-kube-api-access-fgx9h\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.889162 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.889130 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11d5259f-4cb2-41b5-b18f-4021808cf133-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.890935 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.890914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11d5259f-4cb2-41b5-b18f-4021808cf133-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.891051 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.890922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/11d5259f-4cb2-41b5-b18f-4021808cf133-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.898779 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.898686 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgx9h\" (UniqueName: \"kubernetes.io/projected/11d5259f-4cb2-41b5-b18f-4021808cf133-kube-api-access-fgx9h\") pod \"prometheus-operator-84d69f794d-7hd8h\" (UID: \"11d5259f-4cb2-41b5-b18f-4021808cf133\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:02.950555 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:02.950517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" Jul 28 20:49:05.173260 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.173236 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7hd8h"] Jul 28 20:49:05.175905 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:05.175878 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d5259f_4cb2_41b5_b18f_4021808cf133.slice/crio-99b4f8fad4a005af76948c0435c5bd24a5b03670ca73dfedf86629b634fd071b WatchSource:0}: Error finding container 99b4f8fad4a005af76948c0435c5bd24a5b03670ca73dfedf86629b634fd071b: Status 404 returned error can't find the container with id 99b4f8fad4a005af76948c0435c5bd24a5b03670ca73dfedf86629b634fd071b Jul 28 20:49:05.498126 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.498088 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:49:05.498302 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.498150 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:49:05.499525 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.499486 2568 patch_prober.go:28] interesting pod/console-6fd4b78c87-fb9b6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 28 20:49:05.499645 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.499545 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fd4b78c87-fb9b6" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 28 20:49:05.945983 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.945871 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" event={"ID":"11d5259f-4cb2-41b5-b18f-4021808cf133","Type":"ContainerStarted","Data":"99b4f8fad4a005af76948c0435c5bd24a5b03670ca73dfedf86629b634fd071b"} Jul 28 20:49:05.948288 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:05.948213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjvck" event={"ID":"556c2253-0f8d-4d2d-9245-e83ab33d414f","Type":"ContainerStarted","Data":"fabaa2de9f7cd61f98be493c6784d3f00b17cf19a08516b3f959f073367f64e8"} Jul 28 20:49:08.961072 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:08.960967 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" event={"ID":"11d5259f-4cb2-41b5-b18f-4021808cf133","Type":"ContainerStarted","Data":"a6674b43877c6f87f8cb89fba7c3c4ee6dd25fd4c20ec71aff19a95222308112"} Jul 28 20:49:08.961072 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:08.961067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" event={"ID":"11d5259f-4cb2-41b5-b18f-4021808cf133","Type":"ContainerStarted","Data":"e107ec23c8fdbb3ba42be46a5d61dc13081204df2036b1afe478794455061fc2"} Jul 28 20:49:08.962641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:08.962613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjvck" event={"ID":"556c2253-0f8d-4d2d-9245-e83ab33d414f","Type":"ContainerStarted","Data":"29c000e7730e51d2f83d40cb000490d8cb76e411bceebaa43fc3d4a872fbc878"} Jul 28 20:49:08.981654 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:08.981609 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-7hd8h" podStartSLOduration=3.527448211 podStartE2EDuration="6.981593009s" totalImagesPullingTime="3.454144798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:08.980871788 +0000 UTC m=+113.126902010" watchObservedRunningTime="2026-07-28 20:49:08.981593009 +0000 UTC m=+113.127623237" Jul 28 20:49:11.071589 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.071550 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dtq4b"] Jul 28 20:49:11.086039 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.086005 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.090232 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.089620 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 20:49:11.090407 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.090379 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 20:49:11.090511 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.090457 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 20:49:11.090567 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.090387 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d2fw6\"" Jul 28 20:49:11.261854 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-wtmp\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.261854 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-textfile\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.261854 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.261854 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-metrics-client-ca\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.261854 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.262316 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-root\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.262316 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.261932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-sys\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.262316 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.262000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpf5k\" (UniqueName: \"kubernetes.io/projected/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-kube-api-access-qpf5k\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.262316 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.262040 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-tls\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.362933 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.362851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-metrics-client-ca\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.362933 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.362922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363162 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.362993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-root\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363162 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-sys\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363162 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363077 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpf5k\" (UniqueName: \"kubernetes.io/projected/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-kube-api-access-qpf5k\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363162 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-tls\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363162 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-wtmp\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-textfile\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363219 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-root\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.363587 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:49:11.363436 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 20:49:11.363587 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:49:11.363496 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-tls podName:ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e nodeName:}" failed. No retries permitted until 2026-07-28 20:49:11.863475326 +0000 UTC m=+116.009505542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-tls") pod "node-exporter-dtq4b" (UID: "ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e") : secret "node-exporter-tls" not found Jul 28 20:49:11.364240 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-sys\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.364240 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.363986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-textfile\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.364240 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.364085 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-metrics-client-ca\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.364240 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.364124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-wtmp\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.364529 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.364414 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.366177 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.366155 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.374232 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.374210 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpf5k\" (UniqueName: \"kubernetes.io/projected/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-kube-api-access-qpf5k\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.867573 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.867523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-tls\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.869997 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.869930 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e-node-exporter-tls\") pod \"node-exporter-dtq4b\" (UID: \"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e\") " pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:11.998935 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:11.998898 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dtq4b" Jul 28 20:49:12.090565 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.090531 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 20:49:12.097071 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.097043 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.099713 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.099689 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 20:49:12.100032 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.100014 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 20:49:12.100428 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.100411 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 20:49:12.100644 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.100629 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 20:49:12.100813 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.100796 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 20:49:12.101733 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.101699 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 20:49:12.102775 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.102600 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 20:49:12.102775 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.102628 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 20:49:12.103151 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.102986 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 20:49:12.103249 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.103170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jfc5x\"" Jul 28 20:49:12.113478 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.113454 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 20:49:12.170354 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170537 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7z4w\" (UniqueName: \"kubernetes.io/projected/5594f5fd-18bb-41c7-9b51-e0515706013b-kube-api-access-v7z4w\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170537 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170537 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170537 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170504 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5594f5fd-18bb-41c7-9b51-e0515706013b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170537 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-web-config\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5594f5fd-18bb-41c7-9b51-e0515706013b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5594f5fd-18bb-41c7-9b51-e0515706013b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.170856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.171089 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.171089 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5594f5fd-18bb-41c7-9b51-e0515706013b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.171089 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.170938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5594f5fd-18bb-41c7-9b51-e0515706013b-config-out\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.252030 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:12.251996 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce602785_1f7e_4888_aaf2_a8a5e4bb1c0e.slice/crio-6361edf412d8eb348ff18d4273118227003c0c5f5ab7a4a75b66b9b24f5fc1ce WatchSource:0}: Error finding container 6361edf412d8eb348ff18d4273118227003c0c5f5ab7a4a75b66b9b24f5fc1ce: Status 404 returned error can't find the container with id 6361edf412d8eb348ff18d4273118227003c0c5f5ab7a4a75b66b9b24f5fc1ce Jul 28 20:49:12.272039 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5594f5fd-18bb-41c7-9b51-e0515706013b-config-out\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7z4w\" (UniqueName: \"kubernetes.io/projected/5594f5fd-18bb-41c7-9b51-e0515706013b-kube-api-access-v7z4w\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5594f5fd-18bb-41c7-9b51-e0515706013b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272193 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-web-config\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5594f5fd-18bb-41c7-9b51-e0515706013b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5594f5fd-18bb-41c7-9b51-e0515706013b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.272426 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.272421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5594f5fd-18bb-41c7-9b51-e0515706013b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.274209 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.273257 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5594f5fd-18bb-41c7-9b51-e0515706013b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.274209 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.273761 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5594f5fd-18bb-41c7-9b51-e0515706013b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.274209 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:49:12.273876 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 28 20:49:12.274209 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:49:12.273967 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-main-tls podName:5594f5fd-18bb-41c7-9b51-e0515706013b nodeName:}" failed. No retries permitted until 2026-07-28 20:49:12.773926906 +0000 UTC m=+116.919957117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5594f5fd-18bb-41c7-9b51-e0515706013b") : secret "alertmanager-main-tls" not found Jul 28 20:49:12.274488 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.274266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5594f5fd-18bb-41c7-9b51-e0515706013b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.275071 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.275031 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5594f5fd-18bb-41c7-9b51-e0515706013b-config-out\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.275292 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.275112 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-web-config\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.275875 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.275774 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.275875 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.275835 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.277366 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.277311 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5594f5fd-18bb-41c7-9b51-e0515706013b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.278051 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.278008 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.278314 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.278295 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.278569 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.278547 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.281038 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.281017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7z4w\" (UniqueName: \"kubernetes.io/projected/5594f5fd-18bb-41c7-9b51-e0515706013b-kube-api-access-v7z4w\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.776982 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.776926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.780007 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.779971 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5594f5fd-18bb-41c7-9b51-e0515706013b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5594f5fd-18bb-41c7-9b51-e0515706013b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:12.938387 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.938352 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tvgbf" Jul 28 20:49:12.981028 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.980990 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjvck" event={"ID":"556c2253-0f8d-4d2d-9245-e83ab33d414f","Type":"ContainerStarted","Data":"2f5ac38d3c5325d2e7958b78bb7cf4ff305caf56a38661b4a219fb5da631ff84"} Jul 28 20:49:12.982342 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:12.982320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtq4b" event={"ID":"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e","Type":"ContainerStarted","Data":"6361edf412d8eb348ff18d4273118227003c0c5f5ab7a4a75b66b9b24f5fc1ce"} Jul 28 20:49:13.002592 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:13.002543 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jjvck" podStartSLOduration=35.244102133 podStartE2EDuration="48.002525442s" totalImagesPullingTime="12.758423309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:48:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:13.000914826 +0000 UTC m=+117.146945074" watchObservedRunningTime="2026-07-28 20:49:13.002525442 +0000 UTC m=+117.148555662" Jul 28 20:49:13.009519 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:13.009491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 20:49:13.281042 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:13.276785 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 20:49:13.987915 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:13.987873 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"c45710cba011c46378b7230f62a2d07bb4caafd3151c697ea3ed4186a5ac98d6"} Jul 28 20:49:13.989878 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:13.989845 2568 generic.go:356] "Generic (PLEG): container finished" podID="ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e" containerID="e3edd7590c5ee49f45fddb613153c78918cbee099250c323861cd6070c1cdd9b" exitCode=0 Jul 28 20:49:13.990025 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:13.989935 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtq4b" event={"ID":"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e","Type":"ContainerDied","Data":"e3edd7590c5ee49f45fddb613153c78918cbee099250c323861cd6070c1cdd9b"} Jul 28 20:49:14.995641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:14.995601 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtq4b" event={"ID":"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e","Type":"ContainerStarted","Data":"fe499c345a5b6db2ea0fd9b65118fec1217ac56da76dcb5421e9fa6bc56b6698"} Jul 28 20:49:14.996081 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:14.995653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtq4b" event={"ID":"ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e","Type":"ContainerStarted","Data":"07145db4ea7cc94cf09c7ebd32e94087c205628f648ac2f09b47c25d0bee69d6"} Jul 28 20:49:14.997061 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:14.997037 2568 generic.go:356] "Generic (PLEG): container finished" podID="5594f5fd-18bb-41c7-9b51-e0515706013b" containerID="4e6a290034a4924c17a470962be7bf3eaa08cd917e8f7c57de28f8d87b59e007" exitCode=0 Jul 28 20:49:14.997169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:14.997069 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerDied","Data":"4e6a290034a4924c17a470962be7bf3eaa08cd917e8f7c57de28f8d87b59e007"} Jul 28 20:49:15.042614 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.042562 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dtq4b" podStartSLOduration=3.049887502 podStartE2EDuration="4.042547027s" totalImagesPullingTime="927.39421ms" totalInitContainerRuntime="65.265315ms" isStatefulPod=true podCreationTimestamp="2026-07-28 20:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:15.039848129 +0000 UTC m=+119.185878371" watchObservedRunningTime="2026-07-28 20:49:15.042547027 +0000 UTC m=+119.188577248" Jul 28 20:49:15.332526 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.332444 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56847789d6-grcz4"] Jul 28 20:49:15.335770 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.335749 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.339066 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.339042 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 20:49:15.339200 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.339098 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 20:49:15.339288 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.339240 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xpzjv\"" Jul 28 20:49:15.339380 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.339364 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 20:49:15.339469 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.339376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 20:49:15.339615 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.339603 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ff07g1o9tqbve\"" Jul 28 20:49:15.347978 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.347943 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56847789d6-grcz4"] Jul 28 20:49:15.397899 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.397861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfmm4\" (UniqueName: \"kubernetes.io/projected/30c4826a-626b-4a6c-81f8-df7ff31694de-kube-api-access-sfmm4\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.397899 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.397899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-secret-metrics-server-client-certs\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.398084 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.397923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30c4826a-626b-4a6c-81f8-df7ff31694de-metrics-server-audit-profiles\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.398084 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.398003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-client-ca-bundle\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.398084 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.398024 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30c4826a-626b-4a6c-81f8-df7ff31694de-audit-log\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.398192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.398084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-secret-metrics-server-tls\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.398192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.398115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30c4826a-626b-4a6c-81f8-df7ff31694de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498436 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498388 2568 patch_prober.go:28] interesting pod/console-6fd4b78c87-fb9b6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 28 20:49:15.498591 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498450 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fd4b78c87-fb9b6" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 28 20:49:15.498591 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-secret-metrics-server-client-certs\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498591 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30c4826a-626b-4a6c-81f8-df7ff31694de-metrics-server-audit-profiles\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498591 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-client-ca-bundle\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498771 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30c4826a-626b-4a6c-81f8-df7ff31694de-audit-log\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498771 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498642 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-secret-metrics-server-tls\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498771 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30c4826a-626b-4a6c-81f8-df7ff31694de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.498771 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.498763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfmm4\" (UniqueName: \"kubernetes.io/projected/30c4826a-626b-4a6c-81f8-df7ff31694de-kube-api-access-sfmm4\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.499190 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.499160 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/30c4826a-626b-4a6c-81f8-df7ff31694de-audit-log\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.499467 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.499434 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30c4826a-626b-4a6c-81f8-df7ff31694de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.499605 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.499588 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/30c4826a-626b-4a6c-81f8-df7ff31694de-metrics-server-audit-profiles\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.501084 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.501064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-secret-metrics-server-tls\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.501589 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.501571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-client-ca-bundle\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.501648 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.501603 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/30c4826a-626b-4a6c-81f8-df7ff31694de-secret-metrics-server-client-certs\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.510631 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.510602 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfmm4\" (UniqueName: \"kubernetes.io/projected/30c4826a-626b-4a6c-81f8-df7ff31694de-kube-api-access-sfmm4\") pod \"metrics-server-56847789d6-grcz4\" (UID: \"30c4826a-626b-4a6c-81f8-df7ff31694de\") " pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.645381 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.645345 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:15.789358 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.789327 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd4b78c87-fb9b6"] Jul 28 20:49:15.813984 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:15.813941 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56847789d6-grcz4"] Jul 28 20:49:15.817065 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:15.817025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c4826a_626b_4a6c_81f8_df7ff31694de.slice/crio-66a1a04d9cffae4c8a827ace19829a13af2daf1034dc3f345d8b1f740497e5b5 WatchSource:0}: Error finding container 66a1a04d9cffae4c8a827ace19829a13af2daf1034dc3f345d8b1f740497e5b5: Status 404 returned error can't find the container with id 66a1a04d9cffae4c8a827ace19829a13af2daf1034dc3f345d8b1f740497e5b5 Jul 28 20:49:16.002424 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.002338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" event={"ID":"30c4826a-626b-4a6c-81f8-df7ff31694de","Type":"ContainerStarted","Data":"66a1a04d9cffae4c8a827ace19829a13af2daf1034dc3f345d8b1f740497e5b5"} Jul 28 20:49:16.220750 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.220711 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d76459ddb-8gq9t"] Jul 28 20:49:16.225418 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.225388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.229013 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.228971 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 20:49:16.229601 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.229581 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 20:49:16.229764 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.229743 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 20:49:16.229863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.229771 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 20:49:16.229863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.229773 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 20:49:16.230308 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.230287 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9slcr\"" Jul 28 20:49:16.236228 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.236207 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 20:49:16.241423 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.241399 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d76459ddb-8gq9t"] Jul 28 20:49:16.307811 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.307742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-serving-certs-ca-bundle\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.307811 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.307798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wc6\" (UniqueName: \"kubernetes.io/projected/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-kube-api-access-79wc6\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.308049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.307857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.308049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.307903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-telemeter-client-tls\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.308049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.307940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-secret-telemeter-client\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.308049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.307996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-federate-client-tls\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.308049 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.308013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.308225 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.308073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-metrics-client-ca\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.408993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-serving-certs-ca-bundle\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409207 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wc6\" (UniqueName: \"kubernetes.io/projected/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-kube-api-access-79wc6\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409207 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409207 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-telemeter-client-tls\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409207 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-secret-telemeter-client\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409207 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409180 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-federate-client-tls\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409207 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.409472 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.409313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-metrics-client-ca\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.410052 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.410020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-metrics-client-ca\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.412166 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.412148 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 20:49:16.412573 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.412550 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 20:49:16.412748 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.412569 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 20:49:16.412748 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.412569 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 20:49:16.412892 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.412861 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 20:49:16.417352 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.417331 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 20:49:16.419773 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.419729 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wc6\" (UniqueName: \"kubernetes.io/projected/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-kube-api-access-79wc6\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.419862 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.419800 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-serving-certs-ca-bundle\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.420167 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.420142 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.421723 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.421700 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-federate-client-tls\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.421856 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.421839 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.422141 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.422123 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-telemeter-client-tls\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.422505 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.422483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dec67974-9bfa-4dc2-94f6-d686e4ddb30d-secret-telemeter-client\") pod \"telemeter-client-d76459ddb-8gq9t\" (UID: \"dec67974-9bfa-4dc2-94f6-d686e4ddb30d\") " pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.523215 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.523189 2568 patch_prober.go:28] interesting pod/image-registry-65655f5f66-nkj6w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 20:49:16.523306 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.523234 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" podUID="12372d67-ea1e-4e88-8e3a-594da50417ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 20:49:16.538579 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.538558 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9slcr\"" Jul 28 20:49:16.546796 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.546772 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" Jul 28 20:49:16.704657 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:16.704627 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d76459ddb-8gq9t"] Jul 28 20:49:16.710513 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:16.710480 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec67974_9bfa_4dc2_94f6_d686e4ddb30d.slice/crio-8e84d023f2ec03276b311dbbf8a718b10bfdc477de5bcfb3c0b2d8855ff62a26 WatchSource:0}: Error finding container 8e84d023f2ec03276b311dbbf8a718b10bfdc477de5bcfb3c0b2d8855ff62a26: Status 404 returned error can't find the container with id 8e84d023f2ec03276b311dbbf8a718b10bfdc477de5bcfb3c0b2d8855ff62a26 Jul 28 20:49:17.010135 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.010105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"bfbde88c1611e1f3d5a7ad26d42ebbe3aef6aa21c193c5252c3b060e653bbc7b"} Jul 28 20:49:17.010505 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.010187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"3d954c0309af02f549938d762c0af8d6c7255bf56bae711124436fa8cb71e7e7"} Jul 28 20:49:17.010505 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.010233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"6b762f410c5c769333b55cacc448f6a14175332b8106f345ff52cfcfdd98c8be"} Jul 28 20:49:17.010505 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.010275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"0598ad35f2dc6fa08d497d2372daac31e84573c9a9ded2cd9e48dc81fb361a37"} Jul 28 20:49:17.010505 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.010311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"d4ff2f71f417fca9bb9d670537a4b6ed2d2fba6562bbf3cd96eaa1bc1a161f01"} Jul 28 20:49:17.011436 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.011410 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" event={"ID":"dec67974-9bfa-4dc2-94f6-d686e4ddb30d","Type":"ContainerStarted","Data":"8e84d023f2ec03276b311dbbf8a718b10bfdc477de5bcfb3c0b2d8855ff62a26"} Jul 28 20:49:17.380056 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.379780 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 20:49:17.384965 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.384931 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.388860 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.388834 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 20:49:17.389282 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.389262 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 20:49:17.391416 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.391390 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 20:49:17.391509 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.391420 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 20:49:17.391615 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.391594 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 20:49:17.391693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.391594 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 20:49:17.391693 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.391667 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 20:49:17.391928 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.391909 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kfb98\"" Jul 28 20:49:17.392719 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.392700 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1f66cvidq2ct0\"" Jul 28 20:49:17.392899 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.392871 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 20:49:17.393020 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.392986 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 20:49:17.393133 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.393114 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 20:49:17.393674 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.393390 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 20:49:17.393674 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.393521 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 20:49:17.396634 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.396614 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 20:49:17.403233 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.403214 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 20:49:17.409191 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.409168 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 20:49:17.422587 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5sdf\" (UniqueName: \"kubernetes.io/projected/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-kube-api-access-r5sdf\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.422736 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.422736 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.422844 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.422844 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.422844 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.422994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423033 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-config\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.423370 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.423335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.524723 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524688 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-config\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.524882 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524743 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.524882 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.524882 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524820 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.524882 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.524882 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524906 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.524942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5sdf\" (UniqueName: \"kubernetes.io/projected/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-kube-api-access-r5sdf\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525013 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525127 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525229 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525459 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.525847 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.525729 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.526348 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.526088 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.526600 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.526569 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.527171 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.527142 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.527854 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.527818 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.529724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.528615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.529724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.528619 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.529724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.528863 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.529724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.529052 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.529724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.529587 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-config\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.529724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.529663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.530120 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.530097 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.530190 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.530150 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.530249 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.530222 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.530801 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.530780 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.530888 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.530866 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.531065 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.531042 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.531779 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.531759 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.545705 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.545682 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5sdf\" (UniqueName: \"kubernetes.io/projected/d8b68be3-5d79-4ce3-9d2a-b4b85abc8530-kube-api-access-r5sdf\") pod \"prometheus-k8s-0\" (UID: \"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.700297 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.700235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:17.788751 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.788538 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65655f5f66-nkj6w"] Jul 28 20:49:17.796332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.796276 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:49:17.904211 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:17.904066 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 20:49:18.022791 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:18.022734 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" event={"ID":"30c4826a-626b-4a6c-81f8-df7ff31694de","Type":"ContainerStarted","Data":"62422f971af8c76b281a3db110fb345e08d524aaf851aada81189ed234afc5cf"} Jul 28 20:49:18.055528 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:18.055492 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b68be3_5d79_4ce3_9d2a_b4b85abc8530.slice/crio-c6c30ada40c65c01c256f3ac99b39394c14e4d1e3f88a7d42c2013b1d6219106 WatchSource:0}: Error finding container c6c30ada40c65c01c256f3ac99b39394c14e4d1e3f88a7d42c2013b1d6219106: Status 404 returned error can't find the container with id c6c30ada40c65c01c256f3ac99b39394c14e4d1e3f88a7d42c2013b1d6219106 Jul 28 20:49:18.069701 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:18.069544 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" podStartSLOduration=1.313632036 podStartE2EDuration="3.069523517s" totalImagesPullingTime="1.755891481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:18.068705209 +0000 UTC m=+122.214735432" watchObservedRunningTime="2026-07-28 20:49:18.069523517 +0000 UTC m=+122.215553740" Jul 28 20:49:19.031251 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:19.031211 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5594f5fd-18bb-41c7-9b51-e0515706013b","Type":"ContainerStarted","Data":"f50a42e7ae15dafcadf1a975c049fd50b144783e02722035415fbc031a383eee"} Jul 28 20:49:19.033183 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:19.033158 2568 generic.go:356] "Generic (PLEG): container finished" podID="d8b68be3-5d79-4ce3-9d2a-b4b85abc8530" containerID="335a3ea562f1937cffc6c24f244fce4edbedaaa49a75feaafc444194cb0d0a05" exitCode=0 Jul 28 20:49:19.033305 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:19.033252 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerDied","Data":"335a3ea562f1937cffc6c24f244fce4edbedaaa49a75feaafc444194cb0d0a05"} Jul 28 20:49:19.033381 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:19.033333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"c6c30ada40c65c01c256f3ac99b39394c14e4d1e3f88a7d42c2013b1d6219106"} Jul 28 20:49:19.065504 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:19.064548 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.242921843 podStartE2EDuration="7.064528218s" totalImagesPullingTime="3.804264562s" totalInitContainerRuntime="17.341813ms" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:19.062489964 +0000 UTC m=+123.208520224" watchObservedRunningTime="2026-07-28 20:49:19.064528218 +0000 UTC m=+123.210558440" Jul 28 20:49:20.039259 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:20.039223 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" event={"ID":"dec67974-9bfa-4dc2-94f6-d686e4ddb30d","Type":"ContainerStarted","Data":"181e4ed189101d51995fb498b3f7677399cbd9202e6fc48d0ad7bdb611697265"} Jul 28 20:49:20.039671 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:20.039286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" event={"ID":"dec67974-9bfa-4dc2-94f6-d686e4ddb30d","Type":"ContainerStarted","Data":"8168a976f355d820b6db29b428d7efa7c216b3c07d3fac47f6dcc46ff55ba59d"} Jul 28 20:49:20.039671 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:20.039307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" event={"ID":"dec67974-9bfa-4dc2-94f6-d686e4ddb30d","Type":"ContainerStarted","Data":"5b49cc022aebadaac0cc25e28533bbb95677e560e536872d42ff814859336e3a"} Jul 28 20:49:20.064335 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:20.064283 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d76459ddb-8gq9t" podStartSLOduration=1.558706131 podStartE2EDuration="4.064265058s" totalImagesPullingTime="2.505558927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:20.062252837 +0000 UTC m=+124.208283060" watchObservedRunningTime="2026-07-28 20:49:20.064265058 +0000 UTC m=+124.210295279" Jul 28 20:49:21.476651 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.476614 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6474f854c8-8c7nb"] Jul 28 20:49:21.481222 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.481200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.490724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.490136 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 20:49:21.492786 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.492765 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6474f854c8-8c7nb"] Jul 28 20:49:21.570257 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-oauth-serving-cert\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.570257 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-oauth-config\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.570479 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-serving-cert\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.570479 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxpzh\" (UniqueName: \"kubernetes.io/projected/e03969ca-f761-4519-867e-fff9c41b67b2-kube-api-access-fxpzh\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.570479 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-console-config\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.570587 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-service-ca\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.570587 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.570574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-trusted-ca-bundle\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.671743 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-service-ca\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.671912 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-trusted-ca-bundle\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.671912 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-oauth-serving-cert\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.671912 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-oauth-config\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.671912 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-serving-cert\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.671912 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxpzh\" (UniqueName: \"kubernetes.io/projected/e03969ca-f761-4519-867e-fff9c41b67b2-kube-api-access-fxpzh\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.672167 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.671919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-console-config\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.672671 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.672609 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-service-ca\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.672671 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.672662 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-trusted-ca-bundle\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.672830 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.672764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-console-config\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.672830 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.672764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-oauth-serving-cert\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.674724 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.674699 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-oauth-config\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.675212 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.675188 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-serving-cert\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.682531 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.682507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxpzh\" (UniqueName: \"kubernetes.io/projected/e03969ca-f761-4519-867e-fff9c41b67b2-kube-api-access-fxpzh\") pod \"console-6474f854c8-8c7nb\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:21.792967 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:21.792832 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:22.569313 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:22.569285 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6474f854c8-8c7nb"] Jul 28 20:49:22.570883 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:22.570855 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03969ca_f761_4519_867e_fff9c41b67b2.slice/crio-ed4a65dc90653772a4280d1d581f46ee83d878518a1d42355c5ab18fbf5bcd47 WatchSource:0}: Error finding container ed4a65dc90653772a4280d1d581f46ee83d878518a1d42355c5ab18fbf5bcd47: Status 404 returned error can't find the container with id ed4a65dc90653772a4280d1d581f46ee83d878518a1d42355c5ab18fbf5bcd47 Jul 28 20:49:23.054368 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:23.054316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f854c8-8c7nb" event={"ID":"e03969ca-f761-4519-867e-fff9c41b67b2","Type":"ContainerStarted","Data":"0029281aa4023a8d399708e9f8c45fb1f3476b9ff988940d5d650f6c978bfce4"} Jul 28 20:49:23.054565 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:23.054413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f854c8-8c7nb" event={"ID":"e03969ca-f761-4519-867e-fff9c41b67b2","Type":"ContainerStarted","Data":"ed4a65dc90653772a4280d1d581f46ee83d878518a1d42355c5ab18fbf5bcd47"} Jul 28 20:49:23.056509 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:23.056479 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"c8397046b4c390580d632567443ef1f7620b54fa089fd304407733624a40d61f"} Jul 28 20:49:23.056619 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:23.056554 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"677d6e0b2a443a019a3e6836e072caaefaa11ad8c19f5cd666327de329aedbb1"} Jul 28 20:49:25.066990 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:25.066889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"7b9c452807ee28c8600fd4693a895b60b946068cae3eb500fbc5ea018d50572c"} Jul 28 20:49:25.066990 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:25.066969 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"f27df196763750a3d9fb56ea5c5abd6a881e0972ec2f68d26dc9af9ff8ec7bad"} Jul 28 20:49:25.067385 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:25.066997 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"815ae5b139560cfad56f5c41ed70ccfa8168700a8b30f8aabe56d0113e9bb98f"} Jul 28 20:49:25.067385 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:25.067023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8b68be3-5d79-4ce3-9d2a-b4b85abc8530","Type":"ContainerStarted","Data":"ae3d62d1f50ca018b28e34d8f40f2e1a40fd414027dd7c191496caca345d2ca5"} Jul 28 20:49:25.103932 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:25.103878 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6474f854c8-8c7nb" podStartSLOduration=4.103862149 podStartE2EDuration="4.103862149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:23.085059591 +0000 UTC m=+127.231089812" watchObservedRunningTime="2026-07-28 20:49:25.103862149 +0000 UTC m=+129.249892373" Jul 28 20:49:25.104768 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:25.104739 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.603987162 podStartE2EDuration="8.104730572s" totalImagesPullingTime="5.475465157s" totalInitContainerRuntime="25.278253ms" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:25.103292925 +0000 UTC m=+129.249323180" watchObservedRunningTime="2026-07-28 20:49:25.104730572 +0000 UTC m=+129.250760794" Jul 28 20:49:26.220076 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:26.220029 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:49:26.222987 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:26.222935 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e3b510d-1dde-47f4-9510-2cf8c0b6e619-metrics-certs\") pod \"network-metrics-daemon-knwvn\" (UID: \"5e3b510d-1dde-47f4-9510-2cf8c0b6e619\") " pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:49:26.391361 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:26.391330 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvjsj\"" Jul 28 20:49:26.398429 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:26.398405 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knwvn" Jul 28 20:49:26.528133 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:26.528110 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knwvn"] Jul 28 20:49:26.529935 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:49:26.529911 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3b510d_1dde_47f4_9510_2cf8c0b6e619.slice/crio-462e81f1af589ee31ef0f1dad2105f957fec3c7555c1480c1028d6f7725cd272 WatchSource:0}: Error finding container 462e81f1af589ee31ef0f1dad2105f957fec3c7555c1480c1028d6f7725cd272: Status 404 returned error can't find the container with id 462e81f1af589ee31ef0f1dad2105f957fec3c7555c1480c1028d6f7725cd272 Jul 28 20:49:27.077823 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:27.077785 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knwvn" event={"ID":"5e3b510d-1dde-47f4-9510-2cf8c0b6e619","Type":"ContainerStarted","Data":"462e81f1af589ee31ef0f1dad2105f957fec3c7555c1480c1028d6f7725cd272"} Jul 28 20:49:27.701358 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:27.701323 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:49:28.083237 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:28.083195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knwvn" event={"ID":"5e3b510d-1dde-47f4-9510-2cf8c0b6e619","Type":"ContainerStarted","Data":"bd4c1dc862497937464b1feaf8c30822fc538d6ced8fb483a78954b65af9851c"} Jul 28 20:49:28.083432 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:28.083278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knwvn" event={"ID":"5e3b510d-1dde-47f4-9510-2cf8c0b6e619","Type":"ContainerStarted","Data":"8165d0b83155a2dc14dc977a175e4e458b310cb3043d9b6a39dbf609cc3e19a6"} Jul 28 20:49:28.104197 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:28.104148 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-knwvn" podStartSLOduration=131.182549041 podStartE2EDuration="2m12.104133316s" totalImagesPullingTime="921.584275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:28.101671997 +0000 UTC m=+132.247702229" watchObservedRunningTime="2026-07-28 20:49:28.104133316 +0000 UTC m=+132.250163538" Jul 28 20:49:31.793368 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:31.793329 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:31.793798 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:31.793394 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:31.798228 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:31.798205 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:32.103533 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:32.103458 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:49:35.646139 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:35.646101 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:35.646575 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:35.646168 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:37.127060 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:37.127027 2568 generic.go:356] "Generic (PLEG): container finished" podID="9e1433ce-7054-4faa-9500-eaf7e4ba6f99" containerID="3fc843a829d3ec218c78e380f17281e27027a952a409ec8c9e2b58bdd73fe76c" exitCode=0 Jul 28 20:49:37.127421 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:37.127096 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" event={"ID":"9e1433ce-7054-4faa-9500-eaf7e4ba6f99","Type":"ContainerDied","Data":"3fc843a829d3ec218c78e380f17281e27027a952a409ec8c9e2b58bdd73fe76c"} Jul 28 20:49:37.127468 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:37.127422 2568 scope.go:117] "RemoveContainer" containerID="3fc843a829d3ec218c78e380f17281e27027a952a409ec8c9e2b58bdd73fe76c" Jul 28 20:49:38.134874 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:38.134836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6" event={"ID":"9e1433ce-7054-4faa-9500-eaf7e4ba6f99","Type":"ContainerStarted","Data":"99ee907062163277a5b0412897e80d62dbadc28638f406977ebbaa10cd8ff1ca"} Jul 28 20:49:40.811287 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:40.811230 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fd4b78c87-fb9b6" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerName="console" containerID="cri-o://36b76020baedc2f7ff14397ae789fc15e3955d6d796db910b3260087d2ac552e" gracePeriod=15 Jul 28 20:49:41.148918 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.148885 2568 generic.go:356] "Generic (PLEG): container finished" podID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerID="36b76020baedc2f7ff14397ae789fc15e3955d6d796db910b3260087d2ac552e" exitCode=0 Jul 28 20:49:41.149089 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.148976 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd4b78c87-fb9b6" event={"ID":"872b166f-131b-4f06-a1be-2210e25e0bb7","Type":"ContainerDied","Data":"36b76020baedc2f7ff14397ae789fc15e3955d6d796db910b3260087d2ac552e"} Jul 28 20:49:41.629402 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.629366 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:49:41.765005 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.764979 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrcgt\" (UniqueName: \"kubernetes.io/projected/872b166f-131b-4f06-a1be-2210e25e0bb7-kube-api-access-lrcgt\") pod \"872b166f-131b-4f06-a1be-2210e25e0bb7\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " Jul 28 20:49:41.765136 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765031 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-oauth-serving-cert\") pod \"872b166f-131b-4f06-a1be-2210e25e0bb7\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " Jul 28 20:49:41.765136 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765095 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-console-config\") pod \"872b166f-131b-4f06-a1be-2210e25e0bb7\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " Jul 28 20:49:41.765136 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765131 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-oauth-config\") pod \"872b166f-131b-4f06-a1be-2210e25e0bb7\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " Jul 28 20:49:41.765308 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765188 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-serving-cert\") pod \"872b166f-131b-4f06-a1be-2210e25e0bb7\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " Jul 28 20:49:41.765308 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765231 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-service-ca\") pod \"872b166f-131b-4f06-a1be-2210e25e0bb7\" (UID: \"872b166f-131b-4f06-a1be-2210e25e0bb7\") " Jul 28 20:49:41.765435 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765413 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "872b166f-131b-4f06-a1be-2210e25e0bb7" (UID: "872b166f-131b-4f06-a1be-2210e25e0bb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:49:41.765493 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765455 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-console-config" (OuterVolumeSpecName: "console-config") pod "872b166f-131b-4f06-a1be-2210e25e0bb7" (UID: "872b166f-131b-4f06-a1be-2210e25e0bb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:49:41.765544 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765507 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-oauth-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:41.765687 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.765654 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "872b166f-131b-4f06-a1be-2210e25e0bb7" (UID: "872b166f-131b-4f06-a1be-2210e25e0bb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:49:41.767466 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.767433 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "872b166f-131b-4f06-a1be-2210e25e0bb7" (UID: "872b166f-131b-4f06-a1be-2210e25e0bb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 20:49:41.767466 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.767458 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "872b166f-131b-4f06-a1be-2210e25e0bb7" (UID: "872b166f-131b-4f06-a1be-2210e25e0bb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 20:49:41.767590 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.767462 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/872b166f-131b-4f06-a1be-2210e25e0bb7-kube-api-access-lrcgt" (OuterVolumeSpecName: "kube-api-access-lrcgt") pod "872b166f-131b-4f06-a1be-2210e25e0bb7" (UID: "872b166f-131b-4f06-a1be-2210e25e0bb7"). InnerVolumeSpecName "kube-api-access-lrcgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 20:49:41.866773 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.866733 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-console-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:41.866773 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.866765 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-oauth-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:41.866773 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.866779 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/872b166f-131b-4f06-a1be-2210e25e0bb7-console-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:41.867244 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.866791 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/872b166f-131b-4f06-a1be-2210e25e0bb7-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:41.867244 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:41.866803 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrcgt\" (UniqueName: \"kubernetes.io/projected/872b166f-131b-4f06-a1be-2210e25e0bb7-kube-api-access-lrcgt\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:42.154587 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.154549 2568 generic.go:356] "Generic (PLEG): container finished" podID="6cda6ef2-61d7-4c16-b68b-f91652d1cb92" containerID="ace5fc0f1e630d1eddb463153f6e4f7c1a8fb68b9910e09ae194fa8d68737b2b" exitCode=0 Jul 28 20:49:42.154785 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.154621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" event={"ID":"6cda6ef2-61d7-4c16-b68b-f91652d1cb92","Type":"ContainerDied","Data":"ace5fc0f1e630d1eddb463153f6e4f7c1a8fb68b9910e09ae194fa8d68737b2b"} Jul 28 20:49:42.155054 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.155031 2568 scope.go:117] "RemoveContainer" containerID="ace5fc0f1e630d1eddb463153f6e4f7c1a8fb68b9910e09ae194fa8d68737b2b" Jul 28 20:49:42.156012 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.155989 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd4b78c87-fb9b6" event={"ID":"872b166f-131b-4f06-a1be-2210e25e0bb7","Type":"ContainerDied","Data":"0e0ad18bd0db6842820210e7faf00239070dc91f97fdcd1eefbc59450087509b"} Jul 28 20:49:42.156114 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.156021 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd4b78c87-fb9b6" Jul 28 20:49:42.156114 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.156032 2568 scope.go:117] "RemoveContainer" containerID="36b76020baedc2f7ff14397ae789fc15e3955d6d796db910b3260087d2ac552e" Jul 28 20:49:42.186498 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.186469 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd4b78c87-fb9b6"] Jul 28 20:49:42.193201 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.193179 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fd4b78c87-fb9b6"] Jul 28 20:49:42.375600 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.375567 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" path="/var/lib/kubelet/pods/872b166f-131b-4f06-a1be-2210e25e0bb7/volumes" Jul 28 20:49:42.822333 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:42.822295 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" podUID="12372d67-ea1e-4e88-8e3a-594da50417ea" containerName="registry" containerID="cri-o://1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca" gracePeriod=30 Jul 28 20:49:43.072192 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.072165 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:49:43.162029 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.161985 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ftr5d" event={"ID":"6cda6ef2-61d7-4c16-b68b-f91652d1cb92","Type":"ContainerStarted","Data":"cb2bc43b520e250fb23b8fd41f90583c6044f3f15da4ad01f9ec4269b13f9ddb"} Jul 28 20:49:43.164097 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.164075 2568 generic.go:356] "Generic (PLEG): container finished" podID="12372d67-ea1e-4e88-8e3a-594da50417ea" containerID="1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca" exitCode=0 Jul 28 20:49:43.164173 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.164108 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" Jul 28 20:49:43.164173 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.164141 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" event={"ID":"12372d67-ea1e-4e88-8e3a-594da50417ea","Type":"ContainerDied","Data":"1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca"} Jul 28 20:49:43.164251 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.164190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65655f5f66-nkj6w" event={"ID":"12372d67-ea1e-4e88-8e3a-594da50417ea","Type":"ContainerDied","Data":"95a404eeeb3ea0b9d0481f28ce6b6dc041d442baa4695417d28616dbd410a1cd"} Jul 28 20:49:43.164251 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.164217 2568 scope.go:117] "RemoveContainer" containerID="1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca" Jul 28 20:49:43.172532 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.172517 2568 scope.go:117] "RemoveContainer" containerID="1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca" Jul 28 20:49:43.172765 ip-10-0-134-221 kubenswrapper[2568]: E0728 20:49:43.172745 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca\": container with ID starting with 1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca not found: ID does not exist" containerID="1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca" Jul 28 20:49:43.172821 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.172774 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca"} err="failed to get container status \"1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca\": rpc error: code = NotFound desc = could not find container \"1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca\": container with ID starting with 1f7a9c812e9deb6ec137be90fc2072d8597f9832373958d907acdf7079e2d9ca not found: ID does not exist" Jul 28 20:49:43.178067 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178049 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-image-registry-private-configuration\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178114 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178087 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-bound-sa-token\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178114 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178107 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-certificates\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178179 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178134 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-trusted-ca\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178179 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178162 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12372d67-ea1e-4e88-8e3a-594da50417ea-ca-trust-extracted\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178255 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178205 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178304 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178266 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csrl5\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-kube-api-access-csrl5\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178355 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178299 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-installation-pull-secrets\") pod \"12372d67-ea1e-4e88-8e3a-594da50417ea\" (UID: \"12372d67-ea1e-4e88-8e3a-594da50417ea\") " Jul 28 20:49:43.178584 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178553 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:49:43.178665 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.178624 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:49:43.180646 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.180618 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 20:49:43.180769 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.180739 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-kube-api-access-csrl5" (OuterVolumeSpecName: "kube-api-access-csrl5") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "kube-api-access-csrl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 20:49:43.180848 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.180829 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 20:49:43.180963 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.180924 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 20:49:43.181008 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.180942 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 20:49:43.188792 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.188766 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12372d67-ea1e-4e88-8e3a-594da50417ea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "12372d67-ea1e-4e88-8e3a-594da50417ea" (UID: "12372d67-ea1e-4e88-8e3a-594da50417ea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 20:49:43.279489 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279453 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csrl5\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-kube-api-access-csrl5\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279489 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279486 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-installation-pull-secrets\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279694 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279504 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12372d67-ea1e-4e88-8e3a-594da50417ea-image-registry-private-configuration\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279694 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279517 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-bound-sa-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279694 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279531 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-certificates\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279694 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279543 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12372d67-ea1e-4e88-8e3a-594da50417ea-trusted-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279694 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279555 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12372d67-ea1e-4e88-8e3a-594da50417ea-ca-trust-extracted\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.279694 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.279566 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12372d67-ea1e-4e88-8e3a-594da50417ea-registry-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:49:43.490933 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.490900 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65655f5f66-nkj6w"] Jul 28 20:49:43.496307 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:43.496284 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65655f5f66-nkj6w"] Jul 28 20:49:44.375178 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:44.375145 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12372d67-ea1e-4e88-8e3a-594da50417ea" path="/var/lib/kubelet/pods/12372d67-ea1e-4e88-8e3a-594da50417ea/volumes" Jul 28 20:49:55.650939 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:55.650899 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:49:55.654557 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:49:55.654532 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56847789d6-grcz4" Jul 28 20:50:17.700591 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:50:17.700544 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:50:17.719243 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:50:17.719217 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:50:18.326934 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:50:18.326907 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 20:50:49.281789 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:50:49.281750 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6474f854c8-8c7nb"] Jul 28 20:51:14.301936 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.301870 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6474f854c8-8c7nb" podUID="e03969ca-f761-4519-867e-fff9c41b67b2" containerName="console" containerID="cri-o://0029281aa4023a8d399708e9f8c45fb1f3476b9ff988940d5d650f6c978bfce4" gracePeriod=15 Jul 28 20:51:14.532071 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.532038 2568 generic.go:356] "Generic (PLEG): container finished" podID="e03969ca-f761-4519-867e-fff9c41b67b2" containerID="0029281aa4023a8d399708e9f8c45fb1f3476b9ff988940d5d650f6c978bfce4" exitCode=0 Jul 28 20:51:14.532216 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.532091 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f854c8-8c7nb" event={"ID":"e03969ca-f761-4519-867e-fff9c41b67b2","Type":"ContainerDied","Data":"0029281aa4023a8d399708e9f8c45fb1f3476b9ff988940d5d650f6c978bfce4"} Jul 28 20:51:14.568651 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.568626 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:51:14.641696 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.641658 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-oauth-config\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.641696 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.641699 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-trusted-ca-bundle\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.641896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.641739 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-serving-cert\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.641896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.641754 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-console-config\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.641896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.641805 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-oauth-serving-cert\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.641896 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.641836 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxpzh\" (UniqueName: \"kubernetes.io/projected/e03969ca-f761-4519-867e-fff9c41b67b2-kube-api-access-fxpzh\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.642115 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642001 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-service-ca\") pod \"e03969ca-f761-4519-867e-fff9c41b67b2\" (UID: \"e03969ca-f761-4519-867e-fff9c41b67b2\") " Jul 28 20:51:14.642289 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642224 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-console-config" (OuterVolumeSpecName: "console-config") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:51:14.642289 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642241 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:51:14.642289 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642231 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:51:14.642504 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642329 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-trusted-ca-bundle\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:14.642504 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642349 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-console-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:14.642504 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642365 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-oauth-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:14.642651 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.642570 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 20:51:14.643806 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.643782 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 20:51:14.644296 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.644275 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e03969ca-f761-4519-867e-fff9c41b67b2-kube-api-access-fxpzh" (OuterVolumeSpecName: "kube-api-access-fxpzh") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "kube-api-access-fxpzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 20:51:14.644296 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.644288 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e03969ca-f761-4519-867e-fff9c41b67b2" (UID: "e03969ca-f761-4519-867e-fff9c41b67b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 20:51:14.743197 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.743162 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:14.743197 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.743190 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxpzh\" (UniqueName: \"kubernetes.io/projected/e03969ca-f761-4519-867e-fff9c41b67b2-kube-api-access-fxpzh\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:14.743197 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.743200 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e03969ca-f761-4519-867e-fff9c41b67b2-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:14.743415 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:14.743211 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e03969ca-f761-4519-867e-fff9c41b67b2-console-oauth-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 20:51:15.537172 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:15.537141 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f854c8-8c7nb" event={"ID":"e03969ca-f761-4519-867e-fff9c41b67b2","Type":"ContainerDied","Data":"ed4a65dc90653772a4280d1d581f46ee83d878518a1d42355c5ab18fbf5bcd47"} Jul 28 20:51:15.537564 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:15.537190 2568 scope.go:117] "RemoveContainer" containerID="0029281aa4023a8d399708e9f8c45fb1f3476b9ff988940d5d650f6c978bfce4" Jul 28 20:51:15.537564 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:15.537149 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f854c8-8c7nb" Jul 28 20:51:15.557386 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:15.557360 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6474f854c8-8c7nb"] Jul 28 20:51:15.560164 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:15.560144 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6474f854c8-8c7nb"] Jul 28 20:51:16.374490 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:16.374455 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e03969ca-f761-4519-867e-fff9c41b67b2" path="/var/lib/kubelet/pods/e03969ca-f761-4519-867e-fff9c41b67b2/volumes" Jul 28 20:51:40.845994 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.845941 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k7rjp"] Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846263 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03969ca-f761-4519-867e-fff9c41b67b2" containerName="console" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846273 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03969ca-f761-4519-867e-fff9c41b67b2" containerName="console" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846291 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12372d67-ea1e-4e88-8e3a-594da50417ea" containerName="registry" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846297 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="12372d67-ea1e-4e88-8e3a-594da50417ea" containerName="registry" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846308 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerName="console" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846314 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerName="console" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846366 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="872b166f-131b-4f06-a1be-2210e25e0bb7" containerName="console" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846374 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e03969ca-f761-4519-867e-fff9c41b67b2" containerName="console" Jul 28 20:51:40.846462 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.846381 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="12372d67-ea1e-4e88-8e3a-594da50417ea" containerName="registry" Jul 28 20:51:40.849227 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.849211 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:40.851857 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.851824 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 20:51:40.851857 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.851843 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 20:51:40.852058 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.851862 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5vmtr\"" Jul 28 20:51:40.857857 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.857834 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k7rjp"] Jul 28 20:51:40.959169 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.959132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-665p2\" (UniqueName: \"kubernetes.io/projected/bbe58642-823a-4321-a89c-3393249ddf2f-kube-api-access-665p2\") pod \"cert-manager-webhook-6486ffd997-k7rjp\" (UID: \"bbe58642-823a-4321-a89c-3393249ddf2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:40.959341 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:40.959188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbe58642-823a-4321-a89c-3393249ddf2f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k7rjp\" (UID: \"bbe58642-823a-4321-a89c-3393249ddf2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:41.059744 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.059709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-665p2\" (UniqueName: \"kubernetes.io/projected/bbe58642-823a-4321-a89c-3393249ddf2f-kube-api-access-665p2\") pod \"cert-manager-webhook-6486ffd997-k7rjp\" (UID: \"bbe58642-823a-4321-a89c-3393249ddf2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:41.059940 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.059757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbe58642-823a-4321-a89c-3393249ddf2f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k7rjp\" (UID: \"bbe58642-823a-4321-a89c-3393249ddf2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:41.068282 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.068255 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbe58642-823a-4321-a89c-3393249ddf2f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k7rjp\" (UID: \"bbe58642-823a-4321-a89c-3393249ddf2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:41.068479 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.068456 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-665p2\" (UniqueName: \"kubernetes.io/projected/bbe58642-823a-4321-a89c-3393249ddf2f-kube-api-access-665p2\") pod \"cert-manager-webhook-6486ffd997-k7rjp\" (UID: \"bbe58642-823a-4321-a89c-3393249ddf2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:41.158716 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.158679 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:41.287494 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.287470 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k7rjp"] Jul 28 20:51:41.289782 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:51:41.289752 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbe58642_823a_4321_a89c_3393249ddf2f.slice/crio-e22de5ac2f78306dbd9e97b8fbdfcfbd58d91da09849b094c24cd4af07953db0 WatchSource:0}: Error finding container e22de5ac2f78306dbd9e97b8fbdfcfbd58d91da09849b094c24cd4af07953db0: Status 404 returned error can't find the container with id e22de5ac2f78306dbd9e97b8fbdfcfbd58d91da09849b094c24cd4af07953db0 Jul 28 20:51:41.639314 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:41.639278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" event={"ID":"bbe58642-823a-4321-a89c-3393249ddf2f","Type":"ContainerStarted","Data":"e22de5ac2f78306dbd9e97b8fbdfcfbd58d91da09849b094c24cd4af07953db0"} Jul 28 20:51:44.656853 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:44.656820 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" event={"ID":"bbe58642-823a-4321-a89c-3393249ddf2f","Type":"ContainerStarted","Data":"6010cabb2761f794162db0c5804da6d79a093f644b504b4a97113e27e23c611a"} Jul 28 20:51:44.657345 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:44.656899 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:51:44.674295 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:44.674249 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" podStartSLOduration=1.374051045 podStartE2EDuration="4.674231636s" totalImagesPullingTime="3.300180591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:51:44.672866346 +0000 UTC m=+268.818896588" watchObservedRunningTime="2026-07-28 20:51:44.674231636 +0000 UTC m=+268.820261858" Jul 28 20:51:50.666055 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:51:50.666013 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k7rjp" Jul 28 20:52:07.148045 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.148009 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2"] Jul 28 20:52:07.151633 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.151614 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.155737 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.155716 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 28 20:52:07.155857 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.155759 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sbqvl\"" Jul 28 20:52:07.156024 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.156010 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 28 20:52:07.156314 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.156299 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 20:52:07.156621 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.156607 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 20:52:07.180741 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.180711 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2"] Jul 28 20:52:07.277613 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.277575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.277791 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.277633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pnj\" (UniqueName: \"kubernetes.io/projected/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-kube-api-access-z9pnj\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.277791 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.277682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.277791 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.277718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-manifests\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.277791 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.277736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-tmp\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.379128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.379089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-manifests\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.379128 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.379130 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-tmp\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.379341 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.379162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.379341 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.379201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pnj\" (UniqueName: \"kubernetes.io/projected/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-kube-api-access-z9pnj\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.379341 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.379225 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.379578 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.379547 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-manifests\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.381526 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.381492 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-tmp\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.381630 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.381617 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.381672 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.381636 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.394437 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.394406 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pnj\" (UniqueName: \"kubernetes.io/projected/fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453-kube-api-access-z9pnj\") pod \"opendatahub-operator-controller-manager-6cc774576c-7nwf2\" (UID: \"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.461914 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.461833 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:07.685333 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.685308 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2"] Jul 28 20:52:07.687998 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:52:07.687972 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa51513f_bc9f_4c7b_9dfd_9c9ee8c44453.slice/crio-0c658d9a6fabf907fd9f7d0d710688c4ff0688b2d197de574994fc9b38d6c557 WatchSource:0}: Error finding container 0c658d9a6fabf907fd9f7d0d710688c4ff0688b2d197de574994fc9b38d6c557: Status 404 returned error can't find the container with id 0c658d9a6fabf907fd9f7d0d710688c4ff0688b2d197de574994fc9b38d6c557 Jul 28 20:52:07.747240 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:07.747154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" event={"ID":"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453","Type":"ContainerStarted","Data":"0c658d9a6fabf907fd9f7d0d710688c4ff0688b2d197de574994fc9b38d6c557"} Jul 28 20:52:10.764748 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:10.764711 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" event={"ID":"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453","Type":"ContainerStarted","Data":"05b19a5f4ae6798b4f00fcae6c4cff983ae89f2734b91954cec4115e8b331fe5"} Jul 28 20:52:11.770345 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:11.770308 2568 generic.go:356] "Generic (PLEG): container finished" podID="fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453" containerID="05b19a5f4ae6798b4f00fcae6c4cff983ae89f2734b91954cec4115e8b331fe5" exitCode=0 Jul 28 20:52:11.770709 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:11.770393 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" event={"ID":"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453","Type":"ContainerDied","Data":"05b19a5f4ae6798b4f00fcae6c4cff983ae89f2734b91954cec4115e8b331fe5"} Jul 28 20:52:12.776327 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:12.776289 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" event={"ID":"fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453","Type":"ContainerStarted","Data":"cb71615ee67e0f38bc001f2a244e21e52f4ab87c2bdfd3e31a8a083437efed38"} Jul 28 20:52:12.776706 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:12.776400 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:12.799469 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:12.799421 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" podStartSLOduration=1.4579904830000001 podStartE2EDuration="5.799403654s" totalImagesPullingTime="3.249662929s" totalInitContainerRuntime="1.091750242s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:12.797978272 +0000 UTC m=+296.944008495" watchObservedRunningTime="2026-07-28 20:52:12.799403654 +0000 UTC m=+296.945433875" Jul 28 20:52:16.277513 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:16.277473 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:52:16.285577 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:16.285555 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:52:16.288824 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:16.288802 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 20:52:23.783415 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:23.783386 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc774576c-7nwf2" Jul 28 20:52:27.148430 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.148394 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc"] Jul 28 20:52:27.151395 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.151375 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.153821 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.153798 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 28 20:52:27.153977 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.153934 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 28 20:52:27.154905 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.154886 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 28 20:52:27.155160 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.155138 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 28 20:52:27.155255 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.155155 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 28 20:52:27.155319 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.155290 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lh2n2\"" Jul 28 20:52:27.163140 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.163120 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc"] Jul 28 20:52:27.252089 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.252051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p92hn\" (UniqueName: \"kubernetes.io/projected/4cef19aa-524b-4148-94e7-33b768e55a27-kube-api-access-p92hn\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.252258 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.252102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cef19aa-524b-4148-94e7-33b768e55a27-cert\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.252258 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.252217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cef19aa-524b-4148-94e7-33b768e55a27-manager-config\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.252338 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.252311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cef19aa-524b-4148-94e7-33b768e55a27-metrics-cert\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.352855 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.352822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cef19aa-524b-4148-94e7-33b768e55a27-metrics-cert\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.352855 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.352866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p92hn\" (UniqueName: \"kubernetes.io/projected/4cef19aa-524b-4148-94e7-33b768e55a27-kube-api-access-p92hn\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.353111 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.352890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cef19aa-524b-4148-94e7-33b768e55a27-cert\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.353111 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.352966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cef19aa-524b-4148-94e7-33b768e55a27-manager-config\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.353635 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.353604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cef19aa-524b-4148-94e7-33b768e55a27-manager-config\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.355381 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.355357 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cef19aa-524b-4148-94e7-33b768e55a27-cert\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.355476 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.355383 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cef19aa-524b-4148-94e7-33b768e55a27-metrics-cert\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.378641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.378604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p92hn\" (UniqueName: \"kubernetes.io/projected/4cef19aa-524b-4148-94e7-33b768e55a27-kube-api-access-p92hn\") pod \"lws-controller-manager-bb9684f66-srhfc\" (UID: \"4cef19aa-524b-4148-94e7-33b768e55a27\") " pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.460365 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.460288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:27.606210 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.606182 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc"] Jul 28 20:52:27.609534 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:52:27.609509 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cef19aa_524b_4148_94e7_33b768e55a27.slice/crio-9f5c25eedcebaab4ac3492bd170978283d1671e451f5fe9e618180dea1c3982a WatchSource:0}: Error finding container 9f5c25eedcebaab4ac3492bd170978283d1671e451f5fe9e618180dea1c3982a: Status 404 returned error can't find the container with id 9f5c25eedcebaab4ac3492bd170978283d1671e451f5fe9e618180dea1c3982a Jul 28 20:52:27.611696 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.611677 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 20:52:27.844935 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:27.844845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" event={"ID":"4cef19aa-524b-4148-94e7-33b768e55a27","Type":"ContainerStarted","Data":"9f5c25eedcebaab4ac3492bd170978283d1671e451f5fe9e618180dea1c3982a"} Jul 28 20:52:30.866684 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:30.866649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" event={"ID":"4cef19aa-524b-4148-94e7-33b768e55a27","Type":"ContainerStarted","Data":"4e797467fcaa704caeec6032b663196d0cef4c3759cf1d3fcb8eef4b6158b6cc"} Jul 28 20:52:30.867089 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:30.866883 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:52:30.885439 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:30.885395 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" podStartSLOduration=1.613561585 podStartE2EDuration="3.885380278s" totalImagesPullingTime="2.271818693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:30.884257442 +0000 UTC m=+315.030287677" watchObservedRunningTime="2026-07-28 20:52:30.885380278 +0000 UTC m=+315.031410500" Jul 28 20:52:33.601795 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.601754 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx"] Jul 28 20:52:33.605928 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.605906 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.608752 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.608730 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 20:52:33.608838 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.608730 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 20:52:33.609047 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.609028 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 28 20:52:33.609295 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.609276 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m6lx7\"" Jul 28 20:52:33.618326 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.618307 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx"] Jul 28 20:52:33.712626 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712587 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.712626 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.712863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.712863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703c4e3b-14aa-4b40-8e78-d62de6c49885-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.712863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.712863 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712841 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.713062 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzhbm\" (UniqueName: \"kubernetes.io/projected/703c4e3b-14aa-4b40-8e78-d62de6c49885-kube-api-access-xzhbm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.713062 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.713062 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.712923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814383 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814348 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814577 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703c4e3b-14aa-4b40-8e78-d62de6c49885-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814577 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814702 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814702 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzhbm\" (UniqueName: \"kubernetes.io/projected/703c4e3b-14aa-4b40-8e78-d62de6c49885-kube-api-access-xzhbm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814702 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814905 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814905 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814905 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814820 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.814905 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.814824 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.815126 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.815089 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.815550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.815242 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.815550 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.815439 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703c4e3b-14aa-4b40-8e78-d62de6c49885-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.815774 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.815749 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.817553 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.817524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.817689 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.817574 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.824269 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.824245 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703c4e3b-14aa-4b40-8e78-d62de6c49885-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.824742 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.824725 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzhbm\" (UniqueName: \"kubernetes.io/projected/703c4e3b-14aa-4b40-8e78-d62de6c49885-kube-api-access-xzhbm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx\" (UID: \"703c4e3b-14aa-4b40-8e78-d62de6c49885\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:33.917982 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:33.917933 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:34.058587 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:34.058521 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx"] Jul 28 20:52:34.061129 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:52:34.061106 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703c4e3b_14aa_4b40_8e78_d62de6c49885.slice/crio-3f9478b232c012824abc139aa00fbea37000622e4eab487ea252e939105dd782 WatchSource:0}: Error finding container 3f9478b232c012824abc139aa00fbea37000622e4eab487ea252e939105dd782: Status 404 returned error can't find the container with id 3f9478b232c012824abc139aa00fbea37000622e4eab487ea252e939105dd782 Jul 28 20:52:34.886379 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:34.886335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" event={"ID":"703c4e3b-14aa-4b40-8e78-d62de6c49885","Type":"ContainerStarted","Data":"3f9478b232c012824abc139aa00fbea37000622e4eab487ea252e939105dd782"} Jul 28 20:52:35.524168 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.524122 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787"] Jul 28 20:52:35.528082 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.528053 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.531757 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.531730 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 28 20:52:35.531918 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.531764 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 28 20:52:35.531918 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.531764 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-264pc\"" Jul 28 20:52:35.531918 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.531767 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 28 20:52:35.543165 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.543140 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787"] Jul 28 20:52:35.634474 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.634648 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.634648 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.634648 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.634818 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.634818 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.634818 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.634758 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltdfw\" (UniqueName: \"kubernetes.io/projected/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-kube-api-access-ltdfw\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736031 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.735994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736031 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.736032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736280 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.736165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736280 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.736256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736443 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.736299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736443 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.736322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.736443 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.736341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltdfw\" (UniqueName: \"kubernetes.io/projected/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-kube-api-access-ltdfw\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.737100 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.737048 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.738832 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.738807 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.739007 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.738986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.739223 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.739204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.739373 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.739356 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.746845 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.746823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.747102 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.747084 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltdfw\" (UniqueName: \"kubernetes.io/projected/c1aff8ca-43bd-415b-a1d5-7293db4f92ff-kube-api-access-ltdfw\") pod \"istiod-openshift-gateway-5677ccb49b-qp787\" (UID: \"c1aff8ca-43bd-415b-a1d5-7293db4f92ff\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:35.841831 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:35.841739 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:36.848542 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:36.848501 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 20:52:36.848879 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:36.848580 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 20:52:36.848879 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:36.848609 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 20:52:36.919190 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:36.919162 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787"] Jul 28 20:52:36.922150 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:52:36.922125 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1aff8ca_43bd_415b_a1d5_7293db4f92ff.slice/crio-b55e45212252626c050354f0f6697e63a464653fb614c3756ab62ac37e57e210 WatchSource:0}: Error finding container b55e45212252626c050354f0f6697e63a464653fb614c3756ab62ac37e57e210: Status 404 returned error can't find the container with id b55e45212252626c050354f0f6697e63a464653fb614c3756ab62ac37e57e210 Jul 28 20:52:37.903234 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:37.903196 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" event={"ID":"c1aff8ca-43bd-415b-a1d5-7293db4f92ff","Type":"ContainerStarted","Data":"b55e45212252626c050354f0f6697e63a464653fb614c3756ab62ac37e57e210"} Jul 28 20:52:37.905018 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:37.904989 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" event={"ID":"703c4e3b-14aa-4b40-8e78-d62de6c49885","Type":"ContainerStarted","Data":"627b9e7ceb4725f4f480e12dc2ef2ab6053b58f714aa79482c42aa5ce89781fc"} Jul 28 20:52:37.918267 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:37.918176 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:37.923903 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:37.923877 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:37.934851 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:37.934795 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" podStartSLOduration=2.149957762 podStartE2EDuration="4.934774294s" totalImagesPullingTime="2.784816532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:37.93261728 +0000 UTC m=+322.078647561" watchObservedRunningTime="2026-07-28 20:52:37.934774294 +0000 UTC m=+322.080804517" Jul 28 20:52:38.911167 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:38.911121 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:38.912298 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:38.912274 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx" Jul 28 20:52:39.433846 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:39.433816 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 20:52:39.433928 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:39.433882 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 20:52:39.918247 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:39.918209 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" event={"ID":"c1aff8ca-43bd-415b-a1d5-7293db4f92ff","Type":"ContainerStarted","Data":"8065331d8c87f8ba204de8d11c2f555b575933a3cdeed10abf453e72fbb96965"} Jul 28 20:52:40.922815 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:40.922768 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:40.924332 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:40.924309 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" Jul 28 20:52:40.946763 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:40.946716 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qp787" podStartSLOduration=3.438023278 podStartE2EDuration="5.946701226s" totalImagesPullingTime="2.508677948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:52:39.958432884 +0000 UTC m=+324.104463134" watchObservedRunningTime="2026-07-28 20:52:40.946701226 +0000 UTC m=+325.092731448" Jul 28 20:52:41.872930 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:52:41.872899 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bb9684f66-srhfc" Jul 28 20:54:18.321561 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.321529 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf"] Jul 28 20:54:18.325031 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.325010 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.327645 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.327623 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngpxq\"" Jul 28 20:54:18.327791 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.327771 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 28 20:54:18.327841 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.327818 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 28 20:54:18.337394 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.337373 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf"] Jul 28 20:54:18.356248 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.356223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25mxw\" (UniqueName: \"kubernetes.io/projected/c21dd4a9-87c8-4952-94b4-fdb7850c111b-kube-api-access-25mxw\") pod \"kuadrant-operator-controller-manager-86878c769f-d8wcf\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.356351 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.356303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c21dd4a9-87c8-4952-94b4-fdb7850c111b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d8wcf\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.457417 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.457380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c21dd4a9-87c8-4952-94b4-fdb7850c111b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d8wcf\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.457596 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.457481 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25mxw\" (UniqueName: \"kubernetes.io/projected/c21dd4a9-87c8-4952-94b4-fdb7850c111b-kube-api-access-25mxw\") pod \"kuadrant-operator-controller-manager-86878c769f-d8wcf\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.457774 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.457753 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c21dd4a9-87c8-4952-94b4-fdb7850c111b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d8wcf\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.474294 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.474266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25mxw\" (UniqueName: \"kubernetes.io/projected/c21dd4a9-87c8-4952-94b4-fdb7850c111b-kube-api-access-25mxw\") pod \"kuadrant-operator-controller-manager-86878c769f-d8wcf\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.635564 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.635532 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:18.766657 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:18.766632 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf"] Jul 28 20:54:18.769594 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:54:18.769570 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21dd4a9_87c8_4952_94b4_fdb7850c111b.slice/crio-1953a6f3cc8f7ed56fc11bd75bb44ff603fc63a84d3db114550dd8983f6b52ec WatchSource:0}: Error finding container 1953a6f3cc8f7ed56fc11bd75bb44ff603fc63a84d3db114550dd8983f6b52ec: Status 404 returned error can't find the container with id 1953a6f3cc8f7ed56fc11bd75bb44ff603fc63a84d3db114550dd8983f6b52ec Jul 28 20:54:19.356753 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:19.356717 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" event={"ID":"c21dd4a9-87c8-4952-94b4-fdb7850c111b","Type":"ContainerStarted","Data":"1953a6f3cc8f7ed56fc11bd75bb44ff603fc63a84d3db114550dd8983f6b52ec"} Jul 28 20:54:23.381404 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:23.381365 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" event={"ID":"c21dd4a9-87c8-4952-94b4-fdb7850c111b","Type":"ContainerStarted","Data":"e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198"} Jul 28 20:54:23.381815 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:23.381455 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:54:23.402750 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:23.402699 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" podStartSLOduration=1.465441191 podStartE2EDuration="5.402683182s" totalImagesPullingTime="3.937241991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:54:23.399537589 +0000 UTC m=+427.545567813" watchObservedRunningTime="2026-07-28 20:54:23.402683182 +0000 UTC m=+427.548713403" Jul 28 20:54:34.387794 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:54:34.387764 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 20:56:38.855153 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.855081 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b"] Jul 28 20:56:38.858644 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.858622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:38.861175 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.861153 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 28 20:56:38.861175 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.861181 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 28 20:56:38.862088 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.862065 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 28 20:56:38.862177 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.862076 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mv9qw\"" Jul 28 20:56:38.871419 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.871397 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b"] Jul 28 20:56:38.908564 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.908540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:38.908677 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.908572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:38.908677 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.908667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:38.908798 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.908712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:38.908798 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.908760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ntsp\" (UniqueName: \"kubernetes.io/projected/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-kube-api-access-2ntsp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:38.908900 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:38.908834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009423 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009582 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ntsp\" (UniqueName: \"kubernetes.io/projected/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-kube-api-access-2ntsp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009848 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009821 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.009915 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009847 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.010007 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.009987 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.011680 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.011659 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.011782 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.011764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.017405 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.017386 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ntsp\" (UniqueName: \"kubernetes.io/projected/dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc-kube-api-access-2ntsp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x5x6b\" (UID: \"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.168641 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.168607 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:39.297749 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.297726 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b"] Jul 28 20:56:39.299908 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:56:39.299881 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb59b61_ab4c_48d9_b5a9_714cc9bb57bc.slice/crio-ca93a97272436be69d83147c83759209d1b710212b86b7140876dd701393873f WatchSource:0}: Error finding container ca93a97272436be69d83147c83759209d1b710212b86b7140876dd701393873f: Status 404 returned error can't find the container with id ca93a97272436be69d83147c83759209d1b710212b86b7140876dd701393873f Jul 28 20:56:39.993372 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:39.993336 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" event={"ID":"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc","Type":"ContainerStarted","Data":"ca93a97272436be69d83147c83759209d1b710212b86b7140876dd701393873f"} Jul 28 20:56:40.999123 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:40.999090 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" event={"ID":"dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc","Type":"ContainerStarted","Data":"f0880bf43ce79145db25be1663693b5a2510f8ea9a3748eb425471d625a16b32"} Jul 28 20:56:41.017015 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:41.016973 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" podStartSLOduration=1.99794773 podStartE2EDuration="3.016945298s" totalImagesPullingTime="1.018997568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:56:41.015890564 +0000 UTC m=+565.161920785" watchObservedRunningTime="2026-07-28 20:56:41.016945298 +0000 UTC m=+565.162975519" Jul 28 20:56:49.169500 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:49.169467 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:49.169996 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:49.169641 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:49.181890 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:49.181871 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:56:50.054311 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:56:50.054285 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x5x6b" Jul 28 20:57:02.973301 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:02.973267 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s"] Jul 28 20:57:02.977697 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:02.977678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:02.981072 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:02.981051 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 28 20:57:02.990126 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:02.990105 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s"] Jul 28 20:57:03.115095 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.115061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq2tn\" (UniqueName: \"kubernetes.io/projected/ce395859-3486-441e-b785-5eaac807d6b7-kube-api-access-jq2tn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.115095 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.115097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.115300 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.115164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce395859-3486-441e-b785-5eaac807d6b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.115300 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.115197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.115300 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.115246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.115300 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.115277 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216221 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216392 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216392 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq2tn\" (UniqueName: \"kubernetes.io/projected/ce395859-3486-441e-b785-5eaac807d6b7-kube-api-access-jq2tn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216392 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216556 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216404 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216556 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce395859-3486-441e-b785-5eaac807d6b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216556 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216715 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216605 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.216804 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.216786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.218452 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.218430 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce395859-3486-441e-b785-5eaac807d6b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.218731 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.218710 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce395859-3486-441e-b785-5eaac807d6b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.226684 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.226629 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq2tn\" (UniqueName: \"kubernetes.io/projected/ce395859-3486-441e-b785-5eaac807d6b7-kube-api-access-jq2tn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s\" (UID: \"ce395859-3486-441e-b785-5eaac807d6b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.287622 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.287592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:03.423515 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:03.423490 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s"] Jul 28 20:57:03.426042 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:57:03.426010 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce395859_3486_441e_b785_5eaac807d6b7.slice/crio-550e72ca0cf3690584d4ab37b623daf89415019e49da22caad801731bff9f172 WatchSource:0}: Error finding container 550e72ca0cf3690584d4ab37b623daf89415019e49da22caad801731bff9f172: Status 404 returned error can't find the container with id 550e72ca0cf3690584d4ab37b623daf89415019e49da22caad801731bff9f172 Jul 28 20:57:04.106753 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:04.106714 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" event={"ID":"ce395859-3486-441e-b785-5eaac807d6b7","Type":"ContainerStarted","Data":"577d226f49fc68e6e72d9421a834b1cecfb9b50f0541d77a363ea032414d9b8c"} Jul 28 20:57:04.107133 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:04.106773 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" event={"ID":"ce395859-3486-441e-b785-5eaac807d6b7","Type":"ContainerStarted","Data":"550e72ca0cf3690584d4ab37b623daf89415019e49da22caad801731bff9f172"} Jul 28 20:57:04.124242 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:04.124195 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" podStartSLOduration=1.95642636 podStartE2EDuration="2.124180962s" totalImagesPullingTime="167.754602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:57:04.122297287 +0000 UTC m=+588.268327508" watchObservedRunningTime="2026-07-28 20:57:04.124180962 +0000 UTC m=+588.270211184" Jul 28 20:57:11.509450 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.509412 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn"] Jul 28 20:57:11.512838 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.512817 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.515699 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.515464 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 28 20:57:11.523272 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.523249 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn"] Jul 28 20:57:11.689623 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.689590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.689805 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.689637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x27hk\" (UniqueName: \"kubernetes.io/projected/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-kube-api-access-x27hk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.689805 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.689666 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.689805 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.689723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.689944 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.689812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.689944 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.689837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791215 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x27hk\" (UniqueName: \"kubernetes.io/projected/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-kube-api-access-x27hk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791215 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791215 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791518 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791518 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791518 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791629 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791570 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791629 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791610 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.791692 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.791645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.793445 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.793423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.793684 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.793667 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.799787 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.799758 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x27hk\" (UniqueName: \"kubernetes.io/projected/d00742ab-ba0b-4ffd-b08b-aaaea06e47a3-kube-api-access-x27hk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tdnrn\" (UID: \"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.824119 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.824096 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:11.952888 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:11.952866 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn"] Jul 28 20:57:11.955476 ip-10-0-134-221 kubenswrapper[2568]: W0728 20:57:11.955449 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00742ab_ba0b_4ffd_b08b_aaaea06e47a3.slice/crio-68368e37f9923bc67237372609abd9050a2abc396acfc2e579fc17c5f3cee7d5 WatchSource:0}: Error finding container 68368e37f9923bc67237372609abd9050a2abc396acfc2e579fc17c5f3cee7d5: Status 404 returned error can't find the container with id 68368e37f9923bc67237372609abd9050a2abc396acfc2e579fc17c5f3cee7d5 Jul 28 20:57:12.143690 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:12.143653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" event={"ID":"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3","Type":"ContainerStarted","Data":"68368e37f9923bc67237372609abd9050a2abc396acfc2e579fc17c5f3cee7d5"} Jul 28 20:57:13.150510 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:13.150474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" event={"ID":"d00742ab-ba0b-4ffd-b08b-aaaea06e47a3","Type":"ContainerStarted","Data":"4b1f5ff46a3ba7ada0b48364ef6fc4e6a514ad8d8f1c8417468199cc534da9ac"} Jul 28 20:57:13.169067 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:13.169010 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" podStartSLOduration=1.974947209 podStartE2EDuration="2.168991004s" totalImagesPullingTime="194.043795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:57:13.16709258 +0000 UTC m=+597.313122823" watchObservedRunningTime="2026-07-28 20:57:13.168991004 +0000 UTC m=+597.315021226" Jul 28 20:57:13.288703 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:13.288673 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:13.288849 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:13.288733 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:13.303526 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:13.303502 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:14.166093 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:14.166064 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s" Jul 28 20:57:16.310179 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:16.310155 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:57:16.316416 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:16.316390 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 20:57:21.824266 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:21.824229 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:21.824629 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:21.824295 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:21.836786 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:21.836761 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 20:57:22.203858 ip-10-0-134-221 kubenswrapper[2568]: I0728 20:57:22.203829 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tdnrn" Jul 28 21:02:16.347499 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:02:16.347418 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:02:16.350864 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:02:16.350846 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:05:23.487898 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:23.487820 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf"] Jul 28 21:05:23.488796 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:23.488157 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" podUID="c21dd4a9-87c8-4952-94b4-fdb7850c111b" containerName="manager" containerID="cri-o://e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198" gracePeriod=10 Jul 28 21:05:25.040574 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.040546 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 21:05:25.107857 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.107788 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25mxw\" (UniqueName: \"kubernetes.io/projected/c21dd4a9-87c8-4952-94b4-fdb7850c111b-kube-api-access-25mxw\") pod \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " Jul 28 21:05:25.107857 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.107825 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c21dd4a9-87c8-4952-94b4-fdb7850c111b-extensions-socket-volume\") pod \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\" (UID: \"c21dd4a9-87c8-4952-94b4-fdb7850c111b\") " Jul 28 21:05:25.108335 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.108307 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c21dd4a9-87c8-4952-94b4-fdb7850c111b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c21dd4a9-87c8-4952-94b4-fdb7850c111b" (UID: "c21dd4a9-87c8-4952-94b4-fdb7850c111b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:05:25.109973 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.109924 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c21dd4a9-87c8-4952-94b4-fdb7850c111b-kube-api-access-25mxw" (OuterVolumeSpecName: "kube-api-access-25mxw") pod "c21dd4a9-87c8-4952-94b4-fdb7850c111b" (UID: "c21dd4a9-87c8-4952-94b4-fdb7850c111b"). InnerVolumeSpecName "kube-api-access-25mxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:05:25.209231 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.209201 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25mxw\" (UniqueName: \"kubernetes.io/projected/c21dd4a9-87c8-4952-94b4-fdb7850c111b-kube-api-access-25mxw\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:05:25.209231 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.209227 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c21dd4a9-87c8-4952-94b4-fdb7850c111b-extensions-socket-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:05:25.408718 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.408679 2568 generic.go:356] "Generic (PLEG): container finished" podID="c21dd4a9-87c8-4952-94b4-fdb7850c111b" containerID="e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198" exitCode=0 Jul 28 21:05:25.408861 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.408723 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" Jul 28 21:05:25.408861 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.408746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" event={"ID":"c21dd4a9-87c8-4952-94b4-fdb7850c111b","Type":"ContainerDied","Data":"e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198"} Jul 28 21:05:25.408861 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.408793 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf" event={"ID":"c21dd4a9-87c8-4952-94b4-fdb7850c111b","Type":"ContainerDied","Data":"1953a6f3cc8f7ed56fc11bd75bb44ff603fc63a84d3db114550dd8983f6b52ec"} Jul 28 21:05:25.408861 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.408819 2568 scope.go:117] "RemoveContainer" containerID="e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198" Jul 28 21:05:25.419434 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.419420 2568 scope.go:117] "RemoveContainer" containerID="e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198" Jul 28 21:05:25.419941 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:05:25.419835 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198\": container with ID starting with e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198 not found: ID does not exist" containerID="e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198" Jul 28 21:05:25.419941 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.419866 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198"} err="failed to get container status \"e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198\": rpc error: code = NotFound desc = could not find container \"e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198\": container with ID starting with e205f59125f121661921b5b5d565326a0e2d3599454103f48b65a0d786c11198 not found: ID does not exist" Jul 28 21:05:25.430973 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.430936 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf"] Jul 28 21:05:25.434188 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:25.434167 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d8wcf"] Jul 28 21:05:26.376078 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:05:26.376040 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c21dd4a9-87c8-4952-94b4-fdb7850c111b" path="/var/lib/kubelet/pods/c21dd4a9-87c8-4952-94b4-fdb7850c111b/volumes" Jul 28 21:06:24.626051 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.626010 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j"] Jul 28 21:06:24.626444 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.626385 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21dd4a9-87c8-4952-94b4-fdb7850c111b" containerName="manager" Jul 28 21:06:24.626444 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.626397 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21dd4a9-87c8-4952-94b4-fdb7850c111b" containerName="manager" Jul 28 21:06:24.626516 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.626459 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c21dd4a9-87c8-4952-94b4-fdb7850c111b" containerName="manager" Jul 28 21:06:24.630817 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.630801 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.633473 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.633453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 28 21:06:24.633606 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.633453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 28 21:06:24.633606 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.633495 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngpxq\"" Jul 28 21:06:24.640484 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.640459 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j"] Jul 28 21:06:24.747186 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.747147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9xjx\" (UniqueName: \"kubernetes.io/projected/56bd08d2-7d88-4817-b5c0-269fb142b65a-kube-api-access-z9xjx\") pod \"kuadrant-operator-controller-manager-86878c769f-rzs5j\" (UID: \"56bd08d2-7d88-4817-b5c0-269fb142b65a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.747349 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.747211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56bd08d2-7d88-4817-b5c0-269fb142b65a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rzs5j\" (UID: \"56bd08d2-7d88-4817-b5c0-269fb142b65a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.848317 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.848282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9xjx\" (UniqueName: \"kubernetes.io/projected/56bd08d2-7d88-4817-b5c0-269fb142b65a-kube-api-access-z9xjx\") pod \"kuadrant-operator-controller-manager-86878c769f-rzs5j\" (UID: \"56bd08d2-7d88-4817-b5c0-269fb142b65a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.848508 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.848340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56bd08d2-7d88-4817-b5c0-269fb142b65a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rzs5j\" (UID: \"56bd08d2-7d88-4817-b5c0-269fb142b65a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.848755 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.848736 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56bd08d2-7d88-4817-b5c0-269fb142b65a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rzs5j\" (UID: \"56bd08d2-7d88-4817-b5c0-269fb142b65a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.856867 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.856829 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9xjx\" (UniqueName: \"kubernetes.io/projected/56bd08d2-7d88-4817-b5c0-269fb142b65a-kube-api-access-z9xjx\") pod \"kuadrant-operator-controller-manager-86878c769f-rzs5j\" (UID: \"56bd08d2-7d88-4817-b5c0-269fb142b65a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:24.942138 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:24.942052 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:25.082005 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:25.081978 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j"] Jul 28 21:06:25.084639 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:06:25.084616 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bd08d2_7d88_4817_b5c0_269fb142b65a.slice/crio-d82500b5425466e031d2db34b66204e186f77b28f0bb6469ebb3bd0319519d05 WatchSource:0}: Error finding container d82500b5425466e031d2db34b66204e186f77b28f0bb6469ebb3bd0319519d05: Status 404 returned error can't find the container with id d82500b5425466e031d2db34b66204e186f77b28f0bb6469ebb3bd0319519d05 Jul 28 21:06:25.685558 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:25.685521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" event={"ID":"56bd08d2-7d88-4817-b5c0-269fb142b65a","Type":"ContainerStarted","Data":"1576e80f5e1e972da7cb1e9b0bb3a35696218a28baf92cb7da94b6defd59f931"} Jul 28 21:06:25.686012 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:25.685578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" event={"ID":"56bd08d2-7d88-4817-b5c0-269fb142b65a","Type":"ContainerStarted","Data":"d82500b5425466e031d2db34b66204e186f77b28f0bb6469ebb3bd0319519d05"} Jul 28 21:06:25.686012 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:25.685603 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:06:25.706933 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:25.706886 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" podStartSLOduration=1.706870204 podStartE2EDuration="1.706870204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:06:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:25.704577167 +0000 UTC m=+1149.850607412" watchObservedRunningTime="2026-07-28 21:06:25.706870204 +0000 UTC m=+1149.852900425" Jul 28 21:06:36.693178 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:06:36.693145 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rzs5j" Jul 28 21:07:16.379753 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:07:16.379726 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:07:16.380280 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:07:16.379778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:12:16.409515 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:12:16.409484 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:12:16.412433 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:12:16.412409 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:14:36.981867 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:36.981831 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw"] Jul 28 21:14:36.985340 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:36.985322 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:36.989029 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:36.989007 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3ba07b96-gw-openshift-default-dockercfg-68mhk\"" Jul 28 21:14:37.004824 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.004794 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw"] Jul 28 21:14:37.122655 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-socket\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.122655 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-token\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.122877 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-certs\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.122877 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-podinfo\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.122877 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-credential-socket\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.122877 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-data\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.123025 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122912 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dfb\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-kube-api-access-w7dfb\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.123025 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istiod-ca-cert\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.123025 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.122975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-envoy\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224196 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-credential-socket\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224196 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-data\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224462 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dfb\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-kube-api-access-w7dfb\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224462 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istiod-ca-cert\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224462 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224274 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-envoy\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224462 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-socket\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224462 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-token\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224721 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-certs\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224721 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-podinfo\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224721 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224632 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-credential-socket\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224877 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-socket\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.224983 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.224939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-data\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.225050 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.225000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-certs\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.225175 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.225152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istiod-ca-cert\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.226768 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.226747 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-envoy\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.227076 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.227056 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-podinfo\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.232675 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.232613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-token\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.232979 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.232962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dfb\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-kube-api-access-w7dfb\") pod \"e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.295320 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.295280 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:37.438347 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.438320 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw"] Jul 28 21:14:37.440643 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:14:37.440617 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8c4b0f_18fd_4cae_a4c3_e5ddd78fe1b3.slice/crio-1b5af7985c48c6bc4534c9a329cac1c6bdbc781bb0554aec54304fc088c614be WatchSource:0}: Error finding container 1b5af7985c48c6bc4534c9a329cac1c6bdbc781bb0554aec54304fc088c614be: Status 404 returned error can't find the container with id 1b5af7985c48c6bc4534c9a329cac1c6bdbc781bb0554aec54304fc088c614be Jul 28 21:14:37.443188 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.443158 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:14:37.443263 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.443223 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:14:37.443263 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.443251 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:14:37.987597 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.987558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" event={"ID":"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3","Type":"ContainerStarted","Data":"a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1"} Jul 28 21:14:37.988004 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:37.987616 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" event={"ID":"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3","Type":"ContainerStarted","Data":"1b5af7985c48c6bc4534c9a329cac1c6bdbc781bb0554aec54304fc088c614be"} Jul 28 21:14:38.009645 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:38.009594 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podStartSLOduration=2.009578839 podStartE2EDuration="2.009578839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:14:38.008160199 +0000 UTC m=+1642.154190424" watchObservedRunningTime="2026-07-28 21:14:38.009578839 +0000 UTC m=+1642.155609062" Jul 28 21:14:38.296452 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:38.296362 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:38.302134 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:38.302106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:38.992656 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:38.992624 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:38.993547 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:38.993530 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:53.994185 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:53.994151 2568 patch_prober.go:28] interesting pod/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 28 21:14:53.994600 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:53.994213 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 28 21:14:54.069159 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:54.069128 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerID="a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1" exitCode=0 Jul 28 21:14:54.069314 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:54.069175 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" event={"ID":"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3","Type":"ContainerDied","Data":"a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1"} Jul 28 21:14:54.069601 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:54.069583 2568 scope.go:117] "RemoveContainer" containerID="a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1" Jul 28 21:14:54.070594 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:54.070568 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:14:54.070652 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:54.070644 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:14:54.070687 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:54.070680 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:14:55.081873 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:55.081836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" event={"ID":"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3","Type":"ContainerStarted","Data":"c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445"} Jul 28 21:14:55.295715 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:55.295675 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:55.296416 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:55.296381 2568 patch_prober.go:28] interesting pod/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 28 21:14:55.296640 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:55.296614 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 28 21:14:56.296165 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:56.296121 2568 patch_prober.go:28] interesting pod/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 28 21:14:56.296668 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:56.296187 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 28 21:14:57.295880 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:57.295840 2568 patch_prober.go:28] interesting pod/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 28 21:14:57.296227 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:57.296195 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 28 21:14:58.296124 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:58.296081 2568 patch_prober.go:28] interesting pod/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 28 21:14:58.296328 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:58.296151 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 28 21:14:59.299693 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:59.299659 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:59.300165 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:59.299929 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:14:59.300727 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:14:59.300709 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:15:11.205647 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:11.205612 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw"] Jul 28 21:15:11.206077 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:11.205882 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" containerID="cri-o://c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445" gracePeriod=30 Jul 28 21:15:14.302381 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:14.302338 2568 patch_prober.go:28] interesting pod/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 28 21:15:14.302856 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:14.302408 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 21:15:16.465651 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.465627 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:15:16.620981 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.620868 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-socket\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.620981 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.620913 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-envoy\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.620981 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.620931 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-data\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.620994 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istiod-ca-cert\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621034 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-credential-socket\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621065 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-certs\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621100 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-token\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621180 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-podinfo\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621227 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7dfb\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-kube-api-access-w7dfb\") pod \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\" (UID: \"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3\") " Jul 28 21:15:16.621270 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621252 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:15:16.621602 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621542 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.621942 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621723 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:15:16.621942 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621739 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:15:16.621942 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621774 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:15:16.621942 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.621899 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:15:16.623487 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.623466 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:15:16.623583 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.623559 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-kube-api-access-w7dfb" (OuterVolumeSpecName: "kube-api-access-w7dfb") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "kube-api-access-w7dfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:15:16.623638 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.623599 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:15:16.623638 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.623602 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" (UID: "1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:15:16.722886 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722853 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.722886 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722883 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7dfb\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-kube-api-access-w7dfb\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.722886 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722894 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.723135 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722903 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.723135 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722911 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.723135 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722918 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.723135 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722927 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:16.723135 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:16.722935 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:15:17.188893 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.188861 2568 generic.go:356] "Generic (PLEG): container finished" podID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerID="c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445" exitCode=0 Jul 28 21:15:17.189102 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.188930 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" Jul 28 21:15:17.189102 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.188961 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" event={"ID":"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3","Type":"ContainerDied","Data":"c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445"} Jul 28 21:15:17.189102 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.189058 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw" event={"ID":"1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3","Type":"ContainerDied","Data":"1b5af7985c48c6bc4534c9a329cac1c6bdbc781bb0554aec54304fc088c614be"} Jul 28 21:15:17.189102 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.189088 2568 scope.go:117] "RemoveContainer" containerID="c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445" Jul 28 21:15:17.198756 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.198734 2568 scope.go:117] "RemoveContainer" containerID="a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1" Jul 28 21:15:17.206927 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.206911 2568 scope.go:117] "RemoveContainer" containerID="c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445" Jul 28 21:15:17.207225 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:15:17.207208 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445\": container with ID starting with c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445 not found: ID does not exist" containerID="c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445" Jul 28 21:15:17.207273 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.207232 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445"} err="failed to get container status \"c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445\": rpc error: code = NotFound desc = could not find container \"c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445\": container with ID starting with c24faf10e0f58113d1d5ce16dc2e6e510b8a3498fa270a6fd73d37166d7c3445 not found: ID does not exist" Jul 28 21:15:17.207273 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.207250 2568 scope.go:117] "RemoveContainer" containerID="a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1" Jul 28 21:15:17.207494 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:15:17.207473 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1\": container with ID starting with a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1 not found: ID does not exist" containerID="a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1" Jul 28 21:15:17.207539 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.207500 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1"} err="failed to get container status \"a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1\": rpc error: code = NotFound desc = could not find container \"a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1\": container with ID starting with a384626a0771878211bf13b34511d839846a921ba823f1ee966c1193e35aa2f1 not found: ID does not exist" Jul 28 21:15:17.219388 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.219367 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw"] Jul 28 21:15:17.221086 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:17.221069 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3ba07b96-gw-openshift-default-c7d974596-gpqgw"] Jul 28 21:15:18.376144 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:18.376116 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" path="/var/lib/kubelet/pods/1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3/volumes" Jul 28 21:15:47.245172 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.245136 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf"] Jul 28 21:15:47.245622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.245530 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" Jul 28 21:15:47.245622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.245541 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" Jul 28 21:15:47.245622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.245615 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" Jul 28 21:15:47.245622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.245624 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" Jul 28 21:15:47.249037 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.249012 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.251853 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.251831 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-99e39a7a-openshift-default-dockercfg-wnpzx\"" Jul 28 21:15:47.268386 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.268364 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf"] Jul 28 21:15:47.412995 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.412962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39794975-fb5f-4f2a-a494-743d34d3e2b9-istiod-ca-cert\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413176 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-certs\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413176 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413024 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd4q8\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-kube-api-access-gd4q8\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413176 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-envoy\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413176 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413083 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-podinfo\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413176 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-credential-socket\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413360 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-token\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413360 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-socket\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.413360 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.413289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-data\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514488 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514403 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-credential-socket\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514488 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-token\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514488 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-socket\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514757 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-data\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514757 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39794975-fb5f-4f2a-a494-743d34d3e2b9-istiod-ca-cert\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514757 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514689 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-certs\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514918 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514884 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-socket\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514993 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-credential-socket\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.514993 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd4q8\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-kube-api-access-gd4q8\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.515092 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.514996 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-data\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.515092 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.515030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-envoy\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.515092 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.515036 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-certs\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.515092 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.515088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-podinfo\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.515494 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.515465 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39794975-fb5f-4f2a-a494-743d34d3e2b9-istiod-ca-cert\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.517174 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.517150 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-envoy\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.517348 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.517332 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-podinfo\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.523984 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.523961 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-token\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.524238 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.524222 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd4q8\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-kube-api-access-gd4q8\") pod \"e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.559288 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.559256 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:47.710479 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.710448 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf"] Jul 28 21:15:47.712752 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:15:47.712716 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39794975_fb5f_4f2a_a494_743d34d3e2b9.slice/crio-9b666574505577f170c00848e243d38c9ababfa3e69f96da70d9e9782b01ff1a WatchSource:0}: Error finding container 9b666574505577f170c00848e243d38c9ababfa3e69f96da70d9e9782b01ff1a: Status 404 returned error can't find the container with id 9b666574505577f170c00848e243d38c9ababfa3e69f96da70d9e9782b01ff1a Jul 28 21:15:47.715145 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.715111 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:15:47.715254 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.715202 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:15:47.715314 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:47.715263 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:15:48.334283 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:48.334251 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" event={"ID":"39794975-fb5f-4f2a-a494-743d34d3e2b9","Type":"ContainerStarted","Data":"080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29"} Jul 28 21:15:48.334638 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:48.334312 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" event={"ID":"39794975-fb5f-4f2a-a494-743d34d3e2b9","Type":"ContainerStarted","Data":"9b666574505577f170c00848e243d38c9ababfa3e69f96da70d9e9782b01ff1a"} Jul 28 21:15:48.358032 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:48.357980 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podStartSLOduration=1.357965805 podStartE2EDuration="1.357965805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:15:48.355863542 +0000 UTC m=+1712.501893775" watchObservedRunningTime="2026-07-28 21:15:48.357965805 +0000 UTC m=+1712.503996018" Jul 28 21:15:48.559698 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:48.559663 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:48.564464 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:48.564439 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:49.339271 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:49.339224 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:15:49.340348 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:15:49.340325 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:03.409686 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:03.409651 2568 generic.go:356] "Generic (PLEG): container finished" podID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerID="080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29" exitCode=0 Jul 28 21:16:03.410122 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:03.409727 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" event={"ID":"39794975-fb5f-4f2a-a494-743d34d3e2b9","Type":"ContainerDied","Data":"080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29"} Jul 28 21:16:03.410174 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:03.410145 2568 scope.go:117] "RemoveContainer" containerID="080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29" Jul 28 21:16:03.411391 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:03.411355 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:16:03.411460 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:03.411446 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:16:03.411506 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:03.411491 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:16:04.339918 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:04.339874 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:04.419742 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:04.419698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" event={"ID":"39794975-fb5f-4f2a-a494-743d34d3e2b9","Type":"ContainerStarted","Data":"812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961"} Jul 28 21:16:04.560026 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:04.559992 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:04.561066 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:04.561044 2568 patch_prober.go:28] interesting pod/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 28 21:16:04.561181 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:04.561088 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 28 21:16:05.559839 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:05.559804 2568 patch_prober.go:28] interesting pod/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 28 21:16:05.560241 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:05.559859 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 28 21:16:06.560332 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:06.560297 2568 patch_prober.go:28] interesting pod/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 28 21:16:06.560688 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:06.560347 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 28 21:16:07.560339 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:07.560303 2568 patch_prober.go:28] interesting pod/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 28 21:16:07.560711 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:07.560360 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 28 21:16:08.564232 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:08.564201 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:08.564599 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:08.564573 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:08.565190 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:08.565168 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:20.808448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:20.808408 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf"] Jul 28 21:16:20.809032 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:20.808625 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" containerID="cri-o://812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961" gracePeriod=30 Jul 28 21:16:23.566983 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:23.566936 2568 patch_prober.go:28] interesting pod/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 28 21:16:23.567351 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:23.567017 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 21:16:26.067881 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.067824 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:26.204060 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204021 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd4q8\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-kube-api-access-gd4q8\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204226 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204083 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39794975-fb5f-4f2a-a494-743d34d3e2b9-istiod-ca-cert\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204226 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204179 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-certs\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204340 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204232 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-credential-socket\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204340 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204255 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-data\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204340 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204297 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-token\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204340 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204319 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-socket\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204539 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204364 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-envoy\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204539 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204402 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-podinfo\") pod \"39794975-fb5f-4f2a-a494-743d34d3e2b9\" (UID: \"39794975-fb5f-4f2a-a494-743d34d3e2b9\") " Jul 28 21:16:26.204539 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204470 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:16:26.204539 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204491 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:16:26.204743 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204581 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39794975-fb5f-4f2a-a494-743d34d3e2b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:16:26.204743 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204636 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:16:26.204842 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204780 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39794975-fb5f-4f2a-a494-743d34d3e2b9-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.204842 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204800 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.204842 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204820 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.204842 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.204838 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.205234 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.205193 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:16:26.206700 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.206670 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:16:26.206700 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.206695 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:16:26.206901 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.206883 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:16:26.207042 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.207026 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-kube-api-access-gd4q8" (OuterVolumeSpecName: "kube-api-access-gd4q8") pod "39794975-fb5f-4f2a-a494-743d34d3e2b9" (UID: "39794975-fb5f-4f2a-a494-743d34d3e2b9"). InnerVolumeSpecName "kube-api-access-gd4q8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:16:26.305840 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.305796 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd4q8\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-kube-api-access-gd4q8\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.305840 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.305825 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.305840 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.305835 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.305840 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.305844 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.305840 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.305851 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39794975-fb5f-4f2a-a494-743d34d3e2b9-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:16:26.526703 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.526668 2568 generic.go:356] "Generic (PLEG): container finished" podID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerID="812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961" exitCode=0 Jul 28 21:16:26.526916 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.526725 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" Jul 28 21:16:26.526916 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.526739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" event={"ID":"39794975-fb5f-4f2a-a494-743d34d3e2b9","Type":"ContainerDied","Data":"812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961"} Jul 28 21:16:26.526916 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.526780 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf" event={"ID":"39794975-fb5f-4f2a-a494-743d34d3e2b9","Type":"ContainerDied","Data":"9b666574505577f170c00848e243d38c9ababfa3e69f96da70d9e9782b01ff1a"} Jul 28 21:16:26.526916 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.526804 2568 scope.go:117] "RemoveContainer" containerID="812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961" Jul 28 21:16:26.535583 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.535563 2568 scope.go:117] "RemoveContainer" containerID="080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29" Jul 28 21:16:26.543462 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.543441 2568 scope.go:117] "RemoveContainer" containerID="812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961" Jul 28 21:16:26.543732 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:16:26.543712 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961\": container with ID starting with 812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961 not found: ID does not exist" containerID="812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961" Jul 28 21:16:26.543815 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.543743 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961"} err="failed to get container status \"812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961\": rpc error: code = NotFound desc = could not find container \"812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961\": container with ID starting with 812307fd794f33d2ca844897532b2d04bed49fc2203f991a10106fc4d4c32961 not found: ID does not exist" Jul 28 21:16:26.543815 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.543768 2568 scope.go:117] "RemoveContainer" containerID="080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29" Jul 28 21:16:26.544110 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:16:26.544091 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29\": container with ID starting with 080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29 not found: ID does not exist" containerID="080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29" Jul 28 21:16:26.544165 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.544117 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29"} err="failed to get container status \"080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29\": rpc error: code = NotFound desc = could not find container \"080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29\": container with ID starting with 080a3e1688dbdde99fe80320b73433aabc8ec5ffa16fe8fc19a173d24fdbae29 not found: ID does not exist" Jul 28 21:16:26.544563 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.544545 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf"] Jul 28 21:16:26.548072 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:26.548052 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-99e39a7a-openshift-default-74fcfb4644-bf9bf"] Jul 28 21:16:28.376022 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:16:28.375992 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" path="/var/lib/kubelet/pods/39794975-fb5f-4f2a-a494-743d34d3e2b9/volumes" Jul 28 21:17:16.438594 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:17:16.438560 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:17:16.441456 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:17:16.441436 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:22:16.473235 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:22:16.473203 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:22:16.477183 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:22:16.477160 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:23:23.798699 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.798619 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx"] Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799035 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799049 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8c4b0f-18fd-4cae-a4c3-e5ddd78fe1b3" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799060 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799067 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799076 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799082 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799157 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" Jul 28 21:23:23.799214 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.799165 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39794975-fb5f-4f2a-a494-743d34d3e2b9" containerName="istio-proxy" Jul 28 21:23:23.802199 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.802180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.804835 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.804809 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-75f962-openshift-default-dockercfg-x8p57\"" Jul 28 21:23:23.815004 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.814934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx"] Jul 28 21:23:23.945683 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.945648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-socket\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.945847 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.945691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-credential-socket\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.945847 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.945765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-token\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.945939 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.945887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-data\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.945939 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.945917 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-certs\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.946049 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.945974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-envoy\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.946049 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.946005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istiod-ca-cert\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.946049 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.946032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-podinfo\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:23.946192 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:23.946069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vp7\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-kube-api-access-j6vp7\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.046956 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.046927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-token\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047100 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047033 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-data\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047100 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-certs\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047100 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-envoy\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047272 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istiod-ca-cert\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047272 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047151 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-podinfo\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047272 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vp7\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-kube-api-access-j6vp7\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047427 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-socket\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047427 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-credential-socket\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047595 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047572 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-certs\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047731 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047691 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-data\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047731 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047689 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-socket\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047849 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047742 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-credential-socket\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.047849 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.047833 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istiod-ca-cert\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.049409 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.049360 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-envoy\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.049632 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.049611 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-podinfo\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.055695 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.055668 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-token\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.056509 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.056492 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vp7\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-kube-api-access-j6vp7\") pod \"e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.115556 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.115530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:24.252807 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.252779 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx"] Jul 28 21:23:24.257484 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:23:24.257456 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c08bb5_b5ce_4977_8fa8_3cc6b366f73d.slice/crio-dedfa7ee00581bc4525de703db1ce49106b31c4e5370457ba8c836bac29bf67c WatchSource:0}: Error finding container dedfa7ee00581bc4525de703db1ce49106b31c4e5370457ba8c836bac29bf67c: Status 404 returned error can't find the container with id dedfa7ee00581bc4525de703db1ce49106b31c4e5370457ba8c836bac29bf67c Jul 28 21:23:24.259833 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.259804 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:23:24.259908 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.259867 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:23:24.259908 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.259896 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:23:24.460139 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.460101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" event={"ID":"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d","Type":"ContainerStarted","Data":"99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70"} Jul 28 21:23:24.460296 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:24.460161 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" event={"ID":"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d","Type":"ContainerStarted","Data":"dedfa7ee00581bc4525de703db1ce49106b31c4e5370457ba8c836bac29bf67c"} Jul 28 21:23:25.116577 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:25.116544 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:25.121407 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:25.121382 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:25.159112 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:25.159063 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podStartSLOduration=2.159048369 podStartE2EDuration="2.159048369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:23:24.479778868 +0000 UTC m=+2168.625809093" watchObservedRunningTime="2026-07-28 21:23:25.159048369 +0000 UTC m=+2169.305078590" Jul 28 21:23:25.465213 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:25.465181 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:25.466074 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:25.466052 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:41.020192 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.019784 2568 patch_prober.go:28] interesting pod/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": read tcp 10.132.0.2:41670->10.132.0.35:15021: read: connection reset by peer" start-of-body= Jul 28 21:23:41.020192 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.019853 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": read tcp 10.132.0.2:41670->10.132.0.35:15021: read: connection reset by peer" Jul 28 21:23:41.550662 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.550627 2568 generic.go:356] "Generic (PLEG): container finished" podID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerID="99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70" exitCode=0 Jul 28 21:23:41.550836 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.550703 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" event={"ID":"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d","Type":"ContainerDied","Data":"99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70"} Jul 28 21:23:41.551134 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.551121 2568 scope.go:117] "RemoveContainer" containerID="99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70" Jul 28 21:23:41.552136 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.552109 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:23:41.552237 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.552172 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:23:41.552237 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:41.552200 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:23:42.557200 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:42.557164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" event={"ID":"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d","Type":"ContainerStarted","Data":"fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a"} Jul 28 21:23:43.116911 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:43.116241 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:43.116911 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:43.116613 2568 patch_prober.go:28] interesting pod/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 28 21:23:43.116911 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:43.116659 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 28 21:23:44.116421 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:44.115986 2568 patch_prober.go:28] interesting pod/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 28 21:23:44.116421 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:44.116047 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 28 21:23:45.116714 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:45.116672 2568 patch_prober.go:28] interesting pod/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 28 21:23:45.117205 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:45.116744 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 28 21:23:46.117018 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:46.116973 2568 patch_prober.go:28] interesting pod/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 28 21:23:46.117484 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:46.117048 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 28 21:23:47.119510 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:47.119481 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:47.119872 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:47.119776 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:23:47.120448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:23:47.120432 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:25:57.141929 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:25:57.141898 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx"] Jul 28 21:25:57.142494 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:25:57.142143 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" containerID="cri-o://fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a" gracePeriod=30 Jul 28 21:26:02.121435 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.121393 2568 patch_prober.go:28] interesting pod/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 28 21:26:02.121795 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.121464 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 21:26:02.393978 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.393927 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:26:02.463170 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463143 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-token\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463358 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463183 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-certs\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463358 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463203 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-socket\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463358 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463226 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istiod-ca-cert\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463358 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463279 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-podinfo\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463358 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463308 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-data\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463616 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463463 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6vp7\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-kube-api-access-j6vp7\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463616 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463478 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:26:02.463616 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463525 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:26:02.463616 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463556 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-envoy\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463799 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463621 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-credential-socket\") pod \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\" (UID: \"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d\") " Jul 28 21:26:02.463799 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463677 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:26:02.463985 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463966 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.464064 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.463989 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.464064 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.464002 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.464149 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.464077 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:26:02.464357 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.464334 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-data" (OuterVolumeSpecName: "istio-data") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:26:02.465520 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.465496 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-kube-api-access-j6vp7" (OuterVolumeSpecName: "kube-api-access-j6vp7") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "kube-api-access-j6vp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:26:02.465769 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.465743 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:26:02.465845 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.465787 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:26:02.465845 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.465793 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-token" (OuterVolumeSpecName: "istio-token") pod "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" (UID: "62c08bb5-b5ce-4977-8fa8-3cc6b366f73d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:26:02.564994 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.564972 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.564994 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.564992 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.565121 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.565002 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.565121 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.565010 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.565121 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.565019 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6vp7\" (UniqueName: \"kubernetes.io/projected/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-kube-api-access-j6vp7\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:02.565121 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:02.565026 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:26:03.218766 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.218719 2568 generic.go:356] "Generic (PLEG): container finished" podID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerID="fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a" exitCode=0 Jul 28 21:26:03.219281 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.218790 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" Jul 28 21:26:03.219281 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.218783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" event={"ID":"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d","Type":"ContainerDied","Data":"fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a"} Jul 28 21:26:03.219281 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.218865 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx" event={"ID":"62c08bb5-b5ce-4977-8fa8-3cc6b366f73d","Type":"ContainerDied","Data":"dedfa7ee00581bc4525de703db1ce49106b31c4e5370457ba8c836bac29bf67c"} Jul 28 21:26:03.219281 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.218901 2568 scope.go:117] "RemoveContainer" containerID="fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a" Jul 28 21:26:03.228486 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.228469 2568 scope.go:117] "RemoveContainer" containerID="99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70" Jul 28 21:26:03.235826 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.235809 2568 scope.go:117] "RemoveContainer" containerID="fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a" Jul 28 21:26:03.236135 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:26:03.236117 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a\": container with ID starting with fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a not found: ID does not exist" containerID="fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a" Jul 28 21:26:03.236187 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.236143 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a"} err="failed to get container status \"fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a\": rpc error: code = NotFound desc = could not find container \"fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a\": container with ID starting with fe1c0d76f81de659d2ce766d2358876191fd859dd6bc21402c9999b149a3584a not found: ID does not exist" Jul 28 21:26:03.236187 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.236158 2568 scope.go:117] "RemoveContainer" containerID="99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70" Jul 28 21:26:03.236372 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:26:03.236358 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70\": container with ID starting with 99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70 not found: ID does not exist" containerID="99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70" Jul 28 21:26:03.236408 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.236376 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70"} err="failed to get container status \"99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70\": rpc error: code = NotFound desc = could not find container \"99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70\": container with ID starting with 99333c6962990769a18362894cc00c2fcd8535e9c3b0a574069aac5da27e9d70 not found: ID does not exist" Jul 28 21:26:03.241734 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.241712 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx"] Jul 28 21:26:03.246301 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:03.246282 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-75f962-openshift-default-7c46c59986-tlcqx"] Jul 28 21:26:04.375664 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:04.375632 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" path="/var/lib/kubelet/pods/62c08bb5-b5ce-4977-8fa8-3cc6b366f73d/volumes" Jul 28 21:26:26.863197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863165 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t"] Jul 28 21:26:26.863571 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863557 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" Jul 28 21:26:26.863615 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863573 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" Jul 28 21:26:26.863615 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863588 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" Jul 28 21:26:26.863615 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863594 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" Jul 28 21:26:26.863706 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863674 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" Jul 28 21:26:26.863706 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.863685 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c08bb5-b5ce-4977-8fa8-3cc6b366f73d" containerName="istio-proxy" Jul 28 21:26:26.866389 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.866368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.869511 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.869491 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-65cc6c-openshift-default-dockercfg-s5rd8\"" Jul 28 21:26:26.879643 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.879622 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t"] Jul 28 21:26:26.974304 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-envoy\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974476 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ede23f0-df34-4d05-b8f2-99e643af7caa-istiod-ca-cert\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974476 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-podinfo\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974476 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpbh\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-kube-api-access-sxpbh\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974476 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974459 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-token\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974641 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-credential-socket\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974641 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-data\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974737 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-certs\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:26.974792 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:26.974776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-socket\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076363 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076328 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-envoy\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076363 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076365 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ede23f0-df34-4d05-b8f2-99e643af7caa-istiod-ca-cert\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-podinfo\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpbh\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-kube-api-access-sxpbh\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-token\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-credential-socket\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-data\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076622 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-certs\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.076914 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.076681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-socket\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.077157 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.077127 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-data\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.077157 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.077142 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-socket\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.077295 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.077157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-certs\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.077295 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.077237 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-credential-socket\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.077295 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.077278 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ede23f0-df34-4d05-b8f2-99e643af7caa-istiod-ca-cert\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.078764 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.078743 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-envoy\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.079139 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.079123 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-podinfo\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.087628 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.087598 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpbh\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-kube-api-access-sxpbh\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.087762 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.087614 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-token\") pod \"e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.177216 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.177184 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:27.317979 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.317939 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t"] Jul 28 21:26:27.320421 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:26:27.320385 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ede23f0_df34_4d05_b8f2_99e643af7caa.slice/crio-d07eef5aa512bc78fb9b6ea350498657a31f3fa82e16dd72824377160f1ed2d9 WatchSource:0}: Error finding container d07eef5aa512bc78fb9b6ea350498657a31f3fa82e16dd72824377160f1ed2d9: Status 404 returned error can't find the container with id d07eef5aa512bc78fb9b6ea350498657a31f3fa82e16dd72824377160f1ed2d9 Jul 28 21:26:27.322676 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.322644 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:26:27.322759 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.322713 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:26:27.322759 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.322748 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:26:27.335062 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:27.335036 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" event={"ID":"1ede23f0-df34-4d05-b8f2-99e643af7caa","Type":"ContainerStarted","Data":"d07eef5aa512bc78fb9b6ea350498657a31f3fa82e16dd72824377160f1ed2d9"} Jul 28 21:26:28.340605 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:28.340566 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" event={"ID":"1ede23f0-df34-4d05-b8f2-99e643af7caa","Type":"ContainerStarted","Data":"5ccc18ec0c016d4cd8ace0fa441a68e5c69a3a516c3602cd73de7be80466d9f6"} Jul 28 21:26:28.366151 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:28.366093 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podStartSLOduration=2.366075567 podStartE2EDuration="2.366075567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:26:28.363430607 +0000 UTC m=+2352.509460853" watchObservedRunningTime="2026-07-28 21:26:28.366075567 +0000 UTC m=+2352.512105790" Jul 28 21:26:29.178135 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:29.178095 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:29.182788 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:29.182761 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:29.345033 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:29.345002 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:29.345908 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:29.345887 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:44.346738 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.346697 2568 patch_prober.go:28] interesting pod/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 28 21:26:44.347168 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.346765 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 28 21:26:44.416588 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.416553 2568 generic.go:356] "Generic (PLEG): container finished" podID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerID="5ccc18ec0c016d4cd8ace0fa441a68e5c69a3a516c3602cd73de7be80466d9f6" exitCode=0 Jul 28 21:26:44.416738 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.416628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" event={"ID":"1ede23f0-df34-4d05-b8f2-99e643af7caa","Type":"ContainerDied","Data":"5ccc18ec0c016d4cd8ace0fa441a68e5c69a3a516c3602cd73de7be80466d9f6"} Jul 28 21:26:44.417047 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.417031 2568 scope.go:117] "RemoveContainer" containerID="5ccc18ec0c016d4cd8ace0fa441a68e5c69a3a516c3602cd73de7be80466d9f6" Jul 28 21:26:44.418080 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.418051 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:26:44.418153 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.418135 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:26:44.418190 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:44.418178 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:26:45.425309 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:45.425273 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" event={"ID":"1ede23f0-df34-4d05-b8f2-99e643af7caa","Type":"ContainerStarted","Data":"5bb3f0dedd0d537ad70f20088511f63c0a0adbfa5ce920a6e7a1c1ff00609f71"} Jul 28 21:26:46.177776 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:46.177736 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:46.178049 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:46.178020 2568 patch_prober.go:28] interesting pod/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 28 21:26:46.178110 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:46.178083 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 28 21:26:47.177756 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:47.177717 2568 patch_prober.go:28] interesting pod/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 28 21:26:47.178191 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:47.177776 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 28 21:26:48.178477 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:48.178439 2568 patch_prober.go:28] interesting pod/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 28 21:26:48.178846 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:48.178497 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 28 21:26:49.177905 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:49.177872 2568 patch_prober.go:28] interesting pod/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 28 21:26:49.178107 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:49.177931 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 28 21:26:50.181430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:50.181399 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:50.181854 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:50.181695 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:26:50.182396 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:26:50.182376 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:27:16.504088 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:16.504057 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:27:16.508287 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:16.508261 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:27:37.457834 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:37.457801 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t"] Jul 28 21:27:37.458554 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:37.458500 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" containerID="cri-o://5bb3f0dedd0d537ad70f20088511f63c0a0adbfa5ce920a6e7a1c1ff00609f71" gracePeriod=30 Jul 28 21:27:42.693342 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.693089 2568 generic.go:356] "Generic (PLEG): container finished" podID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerID="5bb3f0dedd0d537ad70f20088511f63c0a0adbfa5ce920a6e7a1c1ff00609f71" exitCode=0 Jul 28 21:27:42.693342 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.693134 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" event={"ID":"1ede23f0-df34-4d05-b8f2-99e643af7caa","Type":"ContainerDied","Data":"5bb3f0dedd0d537ad70f20088511f63c0a0adbfa5ce920a6e7a1c1ff00609f71"} Jul 28 21:27:42.693342 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.693195 2568 scope.go:117] "RemoveContainer" containerID="5ccc18ec0c016d4cd8ace0fa441a68e5c69a3a516c3602cd73de7be80466d9f6" Jul 28 21:27:42.714109 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.714084 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:27:42.801459 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801387 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-token\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.801459 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801436 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-credential-socket\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.801705 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801488 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-data\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.801705 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801528 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ede23f0-df34-4d05-b8f2-99e643af7caa-istiod-ca-cert\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.801705 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801552 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-envoy\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.801705 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801575 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-podinfo\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.801915 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801774 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:27:42.802006 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.801941 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ede23f0-df34-4d05-b8f2-99e643af7caa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:27:42.802066 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802038 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:27:42.802066 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802056 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-certs\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.802165 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802110 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-socket\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.802218 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802184 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxpbh\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-kube-api-access-sxpbh\") pod \"1ede23f0-df34-4d05-b8f2-99e643af7caa\" (UID: \"1ede23f0-df34-4d05-b8f2-99e643af7caa\") " Jul 28 21:27:42.802324 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802293 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:27:42.802609 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802589 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ede23f0-df34-4d05-b8f2-99e643af7caa-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.802703 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802605 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:27:42.802703 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802616 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.802703 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802660 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.802703 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.802677 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.803771 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.803746 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:27:42.804005 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.803979 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:27:42.804107 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.804072 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:27:42.804340 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.804311 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-kube-api-access-sxpbh" (OuterVolumeSpecName: "kube-api-access-sxpbh") pod "1ede23f0-df34-4d05-b8f2-99e643af7caa" (UID: "1ede23f0-df34-4d05-b8f2-99e643af7caa"). InnerVolumeSpecName "kube-api-access-sxpbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:27:42.903348 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.903319 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.903348 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.903344 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.903348 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.903353 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.903541 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.903362 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxpbh\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-kube-api-access-sxpbh\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:42.903541 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:42.903373 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ede23f0-df34-4d05-b8f2-99e643af7caa-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:27:43.699354 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:43.699328 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" Jul 28 21:27:43.699733 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:43.699373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t" event={"ID":"1ede23f0-df34-4d05-b8f2-99e643af7caa","Type":"ContainerDied","Data":"d07eef5aa512bc78fb9b6ea350498657a31f3fa82e16dd72824377160f1ed2d9"} Jul 28 21:27:43.699733 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:43.699428 2568 scope.go:117] "RemoveContainer" containerID="5bb3f0dedd0d537ad70f20088511f63c0a0adbfa5ce920a6e7a1c1ff00609f71" Jul 28 21:27:43.733886 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:43.733857 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t"] Jul 28 21:27:43.737781 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:43.737758 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-65cc6c-openshift-default-cf56db858-gq84t"] Jul 28 21:27:44.377106 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:27:44.377071 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" path="/var/lib/kubelet/pods/1ede23f0-df34-4d05-b8f2-99e643af7caa/volumes" Jul 28 21:28:07.268408 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.268375 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z"] Jul 28 21:28:07.269079 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.268930 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" Jul 28 21:28:07.269079 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.269017 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" Jul 28 21:28:07.269079 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.269037 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" Jul 28 21:28:07.269079 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.269046 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" Jul 28 21:28:07.269316 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.269154 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" Jul 28 21:28:07.269316 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.269166 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ede23f0-df34-4d05-b8f2-99e643af7caa" containerName="istio-proxy" Jul 28 21:28:07.272432 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.272411 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.274846 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.274824 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2c3f70-openshift-default-dockercfg-lq9t8\"" Jul 28 21:28:07.284050 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.284027 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z"] Jul 28 21:28:07.335189 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-certs\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335361 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bkzx\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-kube-api-access-2bkzx\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335361 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-token\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335361 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335285 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-credential-socket\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335361 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791aaf2-900f-4e18-b891-532f1d4d4383-istiod-ca-cert\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335559 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-envoy\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335559 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-data\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335559 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-podinfo\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.335559 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.335484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-socket\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.436736 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.436703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-credential-socket\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.436904 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.436749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791aaf2-900f-4e18-b891-532f1d4d4383-istiod-ca-cert\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.436904 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.436777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-envoy\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.436904 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.436830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-data\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.436904 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.436866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-podinfo\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.436904 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.436896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-socket\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437013 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-certs\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkzx\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-kube-api-access-2bkzx\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-token\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437362 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437201 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-credential-socket\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437594 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437464 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-data\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437594 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437541 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791aaf2-900f-4e18-b891-532f1d4d4383-istiod-ca-cert\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437754 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437674 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-socket\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.437754 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.437722 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-certs\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.439399 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.439381 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-envoy\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.439723 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.439706 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-podinfo\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.445676 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.445647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-token\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.445815 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.445799 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bkzx\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-kube-api-access-2bkzx\") pod \"e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.583945 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.583859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:07.728337 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.728306 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z"] Jul 28 21:28:07.732253 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:28:07.732228 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd791aaf2_900f_4e18_b891_532f1d4d4383.slice/crio-af8bdc6cbcba5978b4327343fcb709a28105b40f6326a4910ad1a33e55298f7e WatchSource:0}: Error finding container af8bdc6cbcba5978b4327343fcb709a28105b40f6326a4910ad1a33e55298f7e: Status 404 returned error can't find the container with id af8bdc6cbcba5978b4327343fcb709a28105b40f6326a4910ad1a33e55298f7e Jul 28 21:28:07.734993 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.734935 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:28:07.735073 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.735039 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:28:07.735123 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.735082 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:28:07.812261 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.812233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" event={"ID":"d791aaf2-900f-4e18-b891-532f1d4d4383","Type":"ContainerStarted","Data":"a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928"} Jul 28 21:28:07.812376 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.812287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" event={"ID":"d791aaf2-900f-4e18-b891-532f1d4d4383","Type":"ContainerStarted","Data":"af8bdc6cbcba5978b4327343fcb709a28105b40f6326a4910ad1a33e55298f7e"} Jul 28 21:28:07.834944 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:07.834846 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podStartSLOduration=0.834825304 podStartE2EDuration="834.825304ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:28:07.833700261 +0000 UTC m=+2451.979730484" watchObservedRunningTime="2026-07-28 21:28:07.834825304 +0000 UTC m=+2451.980855527" Jul 28 21:28:08.584355 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:08.584316 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:08.589149 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:08.589125 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:08.817202 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:08.817174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:08.818145 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:08.818125 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:24.386307 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.386256 2568 patch_prober.go:28] interesting pod/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": read tcp 10.132.0.2:59908->10.132.0.37:15021: read: connection reset by peer" start-of-body= Jul 28 21:28:24.386823 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.386331 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": read tcp 10.132.0.2:59908->10.132.0.37:15021: read: connection reset by peer" Jul 28 21:28:24.412158 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:28:24.412128 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd791aaf2_900f_4e18_b891_532f1d4d4383.slice/crio-a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928.scope\": RecentStats: unable to find data in memory cache], [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@4-28399-0.service\": RecentStats: unable to find data in memory cache]" Jul 28 21:28:24.894482 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.894452 2568 generic.go:356] "Generic (PLEG): container finished" podID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerID="a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928" exitCode=0 Jul 28 21:28:24.894635 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.894520 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" event={"ID":"d791aaf2-900f-4e18-b891-532f1d4d4383","Type":"ContainerDied","Data":"a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928"} Jul 28 21:28:24.894943 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.894929 2568 scope.go:117] "RemoveContainer" containerID="a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928" Jul 28 21:28:24.895898 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.895875 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:28:24.895984 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.895969 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:28:24.896036 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:24.896005 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:28:25.902071 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:25.902035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" event={"ID":"d791aaf2-900f-4e18-b891-532f1d4d4383","Type":"ContainerStarted","Data":"e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44"} Jul 28 21:28:26.584131 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:26.584100 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:26.584299 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:26.584258 2568 patch_prober.go:28] interesting pod/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 28 21:28:26.584346 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:26.584297 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 28 21:28:27.584773 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:27.584736 2568 patch_prober.go:28] interesting pod/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 28 21:28:27.585211 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:27.584801 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 28 21:28:28.584234 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:28.584196 2568 patch_prober.go:28] interesting pod/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 28 21:28:28.584408 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:28.584264 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 28 21:28:29.584550 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:29.584512 2568 patch_prober.go:28] interesting pod/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 28 21:28:29.585040 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:29.584576 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 28 21:28:30.587693 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:30.587663 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:30.588072 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:30.587911 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:28:30.588630 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:28:30.588615 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:32:16.534765 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:32:16.534686 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:32:16.537970 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:32:16.537936 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:37:16.563017 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:37:16.562988 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:37:16.567099 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:37:16.567072 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:38:14.366603 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.366514 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw"] Jul 28 21:38:14.370258 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.370231 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.372931 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.372907 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-cf1484-openshift-default-dockercfg-gh68q\"" Jul 28 21:38:14.386018 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.385992 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw"] Jul 28 21:38:14.456976 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.456914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-podinfo\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457160 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.456988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-token\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457160 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-certs\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457160 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-envoy\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457297 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-socket\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457297 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8wl5\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-kube-api-access-j8wl5\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457297 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istiod-ca-cert\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457443 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-credential-socket\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.457443 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.457343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-data\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.558817 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.558777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-socket\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559024 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.558846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8wl5\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-kube-api-access-j8wl5\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559024 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.558874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istiod-ca-cert\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559024 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.558900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-credential-socket\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559024 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.558925 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-data\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559261 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-podinfo\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559261 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559110 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-token\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559625 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-certs\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559716 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-envoy\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559786 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559468 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-data\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559786 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559585 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-certs\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.559786 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.559334 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-socket\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.560038 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.560014 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istiod-ca-cert\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.560194 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.560107 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-credential-socket\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.562489 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.562461 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-podinfo\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.562736 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.562710 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-envoy\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.569129 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.569095 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8wl5\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-kube-api-access-j8wl5\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.569297 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.569164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-token\") pod \"e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.682319 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.682273 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:14.823605 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.823577 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw"] Jul 28 21:38:14.825292 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:38:14.825264 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c4c3a5_b4aa_49ea_96e3_24fef2242fed.slice/crio-2537b94a9019fbd322fef5a00384d4acd8b1eb8ad5da2ee2267884f389fa6d72 WatchSource:0}: Error finding container 2537b94a9019fbd322fef5a00384d4acd8b1eb8ad5da2ee2267884f389fa6d72: Status 404 returned error can't find the container with id 2537b94a9019fbd322fef5a00384d4acd8b1eb8ad5da2ee2267884f389fa6d72 Jul 28 21:38:14.827518 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.827488 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:38:14.827650 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.827546 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:38:14.827650 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:14.827574 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:38:15.700489 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:15.700455 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" event={"ID":"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed","Type":"ContainerStarted","Data":"49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1"} Jul 28 21:38:15.700991 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:15.700529 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" event={"ID":"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed","Type":"ContainerStarted","Data":"2537b94a9019fbd322fef5a00384d4acd8b1eb8ad5da2ee2267884f389fa6d72"} Jul 28 21:38:15.721069 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:15.721019 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" podStartSLOduration=1.721006102 podStartE2EDuration="1.721006102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:38:15.720361714 +0000 UTC m=+3059.866391938" watchObservedRunningTime="2026-07-28 21:38:15.721006102 +0000 UTC m=+3059.867036321" Jul 28 21:38:16.683101 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:16.683065 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:16.688063 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:16.688038 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:16.705063 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:16.705033 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:16.705874 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:16.705855 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:32.747131 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:32.747087 2568 patch_prober.go:28] interesting pod/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 28 21:38:32.747531 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:32.747174 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 28 21:38:34.792361 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:34.792320 2568 generic.go:356] "Generic (PLEG): container finished" podID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerID="49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1" exitCode=0 Jul 28 21:38:34.792773 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:34.792392 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" event={"ID":"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed","Type":"ContainerDied","Data":"49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1"} Jul 28 21:38:34.792822 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:34.792782 2568 scope.go:117] "RemoveContainer" containerID="49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1" Jul 28 21:38:34.793821 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:34.793789 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:38:34.793926 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:34.793863 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:38:34.793926 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:34.793896 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:38:35.801936 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:35.801895 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" event={"ID":"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed","Type":"ContainerStarted","Data":"2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410"} Jul 28 21:38:36.683350 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:36.683313 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:36.683554 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:36.683535 2568 patch_prober.go:28] interesting pod/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 28 21:38:36.683635 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:36.683589 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 28 21:38:37.683701 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:37.683662 2568 patch_prober.go:28] interesting pod/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 28 21:38:37.684143 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:37.683718 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 28 21:38:38.683426 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:38.683392 2568 patch_prober.go:28] interesting pod/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 28 21:38:38.683587 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:38.683443 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 28 21:38:39.686882 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:39.686852 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:39.687347 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:39.687330 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:38:39.688023 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:38:39.688005 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:40:10.568054 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.568017 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6"] Jul 28 21:40:10.571553 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.571532 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.574263 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.574240 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ea76b4-openshift-default-dockercfg-9n7m8\"" Jul 28 21:40:10.584388 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.584364 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6"] Jul 28 21:40:10.674247 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpdqm\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-kube-api-access-kpdqm\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-envoy\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-token\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-socket\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-data\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-certs\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674717 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674717 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-podinfo\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.674717 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.674595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-credential-socket\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775485 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpdqm\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-kube-api-access-kpdqm\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775680 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775513 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-envoy\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775680 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-token\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775680 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-socket\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775879 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-data\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775879 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-certs\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775879 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.775879 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-podinfo\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.776143 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.775907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-credential-socket\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.776201 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.776174 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-socket\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.776544 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.776495 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-credential-socket\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.776544 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.776519 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-certs\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.776723 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.776549 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-data\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.776723 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.776583 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.778666 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.778641 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-podinfo\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.778838 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.778818 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-envoy\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.784407 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.784384 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpdqm\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-kube-api-access-kpdqm\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.784707 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.784688 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-token\") pod \"e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:10.882131 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:10.882100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:11.018937 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.018909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6"] Jul 28 21:40:11.020909 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:40:11.020883 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9d5c03_9f91_411e_b272_2a7caf6f978f.slice/crio-81368e7c6521de148cb4bcb7b8b0afb6a575cc51321aed9204c0c8c7b75e8311 WatchSource:0}: Error finding container 81368e7c6521de148cb4bcb7b8b0afb6a575cc51321aed9204c0c8c7b75e8311: Status 404 returned error can't find the container with id 81368e7c6521de148cb4bcb7b8b0afb6a575cc51321aed9204c0c8c7b75e8311 Jul 28 21:40:11.023284 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.023232 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:40:11.023368 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.023315 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:40:11.023368 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.023354 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:40:11.265488 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.265399 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" event={"ID":"bd9d5c03-9f91-411e-b272-2a7caf6f978f","Type":"ContainerStarted","Data":"7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2"} Jul 28 21:40:11.265488 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.265456 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" event={"ID":"bd9d5c03-9f91-411e-b272-2a7caf6f978f","Type":"ContainerStarted","Data":"81368e7c6521de148cb4bcb7b8b0afb6a575cc51321aed9204c0c8c7b75e8311"} Jul 28 21:40:11.286107 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.286039 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" podStartSLOduration=1.286017264 podStartE2EDuration="1.286017264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:40:11.283815496 +0000 UTC m=+3175.429845719" watchObservedRunningTime="2026-07-28 21:40:11.286017264 +0000 UTC m=+3175.432047484" Jul 28 21:40:11.882338 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:11.882303 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:12.887771 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:12.887739 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:13.275007 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:13.274904 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:13.276043 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:13.276001 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:26.346769 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:26.346734 2568 generic.go:356] "Generic (PLEG): container finished" podID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerID="7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2" exitCode=0 Jul 28 21:40:26.347179 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:26.346806 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" event={"ID":"bd9d5c03-9f91-411e-b272-2a7caf6f978f","Type":"ContainerDied","Data":"7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2"} Jul 28 21:40:26.347224 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:26.347174 2568 scope.go:117] "RemoveContainer" containerID="7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2" Jul 28 21:40:26.348201 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:26.348176 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:40:26.348279 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:26.348238 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:40:26.348279 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:26.348269 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 28 21:40:27.353681 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:27.353647 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" event={"ID":"bd9d5c03-9f91-411e-b272-2a7caf6f978f","Type":"ContainerStarted","Data":"ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02"} Jul 28 21:40:27.882264 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:27.882231 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:27.883387 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:27.883356 2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 28 21:40:27.883512 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:27.883407 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 28 21:40:28.275420 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:28.275340 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:28.883324 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:28.883276 2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 28 21:40:28.883719 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:28.883346 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 28 21:40:29.882586 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:29.882549 2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 28 21:40:29.882815 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:29.882613 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 28 21:40:30.883245 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:30.883205 2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 28 21:40:30.883656 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:30.883278 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 28 21:40:31.886376 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:31.886344 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:31.887310 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:31.887290 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:50.495966 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:50.495912 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6"] Jul 28 21:40:50.496444 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:50.496178 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" containerID="cri-o://ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02" gracePeriod=30 Jul 28 21:40:55.755568 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.755548 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:55.903651 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903619 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-data\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.903824 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903674 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-envoy\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.903824 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903704 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-socket\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.903824 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903757 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-credential-socket\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.903824 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903789 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-podinfo\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.903824 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903825 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-certs\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.904142 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903918 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpdqm\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-kube-api-access-kpdqm\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.904142 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.903979 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istiod-ca-cert\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.904142 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904015 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-token\") pod \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\" (UID: \"bd9d5c03-9f91-411e-b272-2a7caf6f978f\") " Jul 28 21:40:55.904142 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904073 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:40:55.904352 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904141 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:40:55.904411 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904397 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:55.904463 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904413 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:55.904596 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904575 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:40:55.904839 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904817 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:40:55.904974 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.904846 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:40:55.906133 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.906103 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:40:55.906574 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.906554 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-kube-api-access-kpdqm" (OuterVolumeSpecName: "kube-api-access-kpdqm") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "kube-api-access-kpdqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:40:55.906656 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.906569 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:40:55.906833 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:55.906798 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd9d5c03-9f91-411e-b272-2a7caf6f978f" (UID: "bd9d5c03-9f91-411e-b272-2a7caf6f978f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:40:56.005228 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005190 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.005228 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005218 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.005228 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005228 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.005228 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005236 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpdqm\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-kube-api-access-kpdqm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.005571 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005246 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.005571 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005254 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.005571 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.005261 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd9d5c03-9f91-411e-b272-2a7caf6f978f-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:40:56.492471 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.492440 2568 generic.go:356] "Generic (PLEG): container finished" podID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerID="ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02" exitCode=0 Jul 28 21:40:56.492667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.492496 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" Jul 28 21:40:56.492667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.492525 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" event={"ID":"bd9d5c03-9f91-411e-b272-2a7caf6f978f","Type":"ContainerDied","Data":"ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02"} Jul 28 21:40:56.492667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.492588 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6" event={"ID":"bd9d5c03-9f91-411e-b272-2a7caf6f978f","Type":"ContainerDied","Data":"81368e7c6521de148cb4bcb7b8b0afb6a575cc51321aed9204c0c8c7b75e8311"} Jul 28 21:40:56.492667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.492618 2568 scope.go:117] "RemoveContainer" containerID="ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02" Jul 28 21:40:56.503437 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.503421 2568 scope.go:117] "RemoveContainer" containerID="7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2" Jul 28 21:40:56.511667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.511650 2568 scope.go:117] "RemoveContainer" containerID="ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02" Jul 28 21:40:56.512005 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:40:56.511987 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02\": container with ID starting with ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02 not found: ID does not exist" containerID="ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02" Jul 28 21:40:56.512073 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.512014 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02"} err="failed to get container status \"ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02\": rpc error: code = NotFound desc = could not find container \"ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02\": container with ID starting with ce1eddfafd4cd02a2add15ee7fa0a75e568ca4c71d5a3e4757db5248452c3d02 not found: ID does not exist" Jul 28 21:40:56.512073 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.512030 2568 scope.go:117] "RemoveContainer" containerID="7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2" Jul 28 21:40:56.512306 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:40:56.512291 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2\": container with ID starting with 7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2 not found: ID does not exist" containerID="7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2" Jul 28 21:40:56.512353 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.512310 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2"} err="failed to get container status \"7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2\": rpc error: code = NotFound desc = could not find container \"7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2\": container with ID starting with 7f37ed4f395057d24b34abd7d9f605344de1c69843fccd1f963d565f2650dab2 not found: ID does not exist" Jul 28 21:40:56.512870 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.512852 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6"] Jul 28 21:40:56.516000 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:56.515980 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ea76b4-openshift-default-cd46b5d8b-8ccb6"] Jul 28 21:40:58.375609 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:40:58.375575 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" path="/var/lib/kubelet/pods/bd9d5c03-9f91-411e-b272-2a7caf6f978f/volumes" Jul 28 21:41:58.926867 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:41:58.926835 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw"] Jul 28 21:41:58.927439 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:41:58.927160 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" containerID="cri-o://2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410" gracePeriod=30 Jul 28 21:42:04.174935 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.174909 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:42:04.233197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233128 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-podinfo\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233178 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-data\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233398 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233249 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8wl5\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-kube-api-access-j8wl5\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233398 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233283 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-certs\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233398 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233307 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-socket\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233398 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233336 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istiod-ca-cert\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233398 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233375 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-envoy\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233422 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-token\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233454 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-credential-socket\") pod \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\" (UID: \"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed\") " Jul 28 21:42:04.233667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233604 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:04.233667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233610 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:04.233872 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233805 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:04.233872 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233826 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.233872 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233845 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.234074 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.233892 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:42:04.234333 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.234304 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:04.235428 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.235398 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:42:04.235531 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.235485 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-kube-api-access-j8wl5" (OuterVolumeSpecName: "kube-api-access-j8wl5") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "kube-api-access-j8wl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:42:04.235582 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.235532 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:42:04.235668 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.235644 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" (UID: "b9c4c3a5-b4aa-49ea-96e3-24fef2242fed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:04.334957 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.334932 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.335055 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.334975 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.335055 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.334984 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.335055 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.334993 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.335055 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.335001 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.335055 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.335009 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.335055 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.335018 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8wl5\" (UniqueName: \"kubernetes.io/projected/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed-kube-api-access-j8wl5\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:04.814578 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.814550 2568 generic.go:356] "Generic (PLEG): container finished" podID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerID="2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410" exitCode=0 Jul 28 21:42:04.814730 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.814591 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" event={"ID":"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed","Type":"ContainerDied","Data":"2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410"} Jul 28 21:42:04.814730 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.814603 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" Jul 28 21:42:04.814730 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.814633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw" event={"ID":"b9c4c3a5-b4aa-49ea-96e3-24fef2242fed","Type":"ContainerDied","Data":"2537b94a9019fbd322fef5a00384d4acd8b1eb8ad5da2ee2267884f389fa6d72"} Jul 28 21:42:04.814730 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.814655 2568 scope.go:117] "RemoveContainer" containerID="2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410" Jul 28 21:42:04.823118 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.823102 2568 scope.go:117] "RemoveContainer" containerID="49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1" Jul 28 21:42:04.836289 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.836263 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw"] Jul 28 21:42:04.837471 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.837455 2568 scope.go:117] "RemoveContainer" containerID="2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410" Jul 28 21:42:04.837724 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:42:04.837703 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410\": container with ID starting with 2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410 not found: ID does not exist" containerID="2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410" Jul 28 21:42:04.837816 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.837729 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410"} err="failed to get container status \"2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410\": rpc error: code = NotFound desc = could not find container \"2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410\": container with ID starting with 2f4fcaf90e44a1c99b752b4c3ccc36b80f30e10fb31860ca3d50dd2be5b7c410 not found: ID does not exist" Jul 28 21:42:04.837816 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.837745 2568 scope.go:117] "RemoveContainer" containerID="49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1" Jul 28 21:42:04.837999 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:42:04.837974 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1\": container with ID starting with 49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1 not found: ID does not exist" containerID="49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1" Jul 28 21:42:04.838129 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.838006 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1"} err="failed to get container status \"49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1\": rpc error: code = NotFound desc = could not find container \"49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1\": container with ID starting with 49870cbb5ab9655c1eeaa5830dc66272390b45aec588201a592ef43391d70af1 not found: ID does not exist" Jul 28 21:42:04.840783 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:04.840762 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-cf1484-openshift-default-5c67cf6886-bpzvw"] Jul 28 21:42:06.376723 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:06.376694 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" path="/var/lib/kubelet/pods/b9c4c3a5-b4aa-49ea-96e3-24fef2242fed/volumes" Jul 28 21:42:16.594121 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:16.594091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:42:16.600843 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:16.600819 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:42:52.212507 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:52.212471 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z"] Jul 28 21:42:52.213025 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:52.212749 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" containerID="cri-o://e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44" gracePeriod=30 Jul 28 21:42:57.462028 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.462000 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:42:57.637920 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.637880 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-certs\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638111 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.637933 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-data\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638111 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638026 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bkzx\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-kube-api-access-2bkzx\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638111 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638070 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-envoy\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638111 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638089 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-credential-socket\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638292 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638149 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791aaf2-900f-4e18-b891-532f1d4d4383-istiod-ca-cert\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638292 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638188 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-token\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638292 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638214 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-podinfo\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638292 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638200 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:57.638502 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638322 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-socket\") pod \"d791aaf2-900f-4e18-b891-532f1d4d4383\" (UID: \"d791aaf2-900f-4e18-b891-532f1d4d4383\") " Jul 28 21:42:57.638502 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638383 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:57.638612 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638582 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d791aaf2-900f-4e18-b891-532f1d4d4383-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 21:42:57.638704 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638674 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791aaf2-900f-4e18-b891-532f1d4d4383-istiod-ca-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.638704 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638699 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.638807 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638713 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-credential-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.638807 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638793 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:57.638988 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.638939 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-data" (OuterVolumeSpecName: "istio-data") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:57.640277 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.640257 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 21:42:57.640416 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.640400 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 21:42:57.640629 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.640610 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-kube-api-access-2bkzx" (OuterVolumeSpecName: "kube-api-access-2bkzx") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "kube-api-access-2bkzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:42:57.640686 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.640627 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-token" (OuterVolumeSpecName: "istio-token") pod "d791aaf2-900f-4e18-b891-532f1d4d4383" (UID: "d791aaf2-900f-4e18-b891-532f1d4d4383"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 21:42:57.739560 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.739515 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bkzx\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-kube-api-access-2bkzx\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.739560 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.739555 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-envoy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.739560 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.739565 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.739560 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.739573 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-podinfo\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.739798 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.739581 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-workload-socket\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:57.739798 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:57.739589 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791aaf2-900f-4e18-b891-532f1d4d4383-istio-data\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 28 21:42:58.066934 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.066853 2568 generic.go:356] "Generic (PLEG): container finished" podID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerID="e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44" exitCode=0 Jul 28 21:42:58.066934 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.066902 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" Jul 28 21:42:58.067120 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.066941 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" event={"ID":"d791aaf2-900f-4e18-b891-532f1d4d4383","Type":"ContainerDied","Data":"e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44"} Jul 28 21:42:58.067120 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.067008 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z" event={"ID":"d791aaf2-900f-4e18-b891-532f1d4d4383","Type":"ContainerDied","Data":"af8bdc6cbcba5978b4327343fcb709a28105b40f6326a4910ad1a33e55298f7e"} Jul 28 21:42:58.067120 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.067030 2568 scope.go:117] "RemoveContainer" containerID="e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44" Jul 28 21:42:58.082107 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.082088 2568 scope.go:117] "RemoveContainer" containerID="a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928" Jul 28 21:42:58.089409 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.089393 2568 scope.go:117] "RemoveContainer" containerID="e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44" Jul 28 21:42:58.089631 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:42:58.089614 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44\": container with ID starting with e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44 not found: ID does not exist" containerID="e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44" Jul 28 21:42:58.089669 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.089640 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44"} err="failed to get container status \"e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44\": rpc error: code = NotFound desc = could not find container \"e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44\": container with ID starting with e241c11e8ca7b4f84fae41dfeb915f22e17ad66e7860a68c4afc0c6c2137ae44 not found: ID does not exist" Jul 28 21:42:58.089669 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.089657 2568 scope.go:117] "RemoveContainer" containerID="a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928" Jul 28 21:42:58.089867 ip-10-0-134-221 kubenswrapper[2568]: E0728 21:42:58.089841 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928\": container with ID starting with a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928 not found: ID does not exist" containerID="a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928" Jul 28 21:42:58.089903 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.089871 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928"} err="failed to get container status \"a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928\": rpc error: code = NotFound desc = could not find container \"a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928\": container with ID starting with a0dc31567f06270456fb42237d89c2edf1323772c74a19c63b47a43fbadf9928 not found: ID does not exist" Jul 28 21:42:58.095284 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.095247 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z"] Jul 28 21:42:58.101015 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.100996 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2c3f70-openshift-default-6fd467664-xf55z"] Jul 28 21:42:58.377193 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.377158 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" path="/var/lib/kubelet/pods/d791aaf2-900f-4e18-b891-532f1d4d4383/volumes" Jul 28 21:42:58.679846 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.679773 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc774576c-7nwf2_fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453/copy-manifests/0.log" Jul 28 21:42:58.698229 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:42:58.698203 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc774576c-7nwf2_fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453/manager/0.log" Jul 28 21:43:01.392364 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:01.392331 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rzs5j_56bd08d2-7d88-4817-b5c0-269fb142b65a/manager/0.log" Jul 28 21:43:01.944343 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:01.944314 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx_703c4e3b-14aa-4b40-8e78-d62de6c49885/istio-proxy/0.log" Jul 28 21:43:02.060369 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:02.060331 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qp787_c1aff8ca-43bd-415b-a1d5-7293db4f92ff/discovery/0.log" Jul 28 21:43:03.179489 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:03.179459 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x5x6b_dfb59b61-ab4c-48d9-b5a9-714cc9bb57bc/main/0.log" Jul 28 21:43:03.392447 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:03.392392 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5qx6s_ce395859-3486-441e-b785-5eaac807d6b7/main/0.log" Jul 28 21:43:03.504132 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:03.504055 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tdnrn_d00742ab-ba0b-4ffd-b08b-aaaea06e47a3/main/0.log" Jul 28 21:43:11.679498 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:11.679458 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jqcjf_c5971d7f-c363-407b-8f3a-09619a3219e1/global-pull-secret-syncer/0.log" Jul 28 21:43:11.891046 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:11.891017 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pk6jt_9c5b9c53-c6e9-4668-863a-9b8887e3262f/konnectivity-agent/0.log" Jul 28 21:43:11.966840 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:11.966759 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-221.ec2.internal_de661c76ba7bc5e0e4094110dc9768c0/haproxy/0.log" Jul 28 21:43:17.469939 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:17.469895 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rzs5j_56bd08d2-7d88-4817-b5c0-269fb142b65a/manager/0.log" Jul 28 21:43:19.358322 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.358242 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/alertmanager/0.log" Jul 28 21:43:19.382607 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.382581 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/config-reloader/0.log" Jul 28 21:43:19.407881 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.407855 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/kube-rbac-proxy-web/0.log" Jul 28 21:43:19.431605 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.431585 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/kube-rbac-proxy/0.log" Jul 28 21:43:19.456315 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.456297 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/kube-rbac-proxy-metric/0.log" Jul 28 21:43:19.485325 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.485304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/prom-label-proxy/0.log" Jul 28 21:43:19.512445 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.512426 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5594f5fd-18bb-41c7-9b51-e0515706013b/init-config-reloader/0.log" Jul 28 21:43:19.664550 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.664530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56847789d6-grcz4_30c4826a-626b-4a6c-81f8-df7ff31694de/metrics-server/0.log" Jul 28 21:43:19.812994 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.812961 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtq4b_ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e/node-exporter/0.log" Jul 28 21:43:19.833679 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.833659 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtq4b_ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e/kube-rbac-proxy/0.log" Jul 28 21:43:19.857665 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:19.857649 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtq4b_ce602785-1f7e-4888-aaf2-a8a5e4bb1c0e/init-textfile/0.log" Jul 28 21:43:20.070932 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.070840 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/prometheus/0.log" Jul 28 21:43:20.092771 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.092749 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/config-reloader/0.log" Jul 28 21:43:20.127429 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.127407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/thanos-sidecar/0.log" Jul 28 21:43:20.149053 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.149020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/kube-rbac-proxy-web/0.log" Jul 28 21:43:20.171205 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.171186 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/kube-rbac-proxy/0.log" Jul 28 21:43:20.193403 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.193383 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/kube-rbac-proxy-thanos/0.log" Jul 28 21:43:20.215777 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.215757 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8b68be3-5d79-4ce3-9d2a-b4b85abc8530/init-config-reloader/0.log" Jul 28 21:43:20.248605 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.248582 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7hd8h_11d5259f-4cb2-41b5-b18f-4021808cf133/prometheus-operator/0.log" Jul 28 21:43:20.270835 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.270814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7hd8h_11d5259f-4cb2-41b5-b18f-4021808cf133/kube-rbac-proxy/0.log" Jul 28 21:43:20.297101 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.297082 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-glfcz_9d8b990b-05aa-47c5-8952-dc7cc9b7b223/prometheus-operator-admission-webhook/0.log" Jul 28 21:43:20.325883 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.325825 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d76459ddb-8gq9t_dec67974-9bfa-4dc2-94f6-d686e4ddb30d/telemeter-client/0.log" Jul 28 21:43:20.349328 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.349305 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d76459ddb-8gq9t_dec67974-9bfa-4dc2-94f6-d686e4ddb30d/reload/0.log" Jul 28 21:43:20.372197 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:20.372174 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d76459ddb-8gq9t_dec67974-9bfa-4dc2-94f6-d686e4ddb30d/kube-rbac-proxy/0.log" Jul 28 21:43:21.854918 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.854886 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd"] Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855246 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855269 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855281 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855288 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855295 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855302 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855318 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855324 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855334 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855339 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855395 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855406 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d791aaf2-900f-4e18-b891-532f1d4d4383" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855417 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd9d5c03-9f91-411e-b272-2a7caf6f978f" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855427 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" Jul 28 21:43:21.855430 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.855435 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c4c3a5-b4aa-49ea-96e3-24fef2242fed" containerName="istio-proxy" Jul 28 21:43:21.859716 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.859696 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:21.862525 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.862499 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-grfnp\"/\"openshift-service-ca.crt\"" Jul 28 21:43:21.863338 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.863322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-grfnp\"/\"kube-root-ca.crt\"" Jul 28 21:43:21.863456 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.863322 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-grfnp\"/\"default-dockercfg-trz77\"" Jul 28 21:43:21.868142 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.868119 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd"] Jul 28 21:43:21.951025 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.950996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-lib-modules\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:21.951173 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.951038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-sys\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:21.951173 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.951109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62s9n\" (UniqueName: \"kubernetes.io/projected/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-kube-api-access-62s9n\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:21.951173 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.951154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-proc\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:21.951293 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:21.951198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-podres\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.051806 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.051780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-sys\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.051934 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.051827 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62s9n\" (UniqueName: \"kubernetes.io/projected/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-kube-api-access-62s9n\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.051934 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.051908 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-sys\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.052056 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.051941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-proc\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.052056 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.052006 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-podres\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.052056 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.052009 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-proc\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.052056 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.052052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-lib-modules\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.052201 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.052097 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-podres\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.052201 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.052169 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-lib-modules\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.059351 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.059331 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62s9n\" (UniqueName: \"kubernetes.io/projected/aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc-kube-api-access-62s9n\") pod \"perf-node-gather-daemonset-jkjrd\" (UID: \"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc\") " pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.170667 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.170648 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:22.293373 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.293344 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/1.log" Jul 28 21:43:22.302610 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.302581 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd"] Jul 28 21:43:22.304288 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:22.304265 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-djc6f_37918386-fb9c-47d9-8d2a-b28de84c0bab/console-operator/2.log" Jul 28 21:43:22.305185 ip-10-0-134-221 kubenswrapper[2568]: W0728 21:43:22.305152 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaaae8f3e_9653_4cbc_86ba_f74f73e4cdbc.slice/crio-b0b0f7a927a67374aed595f41df6bd16c20ba6b893cbad68d6247573205a40aa WatchSource:0}: Error finding container b0b0f7a927a67374aed595f41df6bd16c20ba6b893cbad68d6247573205a40aa: Status 404 returned error can't find the container with id b0b0f7a927a67374aed595f41df6bd16c20ba6b893cbad68d6247573205a40aa Jul 28 21:43:23.183235 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:23.183201 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" event={"ID":"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc","Type":"ContainerStarted","Data":"b986758709943fb21fff4f6e525c86fdae44c3aa09fd9dcdc1c84c51fe6ac7ec"} Jul 28 21:43:23.183613 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:23.183253 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" event={"ID":"aaae8f3e-9653-4cbc-86ba-f74f73e4cdbc","Type":"ContainerStarted","Data":"b0b0f7a927a67374aed595f41df6bd16c20ba6b893cbad68d6247573205a40aa"} Jul 28 21:43:23.183613 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:23.183339 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:23.199920 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:23.199874 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" podStartSLOduration=2.199861358 podStartE2EDuration="2.199861358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 21:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:43:23.198791737 +0000 UTC m=+3367.344821960" watchObservedRunningTime="2026-07-28 21:43:23.199861358 +0000 UTC m=+3367.345891579" Jul 28 21:43:24.537553 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:24.537520 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvgbf_58409041-4cb3-4f20-8e8d-5ae8142435a0/dns/0.log" Jul 28 21:43:24.560356 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:24.560330 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvgbf_58409041-4cb3-4f20-8e8d-5ae8142435a0/kube-rbac-proxy/0.log" Jul 28 21:43:24.638653 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:24.638627 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6n4w5_eedf6297-a6a5-4015-ab30-f37a8a4b17d2/dns-node-resolver/0.log" Jul 28 21:43:25.337541 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:25.337511 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ltssv_15b803eb-bef5-4f43-95ff-be78542a558b/node-ca/0.log" Jul 28 21:43:26.281831 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:26.281803 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx_703c4e3b-14aa-4b40-8e78-d62de6c49885/istio-proxy/0.log" Jul 28 21:43:26.536581 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:26.536513 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qp787_c1aff8ca-43bd-415b-a1d5-7293db4f92ff/discovery/0.log" Jul 28 21:43:27.601124 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:27.601099 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzxjl_872957ee-58fc-4ff7-b7b0-24e61a2b4419/serve-healthcheck-canary/0.log" Jul 28 21:43:28.314595 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:28.314568 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjvck_556c2253-0f8d-4d2d-9245-e83ab33d414f/kube-rbac-proxy/0.log" Jul 28 21:43:28.336901 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:28.336882 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjvck_556c2253-0f8d-4d2d-9245-e83ab33d414f/exporter/0.log" Jul 28 21:43:28.360186 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:28.360167 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjvck_556c2253-0f8d-4d2d-9245-e83ab33d414f/extractor/0.log" Jul 28 21:43:29.197738 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:29.197711 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-grfnp/perf-node-gather-daemonset-jkjrd" Jul 28 21:43:31.262983 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:31.262883 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc774576c-7nwf2_fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453/manager/0.log" Jul 28 21:43:31.282448 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:31.282426 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc774576c-7nwf2_fa51513f-bc9f-4c7b-9dfd-9c9ee8c44453/copy-manifests/0.log" Jul 28 21:43:32.221631 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:32.221598 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx_703c4e3b-14aa-4b40-8e78-d62de6c49885/istio-proxy/0.log" Jul 28 21:43:32.482575 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:32.482498 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qp787_c1aff8ca-43bd-415b-a1d5-7293db4f92ff/discovery/0.log" Jul 28 21:43:32.646770 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:32.646742 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bb9684f66-srhfc_4cef19aa-524b-4148-94e7-33b768e55a27/manager/0.log" Jul 28 21:43:34.075473 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:34.075445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-c8txx_703c4e3b-14aa-4b40-8e78-d62de6c49885/istio-proxy/0.log" Jul 28 21:43:34.330228 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:34.330153 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qp787_c1aff8ca-43bd-415b-a1d5-7293db4f92ff/discovery/0.log" Jul 28 21:43:38.216196 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:38.216161 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6_9e1433ce-7054-4faa-9500-eaf7e4ba6f99/kube-storage-version-migrator-operator/1.log" Jul 28 21:43:38.217971 ip-10-0-134-221 kubenswrapper[2568]: I0728 21:43:38.217926 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-nzxm6_9e1433ce-7054-4faa-9500-eaf7e4ba6f99/kube-storage-version-migrator-operator/0.log"