Aug 02 10:33:12.118354 ip-10-0-141-208 systemd[1]: Starting Kubernetes Kubelet... Aug 02 10:33:12.458172 ip-10-0-141-208 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 02 10:33:12.458172 ip-10-0-141-208 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 02 10:33:12.458172 ip-10-0-141-208 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 02 10:33:12.458172 ip-10-0-141-208 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 02 10:33:12.458172 ip-10-0-141-208 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 02 10:33:12.460808 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.460739 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 02 10:33:12.465636 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465622 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 10:33:12.465636 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465636 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465640 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465643 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465647 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465650 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465653 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465657 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465661 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465665 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465668 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465671 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465673 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465676 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465678 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465681 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465684 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465686 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465689 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465692 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 10:33:12.465696 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465695 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465697 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465700 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465702 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465705 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465708 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465710 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465713 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465715 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465718 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465720 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465723 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465725 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465727 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465730 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465732 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465735 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465737 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465739 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465742 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 10:33:12.466128 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465744 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465747 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465749 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465752 2554 feature_gate.go:328] unrecognized feature gate: Example Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465754 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465757 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465759 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465761 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465764 2554 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465766 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465769 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465771 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465773 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465776 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465781 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465784 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465787 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465791 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465794 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465797 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 10:33:12.466592 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465799 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465802 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465804 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465807 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465809 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465812 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465814 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465817 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465819 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465822 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465824 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465833 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465836 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465838 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465841 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465843 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465846 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465848 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465852 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465854 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 10:33:12.467099 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465857 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465859 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465861 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465864 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465867 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465870 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465873 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465876 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465879 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465882 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465884 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465887 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465889 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465891 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465894 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465896 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465898 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465901 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.465903 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 10:33:12.467586 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466646 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466653 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466656 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466658 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466661 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466665 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466668 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466671 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466673 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466676 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466679 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466681 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466684 2554 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466687 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466689 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466691 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466694 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466696 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466699 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466703 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 10:33:12.468014 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466706 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466708 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466710 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466713 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466715 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466718 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466720 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466722 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466725 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466727 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466730 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466732 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466735 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466737 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466739 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466742 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466744 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466746 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466749 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466752 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 10:33:12.468494 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466754 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466756 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466759 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466761 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466764 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466766 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466768 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466771 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466773 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466776 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466779 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466781 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466784 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466786 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466789 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466791 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466796 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466799 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466802 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466805 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 10:33:12.468956 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466808 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466811 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466813 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466816 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466818 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466821 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466823 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466826 2554 feature_gate.go:328] unrecognized feature gate: Example Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466828 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466830 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466834 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466838 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466841 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466844 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466846 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466849 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466851 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466854 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466856 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466859 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 10:33:12.469437 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466862 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466865 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466869 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466871 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466874 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466876 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466879 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466882 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466885 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466887 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466890 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466892 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466895 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466897 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466900 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466902 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466905 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466907 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.466910 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 10:33:12.469904 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467271 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467277 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467280 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467283 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467286 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467290 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467294 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467296 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467299 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467302 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467304 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467307 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467309 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467312 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467315 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467318 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467320 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467323 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467326 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 10:33:12.470365 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467328 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467331 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467334 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467337 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467339 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467341 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467346 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467349 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467352 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467355 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467358 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467361 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467364 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467367 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467369 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467372 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467374 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467376 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467379 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467382 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 10:33:12.470884 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467384 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467387 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467390 2554 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467393 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467395 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467398 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467403 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467405 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467409 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467411 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467414 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467416 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467419 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467422 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467424 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467427 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467429 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467431 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467434 2554 feature_gate.go:328] unrecognized feature gate: Example Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467437 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 10:33:12.471376 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467439 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467441 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467444 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467446 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467449 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467452 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467454 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467457 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467460 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467462 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467464 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467467 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467470 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467472 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467475 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467477 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467480 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467482 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467487 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 10:33:12.471867 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467489 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467492 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467494 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467498 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467501 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467504 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467507 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467510 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467512 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467515 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467517 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467520 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467522 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467525 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467527 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467529 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467532 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467536 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467538 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467541 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 10:33:12.472337 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.467543 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467605 2554 flags.go:64] FLAG: --address="0.0.0.0" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467612 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467617 2554 flags.go:64] FLAG: --anonymous-auth="true" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467621 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467625 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467629 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467632 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467636 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467639 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467642 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467648 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467652 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467655 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467658 2554 flags.go:64] FLAG: --cgroup-root="" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467661 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467663 2554 flags.go:64] FLAG: --client-ca-file="" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467667 2554 flags.go:64] FLAG: --cloud-provider="external" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467670 2554 flags.go:64] FLAG: --cluster-dns="[]" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467677 2554 flags.go:64] FLAG: --cluster-domain="" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467680 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467683 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467686 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467688 2554 flags.go:64] FLAG: --container-log-max-files="5" Aug 02 10:33:12.472795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467692 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467695 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467698 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467701 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467704 2554 flags.go:64] FLAG: --contention-profiling="false" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467707 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467710 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467713 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467716 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467720 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467722 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467725 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467728 2554 flags.go:64] FLAG: --enable-load-reader="false" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467731 2554 flags.go:64] FLAG: --enable-server="true" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467742 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467746 2554 flags.go:64] FLAG: --event-burst="100" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467749 2554 flags.go:64] FLAG: --event-qps="50" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467751 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467754 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467757 2554 flags.go:64] FLAG: --eviction-hard="" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467761 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467764 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467767 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467770 2554 flags.go:64] FLAG: --eviction-soft="" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467773 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 02 10:33:12.473367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467776 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467778 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467781 2554 flags.go:64] FLAG: --experimental-mounter-path="" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467784 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467787 2554 flags.go:64] FLAG: --fail-swap-on="true" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467790 2554 flags.go:64] FLAG: --feature-gates="" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467793 2554 flags.go:64] FLAG: --file-check-frequency="20s" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467796 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467798 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467801 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467804 2554 flags.go:64] FLAG: --healthz-port="10248" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467808 2554 flags.go:64] FLAG: --help="false" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467810 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467814 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467816 2554 flags.go:64] FLAG: --http-check-frequency="20s" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467820 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467823 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467826 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467829 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467832 2554 flags.go:64] FLAG: --image-service-endpoint="" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467835 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467838 2554 flags.go:64] FLAG: --kube-api-burst="100" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467847 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467851 2554 flags.go:64] FLAG: --kube-api-qps="50" Aug 02 10:33:12.473988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467853 2554 flags.go:64] FLAG: --kube-reserved="" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467857 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467860 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467863 2554 flags.go:64] FLAG: --kubelet-cgroups="" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467866 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467869 2554 flags.go:64] FLAG: --lock-file="" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467872 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467875 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467878 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467883 2554 flags.go:64] FLAG: --log-json-split-stream="false" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467886 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467889 2554 flags.go:64] FLAG: --log-text-split-stream="false" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467892 2554 flags.go:64] FLAG: --logging-format="text" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467895 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467898 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467901 2554 flags.go:64] FLAG: --manifest-url="" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467903 2554 flags.go:64] FLAG: --manifest-url-header="" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467908 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467910 2554 flags.go:64] FLAG: --max-open-files="1000000" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467914 2554 flags.go:64] FLAG: --max-pods="110" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467917 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467920 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467923 2554 flags.go:64] FLAG: --memory-manager-policy="None" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467926 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467929 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 02 10:33:12.474578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467932 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467935 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467942 2554 flags.go:64] FLAG: --node-status-max-images="50" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467944 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467947 2554 flags.go:64] FLAG: --oom-score-adj="-999" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467950 2554 flags.go:64] FLAG: --pod-cidr="" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467954 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467958 2554 flags.go:64] FLAG: --pod-manifest-path="" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467961 2554 flags.go:64] FLAG: --pod-max-pids="-1" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467964 2554 flags.go:64] FLAG: --pods-per-core="0" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467967 2554 flags.go:64] FLAG: --port="10250" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467970 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467973 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e20e578cf30629df" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467976 2554 flags.go:64] FLAG: --qos-reserved="" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467979 2554 flags.go:64] FLAG: --read-only-port="10255" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467982 2554 flags.go:64] FLAG: --register-node="true" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467984 2554 flags.go:64] FLAG: --register-with-taints="" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467988 2554 flags.go:64] FLAG: --registry-burst="10" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467990 2554 flags.go:64] FLAG: --registry-qps="5" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467993 2554 flags.go:64] FLAG: --reserved-cpus="" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467996 2554 flags.go:64] FLAG: --reserved-memory="" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.467999 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468002 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468005 2554 flags.go:64] FLAG: --rotate-certificates="false" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468008 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 02 10:33:12.475230 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468010 2554 flags.go:64] FLAG: --runonce="false" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468013 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468016 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468019 2554 flags.go:64] FLAG: --seccomp-default="false" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468022 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468025 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468028 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468031 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468034 2554 flags.go:64] FLAG: --storage-driver-password="root" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468037 2554 flags.go:64] FLAG: --storage-driver-secure="false" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468039 2554 flags.go:64] FLAG: --storage-driver-table="stats" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468042 2554 flags.go:64] FLAG: --storage-driver-user="root" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468045 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468047 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468051 2554 flags.go:64] FLAG: --system-cgroups="" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468054 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468060 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468064 2554 flags.go:64] FLAG: --tls-cert-file="" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468066 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468070 2554 flags.go:64] FLAG: --tls-min-version="" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468073 2554 flags.go:64] FLAG: --tls-private-key-file="" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468076 2554 flags.go:64] FLAG: --topology-manager-policy="none" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468079 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468081 2554 flags.go:64] FLAG: --topology-manager-scope="container" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468084 2554 flags.go:64] FLAG: --v="2" Aug 02 10:33:12.475797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468088 2554 flags.go:64] FLAG: --version="false" Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468091 2554 flags.go:64] FLAG: --vmodule="" Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468095 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.468098 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468222 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468227 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468230 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468233 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468237 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468240 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468242 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468245 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468247 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468250 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468253 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468255 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468257 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468260 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468262 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468265 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 10:33:12.476382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468268 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468270 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468273 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468275 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468279 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468281 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468284 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468286 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468289 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468291 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468295 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468299 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468302 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468304 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468307 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468310 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468313 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468316 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468319 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 10:33:12.476853 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468321 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468325 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468327 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468329 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468332 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468334 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468336 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468339 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468341 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468345 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468348 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468351 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468353 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468356 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468358 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468360 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468363 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468367 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468369 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 10:33:12.477384 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468372 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468374 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468377 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468380 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468382 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468385 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468387 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468390 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468403 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468406 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468408 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468411 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468413 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468416 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468420 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468422 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468425 2554 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468427 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468431 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468434 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 10:33:12.477826 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468437 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468440 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468442 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468444 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468447 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468450 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468452 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468455 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468457 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468460 2554 feature_gate.go:328] unrecognized feature gate: Example Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468464 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468467 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468470 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468472 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468474 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468477 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468479 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468482 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468484 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 10:33:12.478307 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468487 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468489 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468492 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468494 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468497 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.468500 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.469235 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.475452 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.475468 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.475486 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.475492 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475552 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475557 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475561 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475563 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 10:33:12.478772 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475566 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475569 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475572 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475575 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475577 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475580 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475582 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475586 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475589 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475592 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475595 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475598 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475602 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475605 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475608 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475610 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475614 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475616 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475619 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 10:33:12.479137 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475621 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475624 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475626 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475629 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475631 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475634 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475643 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475646 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475648 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475651 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475653 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475656 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475659 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475661 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475664 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475667 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475670 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475672 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475674 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475677 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 10:33:12.479582 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475679 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475682 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475684 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475687 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475689 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475692 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475694 2554 feature_gate.go:328] unrecognized feature gate: Example Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475697 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475699 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475702 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475704 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475707 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475710 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475712 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475715 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475717 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475720 2554 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475722 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475725 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475735 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 10:33:12.480060 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475738 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475740 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475743 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475745 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475748 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475751 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475753 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475755 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475758 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475760 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475762 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475765 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475767 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475770 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475772 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475775 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475777 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475779 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475782 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475784 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 10:33:12.480527 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475787 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475789 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475792 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475794 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475798 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475802 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475804 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475807 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475809 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475812 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475815 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475817 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475825 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475828 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475830 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 10:33:12.480988 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475833 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.475837 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475976 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475982 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475985 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475988 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475992 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475995 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.475998 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476001 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476003 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476006 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476008 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476011 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 02 10:33:12.481421 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476015 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476018 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476021 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476024 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476026 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476029 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476033 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476035 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476038 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476041 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476043 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476046 2554 feature_gate.go:328] unrecognized feature gate: Example Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476048 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476051 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476053 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476056 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476065 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476068 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476070 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476073 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 02 10:33:12.481752 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476075 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476077 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476080 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476082 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476084 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476087 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476089 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476092 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476094 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476097 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476099 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476101 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476104 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476106 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476108 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476111 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476113 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476128 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476131 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476134 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 02 10:33:12.482243 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476136 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476139 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476141 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476144 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476146 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476149 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476152 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476154 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476157 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476165 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476168 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476171 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476173 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476176 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476178 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476180 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476183 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476185 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476188 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 02 10:33:12.482989 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476190 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476192 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476195 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476197 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476200 2554 feature_gate.go:328] unrecognized feature gate: Example2 Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476202 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476204 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476207 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476209 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476212 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476214 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476217 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476220 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476222 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476224 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476227 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476229 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476232 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476235 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476237 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 02 10:33:12.483737 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476240 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476242 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476261 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476270 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476274 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476278 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476280 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:12.476283 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.476287 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.476408 2554 server.go:962] "Client rotation is on, will bootstrap in background" Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.478408 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.479679 2554 server.go:1019] "Starting client certificate rotation" Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.479771 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 02 10:33:12.484357 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.479804 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 02 10:33:12.484686 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.484512 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 02 10:33:12.488980 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.488964 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 02 10:33:12.497714 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.497699 2554 log.go:25] "Validated CRI v1 runtime API" Aug 02 10:33:12.499657 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.499640 2554 log.go:25] "Validated CRI v1 image API" Aug 02 10:33:12.501110 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.501080 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 02 10:33:12.503696 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.503676 2554 fs.go:135] Filesystem UUIDs: map[43ed24d7-9835-48bf-b410-91ad772c1022:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a7ad2efc-2d3a-45fc-a501-b3c3e7273316:/dev/nvme0n1p3] Aug 02 10:33:12.503772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.503696 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 02 10:33:12.508492 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.508383 2554 manager.go:216] Machine: {Timestamp:2026-08-02 10:33:12.507172547 +0000 UTC m=+0.289527502 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3195534 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b212ef74542942ef871305abd0a04 SystemUUID:ec2b212e-f745-4294-2ef8-71305abd0a04 BootID:321aa137-4c93-481f-94c9-7b370a03f958 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:4b:f4:37:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:4b:f4:37:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:e4:0e:eb:88:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 02 10:33:12.508492 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.508482 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 02 10:33:12.508611 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.508553 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 02 10:33:12.512150 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.512132 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 02 10:33:12.512833 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.512808 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 02 10:33:12.512965 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.512840 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-208.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 02 10:33:12.513747 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.513736 2554 topology_manager.go:138] "Creating topology manager with none policy" Aug 02 10:33:12.513788 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.513749 2554 container_manager_linux.go:309] "Creating device plugin manager" Aug 02 10:33:12.513788 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.513757 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 02 10:33:12.514412 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.514401 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 02 10:33:12.515626 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.515616 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 02 10:33:12.519207 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519195 2554 state_mem.go:36] "Initialized new in-memory state store" Aug 02 10:33:12.519323 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519314 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 02 10:33:12.519355 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519342 2554 kubelet.go:486] "Attempting to sync node with API server" Aug 02 10:33:12.519387 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519363 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 02 10:33:12.519416 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519395 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 02 10:33:12.519416 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519407 2554 kubelet.go:398] "Adding apiserver pod source" Aug 02 10:33:12.519488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519480 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 02 10:33:12.519873 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519856 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 02 10:33:12.519959 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.519899 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 02 10:33:12.522910 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.522873 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 02 10:33:12.524786 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.524768 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 02 10:33:12.524878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.524800 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 02 10:33:12.525371 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525360 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 02 10:33:12.525421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525375 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 02 10:33:12.525421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525381 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 02 10:33:12.525421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525387 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 02 10:33:12.525421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525396 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 02 10:33:12.525421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525404 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 02 10:33:12.525580 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525571 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 02 10:33:12.525580 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525580 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 02 10:33:12.525667 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525587 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 02 10:33:12.525667 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525592 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 02 10:33:12.525667 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525600 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 02 10:33:12.525667 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.525607 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 02 10:33:12.526266 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.526254 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 02 10:33:12.526302 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.526267 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 02 10:33:12.529441 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.529414 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-208.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 02 10:33:12.529441 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.529433 2554 server.go:1268] "Started kubelet" Aug 02 10:33:12.529573 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.529482 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 02 10:33:12.529573 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.529521 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 02 10:33:12.529573 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.529539 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 02 10:33:12.529702 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.529595 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 02 10:33:12.529979 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.529846 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 02 10:33:12.530170 ip-10-0-141-208 systemd[1]: Started Kubernetes Kubelet. Aug 02 10:33:12.530876 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.530697 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 02 10:33:12.531889 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.531872 2554 server.go:310] "Adding debug handlers to kubelet server" Aug 02 10:33:12.534920 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.534899 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 02 10:33:12.536203 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536184 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 02 10:33:12.536293 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536188 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 02 10:33:12.536346 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.536295 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:12.536763 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536748 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 02 10:33:12.536763 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536763 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 02 10:33:12.536898 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536872 2554 reconstruct.go:97] "Volume reconstruction finished" Aug 02 10:33:12.536898 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536879 2554 reconciler.go:29] "Reconciler: start to sync state" Aug 02 10:33:12.536996 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.536962 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 02 10:33:12.537260 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537231 2554 factory.go:55] Registering systemd factory Aug 02 10:33:12.537339 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537280 2554 factory.go:223] Registration of the systemd container factory successfully Aug 02 10:33:12.537481 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537460 2554 factory.go:153] Registering CRI-O factory Aug 02 10:33:12.537481 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537483 2554 factory.go:223] Registration of the crio container factory successfully Aug 02 10:33:12.537631 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537545 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 02 10:33:12.537631 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537573 2554 factory.go:103] Registering Raw factory Aug 02 10:33:12.537631 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537601 2554 manager.go:1196] Started watching for new ooms in manager Aug 02 10:33:12.538000 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.537988 2554 manager.go:349] Starting recovery of all containers Aug 02 10:33:12.538383 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.538351 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 02 10:33:12.539788 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.538626 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-208.ec2.internal.18c7f67ca7ed3237 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-208.ec2.internal,UID:ip-10-0-141-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-208.ec2.internal,},FirstTimestamp:2026-08-02 10:33:12.529408567 +0000 UTC m=+0.311763520,LastTimestamp:2026-08-02 10:33:12.529408567 +0000 UTC m=+0.311763520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-208.ec2.internal,}" Aug 02 10:33:12.545393 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.545366 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 02 10:33:12.547923 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.547888 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 02 10:33:12.548575 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.548561 2554 manager.go:354] Recovery completed Aug 02 10:33:12.550336 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.550313 2554 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Aug 02 10:33:12.553524 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.553512 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.555183 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555167 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.555258 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555193 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.555258 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555203 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.555747 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555729 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 02 10:33:12.555747 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555744 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.555877 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555746 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 02 10:33:12.555877 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.555782 2554 state_mem.go:36] "Initialized new in-memory state store" Aug 02 10:33:12.556382 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.556362 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.556440 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.556396 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.556440 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.556408 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.556923 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.556910 2554 policy_none.go:49] "None policy: Start" Aug 02 10:33:12.556970 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.556927 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 02 10:33:12.556970 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.556937 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 02 10:33:12.557948 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.557937 2554 policy_none.go:47] "Start" Aug 02 10:33:12.559080 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.559066 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-94fvf" Aug 02 10:33:12.565762 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.565693 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-208.ec2.internal.18c7f67ca9767540 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-208.ec2.internal,UID:ip-10-0-141-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-208.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-208.ec2.internal,},FirstTimestamp:2026-08-02 10:33:12.555181376 +0000 UTC m=+0.337536330,LastTimestamp:2026-08-02 10:33:12.555181376 +0000 UTC m=+0.337536330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-208.ec2.internal,}" Aug 02 10:33:12.567130 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.567102 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-94fvf" Aug 02 10:33:12.592840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.592664 2554 manager.go:337] "Starting Device Plugin manager" Aug 02 10:33:12.592840 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.592802 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 02 10:33:12.592840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.592813 2554 server.go:87] "Starting device plugin registration server" Aug 02 10:33:12.593014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.593003 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 02 10:33:12.593046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.593017 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 02 10:33:12.593273 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.593148 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 02 10:33:12.593273 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.593212 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 02 10:33:12.593273 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.593221 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 02 10:33:12.593622 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.593605 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 02 10:33:12.593698 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.593649 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:12.661369 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.661350 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 02 10:33:12.662540 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.661384 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 02 10:33:12.662540 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.661400 2554 kubelet.go:2448] "Starting kubelet main sync loop" Aug 02 10:33:12.662540 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.661427 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 02 10:33:12.663407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.663390 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 10:33:12.693946 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.693923 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.694612 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.694598 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.694671 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.694623 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.694671 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.694634 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.694671 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.694659 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.703124 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.703103 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.703204 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.703139 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-208.ec2.internal\": node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:12.727010 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.726956 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:12.762285 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.762262 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal"] Aug 02 10:33:12.762372 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.762323 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.763043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.763029 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.763104 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.763053 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.763104 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.763066 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.764238 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.764225 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.764350 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.764338 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.764385 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.764363 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.764885 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.764867 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.764972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.764896 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.764972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.764907 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.765255 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.765235 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.765322 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.765258 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.765322 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.765272 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.766395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.766381 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.766475 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.766404 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 02 10:33:12.767013 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.766996 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientMemory" Aug 02 10:33:12.767089 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.767020 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasNoDiskPressure" Aug 02 10:33:12.767089 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.767035 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeHasSufficientPID" Aug 02 10:33:12.791755 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.791739 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-208.ec2.internal\" not found" node="ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.795799 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.795785 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-208.ec2.internal\" not found" node="ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.827516 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.827497 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:12.838848 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.838829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/879b6d327f2c06772af8f06d3e269a3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal\" (UID: \"879b6d327f2c06772af8f06d3e269a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.838924 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.838858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/879b6d327f2c06772af8f06d3e269a3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal\" (UID: \"879b6d327f2c06772af8f06d3e269a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.838924 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.838887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d404b1b7bc2e059ff3b97eda506ec18-config\") pod \"kube-apiserver-proxy-ip-10-0-141-208.ec2.internal\" (UID: \"8d404b1b7bc2e059ff3b97eda506ec18\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.928107 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:12.928081 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:12.939464 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.939446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d404b1b7bc2e059ff3b97eda506ec18-config\") pod \"kube-apiserver-proxy-ip-10-0-141-208.ec2.internal\" (UID: \"8d404b1b7bc2e059ff3b97eda506ec18\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.939530 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.939468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/879b6d327f2c06772af8f06d3e269a3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal\" (UID: \"879b6d327f2c06772af8f06d3e269a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.939530 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.939484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/879b6d327f2c06772af8f06d3e269a3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal\" (UID: \"879b6d327f2c06772af8f06d3e269a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.939530 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.939509 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/879b6d327f2c06772af8f06d3e269a3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal\" (UID: \"879b6d327f2c06772af8f06d3e269a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.939622 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.939539 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d404b1b7bc2e059ff3b97eda506ec18-config\") pod \"kube-apiserver-proxy-ip-10-0-141-208.ec2.internal\" (UID: \"8d404b1b7bc2e059ff3b97eda506ec18\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" Aug 02 10:33:12.939622 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:12.939548 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/879b6d327f2c06772af8f06d3e269a3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal\" (UID: \"879b6d327f2c06772af8f06d3e269a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:13.028851 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.028801 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:13.094339 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.094322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:13.098920 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.098406 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" Aug 02 10:33:13.129243 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.129224 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:13.236570 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.236545 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:13.341695 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.341621 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-208.ec2.internal\" not found" Aug 02 10:33:13.350359 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.350333 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 10:33:13.350439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.350364 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 10:33:13.436694 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.436671 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" Aug 02 10:33:13.449109 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.449090 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 02 10:33:13.451418 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.451404 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" Aug 02 10:33:13.466514 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.466496 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 02 10:33:13.479603 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.479585 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 02 10:33:13.479718 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.479699 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 02 10:33:13.479782 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.479712 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 02 10:33:13.520338 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.520319 2554 apiserver.go:52] "Watching apiserver" Aug 02 10:33:13.532227 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.532206 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 02 10:33:13.532545 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.532525 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9zzhv","kube-system/konnectivity-agent-ctnjw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2","openshift-cluster-node-tuning-operator/tuned-4nhs2","openshift-multus/multus-6pdz4","openshift-multus/network-metrics-daemon-sg228","openshift-network-diagnostics/network-check-target-vqk48","kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal","openshift-dns/node-resolver-mnx6v","openshift-image-registry/node-ca-k5v79","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal","openshift-multus/multus-additional-cni-plugins-svb6t","openshift-network-operator/iptables-alerter-gqpwc","openshift-ovn-kubernetes/ovnkube-node-bd5dw"] Aug 02 10:33:13.534055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.534039 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.535318 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.535300 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:13.535392 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.535371 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:13.536613 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.536596 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 02 10:33:13.536664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.536647 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.537078 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.537059 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 02 10:33:13.537480 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.537463 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 02 10:33:13.538179 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.538166 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4vhpp\"" Aug 02 10:33:13.538501 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.538490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.538864 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.538850 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 02 10:33:13.540092 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.540078 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.540530 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.540514 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.540684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.540669 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v7dmb\"" Aug 02 10:33:13.541422 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.541409 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:13.541490 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.541473 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:13.541760 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.541746 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.541808 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.541749 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.541808 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.541768 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tpp5r\"" Aug 02 10:33:13.541808 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.541778 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.542630 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.542613 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.542757 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.542710 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:13.542955 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.542925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysctl-d\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.542955 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.542933 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.542955 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.542942 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.542977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7903a14d-8514-40cb-be78-4de9b11aa3d3-tmp\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.542982 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vckpj\" (UniqueName: \"kubernetes.io/projected/7903a14d-8514-40cb-be78-4de9b11aa3d3-kube-api-access-vckpj\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36093ce8-c36e-46b8-8cf0-42c27e9b7066-konnectivity-ca\") pod \"konnectivity-agent-ctnjw\" (UID: \"36093ce8-c36e-46b8-8cf0-42c27e9b7066\") " pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-device-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543086 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543119 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-run\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8fm\" (UniqueName: \"kubernetes.io/projected/8c0bab4d-a144-4be4-845e-f17d63330e34-kube-api-access-vj8fm\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysctl-conf\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-systemd\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-var-lib-kubelet\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-host\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543267 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-tuned\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36093ce8-c36e-46b8-8cf0-42c27e9b7066-agent-certs\") pod \"konnectivity-agent-ctnjw\" (UID: \"36093ce8-c36e-46b8-8cf0-42c27e9b7066\") " pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543353 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543420 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543415 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-socket-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543445 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-registration-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-sys-fs\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysconfig\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-sys\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-lib-modules\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543618 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-modprobe-d\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.543867 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-kubernetes\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.544250 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.543988 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.545406 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.545387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.545792 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.545776 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l4wzk\"" Aug 02 10:33:13.546982 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.546962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.547078 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.546980 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z5jzw\"" Aug 02 10:33:13.547078 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.547014 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.547408 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.547390 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.547810 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.547789 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5c7vk\"" Aug 02 10:33:13.548572 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.548066 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 02 10:33:13.548572 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.548105 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.548572 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.548423 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.548572 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.548538 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.549521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.549506 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 02 10:33:13.550205 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.550174 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.551074 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.550801 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 02 10:33:13.551916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.551391 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bzd2\"" Aug 02 10:33:13.551916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.551460 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.551916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.551471 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 02 10:33:13.551916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.551742 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.552323 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.552305 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cvv5t\"" Aug 02 10:33:13.553073 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.553026 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 02 10:33:13.553711 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.553695 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 02 10:33:13.553814 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.553712 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 02 10:33:13.553814 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.553711 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 02 10:33:13.553935 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.553821 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8dx9b\"" Aug 02 10:33:13.555094 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.555078 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 02 10:33:13.555183 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.555131 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 02 10:33:13.555264 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.555249 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 02 10:33:13.570691 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.570657 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-01 10:28:12 +0000 UTC" deadline="2028-03-15 18:42:50.545295017 +0000 UTC" Aug 02 10:33:13.570691 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.570689 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14192h9m36.974607966s" Aug 02 10:33:13.594334 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.594311 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hxsm2" Aug 02 10:33:13.604198 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.604177 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hxsm2" Aug 02 10:33:13.638365 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.638344 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 02 10:33:13.643838 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysconfig\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.643966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a5152e7-9144-44ce-9926-e69323299662-host-slash\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.643966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-var-lib-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.643966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643905 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-node-log\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.643966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643929 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovnkube-script-lib\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.643966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxpb\" (UniqueName: \"kubernetes.io/projected/ca39a0ce-4030-4d12-b7d9-99f45bffa241-kube-api-access-xjxpb\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.643966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643952 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysconfig\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.644290 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.643976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7903a14d-8514-40cb-be78-4de9b11aa3d3-tmp\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.644290 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-systemd\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.644290 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644027 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.644290 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca39a0ce-4030-4d12-b7d9-99f45bffa241-host\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644309 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4dj\" (UniqueName: \"kubernetes.io/projected/118f5d77-248c-4b45-a0cd-1e9648441505-kube-api-access-hf4dj\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644316 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644343 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36093ce8-c36e-46b8-8cf0-42c27e9b7066-konnectivity-ca\") pod \"konnectivity-agent-ctnjw\" (UID: \"36093ce8-c36e-46b8-8cf0-42c27e9b7066\") " pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-device-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-run\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4402ce57-5dd1-4e02-b524-79b116c2f040-hosts-file\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644480 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644563 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-device-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-run\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644624 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644654 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvgcp\" (UniqueName: \"kubernetes.io/projected/4402ce57-5dd1-4e02-b524-79b116c2f040-kube-api-access-vvgcp\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644681 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d5v5\" (UniqueName: \"kubernetes.io/projected/0965e2da-cc3e-491e-b98f-e0dff34143eb-kube-api-access-5d5v5\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.644715 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644705 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-log-socket\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-env-overrides\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-system-cni-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vckpj\" (UniqueName: \"kubernetes.io/projected/7903a14d-8514-40cb-be78-4de9b11aa3d3-kube-api-access-vckpj\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644792 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a5152e7-9144-44ce-9926-e69323299662-iptables-alerter-script\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-kubelet\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysctl-d\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-os-release\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-run-netns\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-etc-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-ovn\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644959 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-cni-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.644984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-k8s-cni-cncf-io\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645067 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36093ce8-c36e-46b8-8cf0-42c27e9b7066-konnectivity-ca\") pod \"konnectivity-agent-ctnjw\" (UID: \"36093ce8-c36e-46b8-8cf0-42c27e9b7066\") " pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.645394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645085 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-cni-bin\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca39a0ce-4030-4d12-b7d9-99f45bffa241-serviceca\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysctl-d\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysctl-conf\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-systemd\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645317 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-host\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645363 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-systemd-units\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-systemd\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-sysctl-conf\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-sys-fs\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645435 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-host\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-lib-modules\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645504 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-sys-fs\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645513 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-lib-modules\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.646192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-slash\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovnkube-config\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-socket-dir-parent\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4dfr\" (UniqueName: \"kubernetes.io/projected/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-kube-api-access-t4dfr\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e19d4e47-67bb-4e6f-a97c-9177040e3552-dbus\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-modprobe-d\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645719 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-cnibin\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xxp\" (UniqueName: \"kubernetes.io/projected/9a5152e7-9144-44ce-9926-e69323299662-kube-api-access-v2xxp\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645769 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-netns\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-conf-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645795 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-modprobe-d\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e19d4e47-67bb-4e6f-a97c-9177040e3552-kubelet-config\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-var-lib-kubelet\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4402ce57-5dd1-4e02-b524-79b116c2f040-tmp-dir\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-kubelet\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645915 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-var-lib-kubelet\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.647125 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj79s\" (UniqueName: \"kubernetes.io/projected/2727b693-d5c7-4e0f-9a01-568bab7341ed-kube-api-access-kj79s\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645970 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-cnibin\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.645997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-hostroot\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36093ce8-c36e-46b8-8cf0-42c27e9b7066-agent-certs\") pod \"konnectivity-agent-ctnjw\" (UID: \"36093ce8-c36e-46b8-8cf0-42c27e9b7066\") " pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-socket-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-sys\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-system-cni-dir\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646267 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-daemon-config\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-etc-kubernetes\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-kubernetes\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646355 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-socket-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-cni-bin\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-sys\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-cni-netd\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646437 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-kubernetes\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovn-node-metrics-cert\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.648037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-cni-binary-copy\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-multus-certs\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646626 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8fm\" (UniqueName: \"kubernetes.io/projected/8c0bab4d-a144-4be4-845e-f17d63330e34-kube-api-access-vj8fm\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646648 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-tuned\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-os-release\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-cni-multus\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646768 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-registration-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.646928 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.647039 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c0bab4d-a144-4be4-845e-f17d63330e34-registration-dir\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.648169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7903a14d-8514-40cb-be78-4de9b11aa3d3-tmp\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.648972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.648665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36093ce8-c36e-46b8-8cf0-42c27e9b7066-agent-certs\") pod \"konnectivity-agent-ctnjw\" (UID: \"36093ce8-c36e-46b8-8cf0-42c27e9b7066\") " pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.649756 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.649721 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7903a14d-8514-40cb-be78-4de9b11aa3d3-etc-tuned\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.651736 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.651716 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:13.651814 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.651744 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:13.651814 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.651754 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:13.651814 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.651806 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:14.151790967 +0000 UTC m=+1.934145932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:13.653987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.653945 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vckpj\" (UniqueName: \"kubernetes.io/projected/7903a14d-8514-40cb-be78-4de9b11aa3d3-kube-api-access-vckpj\") pod \"tuned-4nhs2\" (UID: \"7903a14d-8514-40cb-be78-4de9b11aa3d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.654291 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.654272 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8fm\" (UniqueName: \"kubernetes.io/projected/8c0bab4d-a144-4be4-845e-f17d63330e34-kube-api-access-vj8fm\") pod \"aws-ebs-csi-driver-node-4c6d2\" (UID: \"8c0bab4d-a144-4be4-845e-f17d63330e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.720188 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.720163 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879b6d327f2c06772af8f06d3e269a3f.slice/crio-f14589fe66e520d3b34d8d9f07152e72480466768b5087eddb597227bca3e997 WatchSource:0}: Error finding container f14589fe66e520d3b34d8d9f07152e72480466768b5087eddb597227bca3e997: Status 404 returned error can't find the container with id f14589fe66e520d3b34d8d9f07152e72480466768b5087eddb597227bca3e997 Aug 02 10:33:13.725899 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.725886 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 10:33:13.747055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4402ce57-5dd1-4e02-b524-79b116c2f040-hosts-file\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.747167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvgcp\" (UniqueName: \"kubernetes.io/projected/4402ce57-5dd1-4e02-b524-79b116c2f040-kube-api-access-vvgcp\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.747167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747155 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4402ce57-5dd1-4e02-b524-79b116c2f040-hosts-file\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.747167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d5v5\" (UniqueName: \"kubernetes.io/projected/0965e2da-cc3e-491e-b98f-e0dff34143eb-kube-api-access-5d5v5\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747175 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-log-socket\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-env-overrides\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747236 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-log-socket\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-system-cni-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a5152e7-9144-44ce-9926-e69323299662-iptables-alerter-script\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-kubelet\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-os-release\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-run-netns\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-etc-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-ovn\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747432 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-system-cni-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-cni-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747441 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-os-release\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.747512 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747495 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-kubelet\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747574 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-run-netns\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-ovn\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-etc-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747601 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-k8s-cni-cncf-io\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-cni-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747663 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747696 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-env-overrides\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-k8s-cni-cncf-io\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-cni-bin\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca39a0ce-4030-4d12-b7d9-99f45bffa241-serviceca\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-cni-bin\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-systemd-units\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747863 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.747888 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-slash\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.748231 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747914 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-systemd-units\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovnkube-config\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747957 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-slash\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.747967 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-socket-dir-parent\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.747999 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:14.247977875 +0000 UTC m=+2.030332826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748038 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-socket-dir-parent\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4dfr\" (UniqueName: \"kubernetes.io/projected/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-kube-api-access-t4dfr\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e19d4e47-67bb-4e6f-a97c-9177040e3552-dbus\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748102 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a5152e7-9144-44ce-9926-e69323299662-iptables-alerter-script\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-cnibin\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xxp\" (UniqueName: \"kubernetes.io/projected/9a5152e7-9144-44ce-9926-e69323299662-kube-api-access-v2xxp\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748193 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e19d4e47-67bb-4e6f-a97c-9177040e3552-dbus\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-netns\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748211 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.748232 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748240 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-cnibin\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.749248 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748251 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca39a0ce-4030-4d12-b7d9-99f45bffa241-serviceca\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748267 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-conf-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:13.748281 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:14.248263601 +0000 UTC m=+2.030618548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-conf-dir\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748290 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-netns\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e19d4e47-67bb-4e6f-a97c-9177040e3552-kubelet-config\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4402ce57-5dd1-4e02-b524-79b116c2f040-tmp-dir\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748376 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-kubelet\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748385 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e19d4e47-67bb-4e6f-a97c-9177040e3552-kubelet-config\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj79s\" (UniqueName: \"kubernetes.io/projected/2727b693-d5c7-4e0f-9a01-568bab7341ed-kube-api-access-kj79s\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-cnibin\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-kubelet\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748463 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovnkube-config\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748483 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-hostroot\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-cnibin\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748514 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-system-cni-dir\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748539 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-hostroot\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.749897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-daemon-config\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748566 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0965e2da-cc3e-491e-b98f-e0dff34143eb-system-cni-dir\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-etc-kubernetes\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-etc-kubernetes\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-cni-bin\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-cni-netd\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovn-node-metrics-cert\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748677 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4402ce57-5dd1-4e02-b524-79b116c2f040-tmp-dir\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-cni-binary-copy\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-cni-bin\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-multus-certs\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748696 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-cni-netd\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-os-release\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-cni-multus\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a5152e7-9144-44ce-9926-e69323299662-host-slash\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.750456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-var-lib-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-node-log\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovnkube-script-lib\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxpb\" (UniqueName: \"kubernetes.io/projected/ca39a0ce-4030-4d12-b7d9-99f45bffa241-kube-api-access-xjxpb\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748897 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-systemd\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca39a0ce-4030-4d12-b7d9-99f45bffa241-host\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4dj\" (UniqueName: \"kubernetes.io/projected/118f5d77-248c-4b45-a0cd-1e9648441505-kube-api-access-hf4dj\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.748990 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-var-lib-openvswitch\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749038 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-run-multus-certs\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749132 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-cni-binary-copy\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749133 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-multus-daemon-config\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749214 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-os-release\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749229 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-node-log\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749270 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-host-var-lib-cni-multus\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749287 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749332 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca39a0ce-4030-4d12-b7d9-99f45bffa241-host\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749220 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2727b693-d5c7-4e0f-9a01-568bab7341ed-run-systemd\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749353 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a5152e7-9144-44ce-9926-e69323299662-host-slash\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.751628 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749516 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.751628 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.749623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovnkube-script-lib\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.751628 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.750275 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0965e2da-cc3e-491e-b98f-e0dff34143eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.751628 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.750812 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2727b693-d5c7-4e0f-9a01-568bab7341ed-ovn-node-metrics-cert\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.756025 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.755984 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d5v5\" (UniqueName: \"kubernetes.io/projected/0965e2da-cc3e-491e-b98f-e0dff34143eb-kube-api-access-5d5v5\") pod \"multus-additional-cni-plugins-svb6t\" (UID: \"0965e2da-cc3e-491e-b98f-e0dff34143eb\") " pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.758134 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.758110 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvgcp\" (UniqueName: \"kubernetes.io/projected/4402ce57-5dd1-4e02-b524-79b116c2f040-kube-api-access-vvgcp\") pod \"node-resolver-mnx6v\" (UID: \"4402ce57-5dd1-4e02-b524-79b116c2f040\") " pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.758344 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.758148 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4dfr\" (UniqueName: \"kubernetes.io/projected/94850f41-6f74-48a9-a8bf-d0f91f1ea63b-kube-api-access-t4dfr\") pod \"multus-6pdz4\" (UID: \"94850f41-6f74-48a9-a8bf-d0f91f1ea63b\") " pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.758344 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.758150 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj79s\" (UniqueName: \"kubernetes.io/projected/2727b693-d5c7-4e0f-9a01-568bab7341ed-kube-api-access-kj79s\") pod \"ovnkube-node-bd5dw\" (UID: \"2727b693-d5c7-4e0f-9a01-568bab7341ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.758344 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.758261 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xxp\" (UniqueName: \"kubernetes.io/projected/9a5152e7-9144-44ce-9926-e69323299662-kube-api-access-v2xxp\") pod \"iptables-alerter-gqpwc\" (UID: \"9a5152e7-9144-44ce-9926-e69323299662\") " pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.758558 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.758542 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4dj\" (UniqueName: \"kubernetes.io/projected/118f5d77-248c-4b45-a0cd-1e9648441505-kube-api-access-hf4dj\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:13.760067 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.760049 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxpb\" (UniqueName: \"kubernetes.io/projected/ca39a0ce-4030-4d12-b7d9-99f45bffa241-kube-api-access-xjxpb\") pod \"node-ca-k5v79\" (UID: \"ca39a0ce-4030-4d12-b7d9-99f45bffa241\") " pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.808522 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.808503 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d404b1b7bc2e059ff3b97eda506ec18.slice/crio-eaeec636a6a1f43cf65d9661f2c9b06d14228c53f55a0c6812878f4f354274d4 WatchSource:0}: Error finding container eaeec636a6a1f43cf65d9661f2c9b06d14228c53f55a0c6812878f4f354274d4: Status 404 returned error can't find the container with id eaeec636a6a1f43cf65d9661f2c9b06d14228c53f55a0c6812878f4f354274d4 Aug 02 10:33:13.859954 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.859896 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:13.866726 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.866703 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36093ce8_c36e_46b8_8cf0_42c27e9b7066.slice/crio-597b8a1690090379f62fd29a92f4e7c08aa3893e7ffc35b990a681bf87707d14 WatchSource:0}: Error finding container 597b8a1690090379f62fd29a92f4e7c08aa3893e7ffc35b990a681bf87707d14: Status 404 returned error can't find the container with id 597b8a1690090379f62fd29a92f4e7c08aa3893e7ffc35b990a681bf87707d14 Aug 02 10:33:13.878319 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.878302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mnx6v" Aug 02 10:33:13.883308 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.883289 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" Aug 02 10:33:13.885326 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.885307 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4402ce57_5dd1_4e02_b524_79b116c2f040.slice/crio-7d6cd6d8c59ac143dd7844424425d733e58f08afe23678750dc11522fd4c54c7 WatchSource:0}: Error finding container 7d6cd6d8c59ac143dd7844424425d733e58f08afe23678750dc11522fd4c54c7: Status 404 returned error can't find the container with id 7d6cd6d8c59ac143dd7844424425d733e58f08afe23678750dc11522fd4c54c7 Aug 02 10:33:13.889972 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.889950 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0bab4d_a144_4be4_845e_f17d63330e34.slice/crio-50757ae45368c6b38b63ad7aea392a66b937d4120d3e9faecf6e5ffcb4bc03a9 WatchSource:0}: Error finding container 50757ae45368c6b38b63ad7aea392a66b937d4120d3e9faecf6e5ffcb4bc03a9: Status 404 returned error can't find the container with id 50757ae45368c6b38b63ad7aea392a66b937d4120d3e9faecf6e5ffcb4bc03a9 Aug 02 10:33:13.895950 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.895933 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" Aug 02 10:33:13.904514 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.904494 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7903a14d_8514_40cb_be78_4de9b11aa3d3.slice/crio-e22c7f49a6e778bfbf91679d9f982e647de6bde953cba9372f2962c18466149a WatchSource:0}: Error finding container e22c7f49a6e778bfbf91679d9f982e647de6bde953cba9372f2962c18466149a: Status 404 returned error can't find the container with id e22c7f49a6e778bfbf91679d9f982e647de6bde953cba9372f2962c18466149a Aug 02 10:33:13.915534 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.915514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6pdz4" Aug 02 10:33:13.921854 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.921835 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94850f41_6f74_48a9_a8bf_d0f91f1ea63b.slice/crio-36f2c683cecff8711b53e7889fe91bec1dde37300638b3c4c3f16a849efcd304 WatchSource:0}: Error finding container 36f2c683cecff8711b53e7889fe91bec1dde37300638b3c4c3f16a849efcd304: Status 404 returned error can't find the container with id 36f2c683cecff8711b53e7889fe91bec1dde37300638b3c4c3f16a849efcd304 Aug 02 10:33:13.942932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.942907 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5v79" Aug 02 10:33:13.949254 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.949232 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca39a0ce_4030_4d12_b7d9_99f45bffa241.slice/crio-0b30a7ab7c9bcf06bb5d1da21512221b7246383563c23a2233b4c6cd1036b769 WatchSource:0}: Error finding container 0b30a7ab7c9bcf06bb5d1da21512221b7246383563c23a2233b4c6cd1036b769: Status 404 returned error can't find the container with id 0b30a7ab7c9bcf06bb5d1da21512221b7246383563c23a2233b4c6cd1036b769 Aug 02 10:33:13.963040 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.963021 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svb6t" Aug 02 10:33:13.969458 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.969439 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gqpwc" Aug 02 10:33:13.969563 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.969544 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0965e2da_cc3e_491e_b98f_e0dff34143eb.slice/crio-95521eab979fabe3f965a3df6c0815af6e1ae621146e9f7b81303a233ac8e10a WatchSource:0}: Error finding container 95521eab979fabe3f965a3df6c0815af6e1ae621146e9f7b81303a233ac8e10a: Status 404 returned error can't find the container with id 95521eab979fabe3f965a3df6c0815af6e1ae621146e9f7b81303a233ac8e10a Aug 02 10:33:13.970624 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:13.970587 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:13.977649 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.977628 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5152e7_9144_44ce_9926_e69323299662.slice/crio-05c3c0b3004228e79a6eae1bf9a2f696109ebc13135fbe28710466243e0898db WatchSource:0}: Error finding container 05c3c0b3004228e79a6eae1bf9a2f696109ebc13135fbe28710466243e0898db: Status 404 returned error can't find the container with id 05c3c0b3004228e79a6eae1bf9a2f696109ebc13135fbe28710466243e0898db Aug 02 10:33:13.980266 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:13.980245 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2727b693_d5c7_4e0f_9a01_568bab7341ed.slice/crio-6a14813dfec117f9b08a886557386bf90f448d0d98da34996c16c125faa34b26 WatchSource:0}: Error finding container 6a14813dfec117f9b08a886557386bf90f448d0d98da34996c16c125faa34b26: Status 404 returned error can't find the container with id 6a14813dfec117f9b08a886557386bf90f448d0d98da34996c16c125faa34b26 Aug 02 10:33:14.132227 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.130401 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 10:33:14.252189 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.252151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:14.252331 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.252208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:14.252331 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.252249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:14.252331 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252308 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:14.252500 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252367 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:14.252500 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252386 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:15.252369616 +0000 UTC m=+3.034724562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:14.252500 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252439 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:15.252420453 +0000 UTC m=+3.034775399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:14.252500 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252373 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:14.252500 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252470 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:14.252500 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252484 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:14.252759 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.252520 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:15.252509781 +0000 UTC m=+3.034864752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:14.606675 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.606609 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-01 10:28:13 +0000 UTC" deadline="2028-05-16 01:53:12.917572508 +0000 UTC" Aug 02 10:33:14.606675 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.606669 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15663h19m58.310907771s" Aug 02 10:33:14.665951 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.665359 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:14.665951 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:14.665488 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:14.687171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.687069 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" event={"ID":"8d404b1b7bc2e059ff3b97eda506ec18","Type":"ContainerStarted","Data":"eaeec636a6a1f43cf65d9661f2c9b06d14228c53f55a0c6812878f4f354274d4"} Aug 02 10:33:14.705049 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.705018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"6a14813dfec117f9b08a886557386bf90f448d0d98da34996c16c125faa34b26"} Aug 02 10:33:14.714035 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.714004 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" event={"ID":"7903a14d-8514-40cb-be78-4de9b11aa3d3","Type":"ContainerStarted","Data":"e22c7f49a6e778bfbf91679d9f982e647de6bde953cba9372f2962c18466149a"} Aug 02 10:33:14.731209 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.731166 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" event={"ID":"8c0bab4d-a144-4be4-845e-f17d63330e34","Type":"ContainerStarted","Data":"50757ae45368c6b38b63ad7aea392a66b937d4120d3e9faecf6e5ffcb4bc03a9"} Aug 02 10:33:14.734414 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.734345 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ctnjw" event={"ID":"36093ce8-c36e-46b8-8cf0-42c27e9b7066","Type":"ContainerStarted","Data":"597b8a1690090379f62fd29a92f4e7c08aa3893e7ffc35b990a681bf87707d14"} Aug 02 10:33:14.751684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.751617 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" event={"ID":"879b6d327f2c06772af8f06d3e269a3f","Type":"ContainerStarted","Data":"f14589fe66e520d3b34d8d9f07152e72480466768b5087eddb597227bca3e997"} Aug 02 10:33:14.756818 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.756763 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gqpwc" event={"ID":"9a5152e7-9144-44ce-9926-e69323299662","Type":"ContainerStarted","Data":"05c3c0b3004228e79a6eae1bf9a2f696109ebc13135fbe28710466243e0898db"} Aug 02 10:33:14.787269 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.787172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerStarted","Data":"95521eab979fabe3f965a3df6c0815af6e1ae621146e9f7b81303a233ac8e10a"} Aug 02 10:33:14.811661 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.811593 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5v79" event={"ID":"ca39a0ce-4030-4d12-b7d9-99f45bffa241","Type":"ContainerStarted","Data":"0b30a7ab7c9bcf06bb5d1da21512221b7246383563c23a2233b4c6cd1036b769"} Aug 02 10:33:14.826836 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.826724 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6pdz4" event={"ID":"94850f41-6f74-48a9-a8bf-d0f91f1ea63b","Type":"ContainerStarted","Data":"36f2c683cecff8711b53e7889fe91bec1dde37300638b3c4c3f16a849efcd304"} Aug 02 10:33:14.850225 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:14.850184 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mnx6v" event={"ID":"4402ce57-5dd1-4e02-b524-79b116c2f040","Type":"ContainerStarted","Data":"7d6cd6d8c59ac143dd7844424425d733e58f08afe23678750dc11522fd4c54c7"} Aug 02 10:33:15.004683 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.004406 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 10:33:15.174151 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.174120 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.261068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.261123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.261198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261315 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261377 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:17.261357745 +0000 UTC m=+5.043712695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261768 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261814 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:17.261799755 +0000 UTC m=+5.044154702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261897 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261915 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261927 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:15.262041 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.261962 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:17.261950169 +0000 UTC m=+5.044305116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:15.607964 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.607804 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-01 10:28:13 +0000 UTC" deadline="2028-03-28 11:36:19.4626451 +0000 UTC" Aug 02 10:33:15.607964 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.607844 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14497h3m3.85480672s" Aug 02 10:33:15.663311 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.662533 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:15.663311 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.662688 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:15.663311 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:15.663110 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:15.663311 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:15.663234 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:16.664247 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:16.664215 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:16.664690 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:16.664347 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:17.275883 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:17.275852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:17.276064 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:17.275892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:17.276064 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:17.275922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:17.276064 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276025 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:17.276064 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276037 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:17.276064 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276045 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:17.276340 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276084 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:21.276072235 +0000 UTC m=+9.058427176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:17.276654 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276462 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:17.276654 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276514 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:21.2764992 +0000 UTC m=+9.058854146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:17.276654 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276568 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:17.276654 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.276610 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:21.276598895 +0000 UTC m=+9.058953840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:17.662014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:17.661990 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:17.662207 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.662133 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:17.662325 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:17.662256 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:17.662375 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:17.662335 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:18.663479 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:18.663448 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:18.672898 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:18.672307 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:19.662322 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:19.662282 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:19.662486 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:19.662405 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:19.662486 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:19.662462 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:19.662608 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:19.662588 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:20.662611 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:20.662015 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:20.662611 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:20.662158 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:21.305595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:21.305672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:21.305707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305841 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305896 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305912 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:29.305891486 +0000 UTC m=+17.088246442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305913 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305927 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305928 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305964 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:29.305951382 +0000 UTC m=+17.088306340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:21.306039 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.305992 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:29.305972648 +0000 UTC m=+17.088327594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:21.662678 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:21.662552 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:21.662678 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:21.662585 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:21.663174 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.662689 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:21.663174 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:21.662944 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:22.662744 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:22.662651 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:22.663292 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:22.662756 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:23.661782 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:23.661746 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:23.661954 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:23.661860 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:23.661954 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:23.661898 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:23.662079 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:23.661967 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:24.662612 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:24.662576 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:24.663080 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:24.662717 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:25.662002 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:25.661965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:25.662002 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:25.661987 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:25.662235 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:25.662112 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:25.662282 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:25.662240 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:26.662306 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:26.662276 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:26.662673 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:26.662407 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:27.661983 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:27.661948 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:27.661983 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:27.661985 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:27.662226 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:27.662064 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:27.662286 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:27.662218 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:28.662398 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:28.662367 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:28.662800 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:28.662482 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:29.367177 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:29.367144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:29.367373 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:29.367206 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:29.367373 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:29.367236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:29.367373 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367332 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:29.367373 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367354 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:29.367373 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367366 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:29.367602 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367380 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:29.367602 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367413 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:45.367396482 +0000 UTC m=+33.149751426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:29.367602 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367435 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:45.367424643 +0000 UTC m=+33.149779584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:29.367602 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367338 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:29.367602 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.367463 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:45.367457103 +0000 UTC m=+33.149812044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:29.662352 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:29.662269 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:29.662352 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:29.662318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:29.662893 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.662410 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:29.662893 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:29.662531 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:30.662717 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:30.662513 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:30.663144 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:30.662822 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:31.662366 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:31.662336 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:31.662526 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:31.662373 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:31.662526 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:31.662440 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:31.662606 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:31.662568 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:32.662464 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:32.662437 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:32.662751 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:32.662528 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:33.662291 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.662071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:33.662375 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.662082 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:33.662412 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:33.662368 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:33.662457 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:33.662436 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:33.905167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.905140 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5v79" event={"ID":"ca39a0ce-4030-4d12-b7d9-99f45bffa241","Type":"ContainerStarted","Data":"5a8d1f7e1f2928b20c84a2b2abbf2527a035376f9026bcd55d17a972d2c2b26b"} Aug 02 10:33:33.906603 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.906584 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6pdz4" event={"ID":"94850f41-6f74-48a9-a8bf-d0f91f1ea63b","Type":"ContainerStarted","Data":"9f2936cea075cf8f6ec71f58f9a4862cb24dca0456275211e58980c1e9651229"} Aug 02 10:33:33.907927 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.907903 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mnx6v" event={"ID":"4402ce57-5dd1-4e02-b524-79b116c2f040","Type":"ContainerStarted","Data":"5cc0cc4cd92eb728392620e1d1c7c600095c6f803e491cfcd6b3355f574624ab"} Aug 02 10:33:33.909291 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.909267 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" event={"ID":"8d404b1b7bc2e059ff3b97eda506ec18","Type":"ContainerStarted","Data":"e4459bea89b10b56b52e0e0ad3fefe1437f33277c8c3689839844d6b38b4fe1a"} Aug 02 10:33:33.911674 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.911659 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:33:33.911978 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.911961 2554 generic.go:356] "Generic (PLEG): container finished" podID="2727b693-d5c7-4e0f-9a01-568bab7341ed" containerID="388034172f68c0711b5cc25c37f4236cc46115fe77fb5b7d472e445d7a128086" exitCode=1 Aug 02 10:33:33.912037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.912025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"d9c81075310b2573a8a1bc894cb9693fe2b8abe4d2d8f0a1f2414090d992fcf8"} Aug 02 10:33:33.912081 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.912075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"8bb25981157b78fcfe493761f0dffd3000521145795b81fef79c161558f88547"} Aug 02 10:33:33.912140 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.912112 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"d0a89c150fa547663f985e4d5ac343f95b13565a346229c0ebcdd60c5d55d9eb"} Aug 02 10:33:33.912179 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.912156 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"abb9bd19ddcf49a91e65a873f5ae3f2d1b8f92fc17da5bfeca4ba505e4f99b1e"} Aug 02 10:33:33.912224 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.912186 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerDied","Data":"388034172f68c0711b5cc25c37f4236cc46115fe77fb5b7d472e445d7a128086"} Aug 02 10:33:33.912267 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.912230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"89cb22affc975136d96825027212adb0219aed15f0b48c67957ff105837aeba7"} Aug 02 10:33:33.913263 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.913242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" event={"ID":"7903a14d-8514-40cb-be78-4de9b11aa3d3","Type":"ContainerStarted","Data":"2ccc75f79c6b6047e281390cd4c86680ec1106c13040ba50afebdf18408d2ac6"} Aug 02 10:33:33.914530 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.914513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" event={"ID":"8c0bab4d-a144-4be4-845e-f17d63330e34","Type":"ContainerStarted","Data":"c6528db2536d08eafae3c295de15688f1ae803a0d5eb6ed559fb44e48fd7231d"} Aug 02 10:33:33.915725 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.915709 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ctnjw" event={"ID":"36093ce8-c36e-46b8-8cf0-42c27e9b7066","Type":"ContainerStarted","Data":"e15f38fb10b6af56deab823e2d251a359243a78c7ee6b12ad34285a84910c7c2"} Aug 02 10:33:33.917077 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.917057 2554 generic.go:356] "Generic (PLEG): container finished" podID="879b6d327f2c06772af8f06d3e269a3f" containerID="b94ef0597aa8d1264de046902ab586aa0d6b71bbe76e18bce5c24e93207e397e" exitCode=0 Aug 02 10:33:33.917172 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.917145 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" event={"ID":"879b6d327f2c06772af8f06d3e269a3f","Type":"ContainerDied","Data":"b94ef0597aa8d1264de046902ab586aa0d6b71bbe76e18bce5c24e93207e397e"} Aug 02 10:33:33.918408 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.918392 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gqpwc" event={"ID":"9a5152e7-9144-44ce-9926-e69323299662","Type":"ContainerStarted","Data":"04747ebf7ac11d7bf663799a853864637cadbb9e7add225f842ebc119fd54756"} Aug 02 10:33:33.919769 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.919750 2554 generic.go:356] "Generic (PLEG): container finished" podID="0965e2da-cc3e-491e-b98f-e0dff34143eb" containerID="442fe5b651e2d6ee1a95bf49421ded496b466a1771f5d8906be158d23abfa6b7" exitCode=0 Aug 02 10:33:33.919834 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.919780 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerDied","Data":"442fe5b651e2d6ee1a95bf49421ded496b466a1771f5d8906be158d23abfa6b7"} Aug 02 10:33:33.922833 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.922798 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k5v79" podStartSLOduration=2.169032727 podStartE2EDuration="20.922787541s" totalImagesPullingTime="18.753754814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:33.922423709 +0000 UTC m=+21.704778673" watchObservedRunningTime="2026-08-02 10:33:33.922787541 +0000 UTC m=+21.705142502" Aug 02 10:33:33.937253 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:33.937222 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gqpwc" podStartSLOduration=2.212332589 podStartE2EDuration="20.937214031s" totalImagesPullingTime="18.724881442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:33.937047904 +0000 UTC m=+21.719402866" watchObservedRunningTime="2026-08-02 10:33:33.937214031 +0000 UTC m=+21.719568993" Aug 02 10:33:34.008526 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.008392 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ctnjw" podStartSLOduration=3.172573114 podStartE2EDuration="22.008379278s" totalImagesPullingTime="18.835806164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:34.008218008 +0000 UTC m=+21.790572971" watchObservedRunningTime="2026-08-02 10:33:34.008379278 +0000 UTC m=+21.790734239" Aug 02 10:33:34.008787 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.008748 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-208.ec2.internal" podStartSLOduration=21.008741969 podStartE2EDuration="21.008741969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:33.980733614 +0000 UTC m=+21.763088577" watchObservedRunningTime="2026-08-02 10:33:34.008741969 +0000 UTC m=+21.791096934" Aug 02 10:33:34.028970 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.028934 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4nhs2" podStartSLOduration=2.228676938 podStartE2EDuration="21.0289215s" totalImagesPullingTime="18.800244562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:34.028510129 +0000 UTC m=+21.810865091" watchObservedRunningTime="2026-08-02 10:33:34.0289215 +0000 UTC m=+21.811276484" Aug 02 10:33:34.067535 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.067494 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mnx6v" podStartSLOduration=2.249987045 podStartE2EDuration="21.067479877s" totalImagesPullingTime="18.817492832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:34.067423753 +0000 UTC m=+21.849778717" watchObservedRunningTime="2026-08-02 10:33:34.067479877 +0000 UTC m=+21.849834840" Aug 02 10:33:34.067968 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.067942 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6pdz4" podStartSLOduration=2.247106626 podStartE2EDuration="21.067934572s" totalImagesPullingTime="18.820827946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:34.045482881 +0000 UTC m=+21.827837844" watchObservedRunningTime="2026-08-02 10:33:34.067934572 +0000 UTC m=+21.850289534" Aug 02 10:33:34.662444 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.662416 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:34.662638 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:34.662538 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:34.924767 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.924737 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" event={"ID":"879b6d327f2c06772af8f06d3e269a3f","Type":"ContainerStarted","Data":"f38a57d1c2a0f44d05d4290c08d40660f2a009e223b21e21f62c18bd9cd88df4"} Aug 02 10:33:34.951163 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:34.951143 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 02 10:33:35.298348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.298324 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:35.299000 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.298976 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:35.314451 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.314412 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-208.ec2.internal" podStartSLOduration=22.314393322 podStartE2EDuration="22.314393322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:34.940988347 +0000 UTC m=+22.723343311" watchObservedRunningTime="2026-08-02 10:33:35.314393322 +0000 UTC m=+23.096748287" Aug 02 10:33:35.603722 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.603567 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-02T10:33:34.951159211Z","UUID":"e5d32699-a8d3-4251-82cd-5cc57b7f0b14","Handler":null,"Name":"","Endpoint":""} Aug 02 10:33:35.605501 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.605480 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 02 10:33:35.605610 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.605528 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 02 10:33:35.662250 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.662225 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:35.662383 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:35.662358 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:35.662673 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.662610 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:35.662793 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:35.662698 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:35.930586 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.930521 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:33:35.930998 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.930970 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"95223ef1bdfa3516c13080c36ca88354464fe148c660add498e3233eba68dc59"} Aug 02 10:33:35.932837 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:35.932807 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" event={"ID":"8c0bab4d-a144-4be4-845e-f17d63330e34","Type":"ContainerStarted","Data":"cc32ac19c664412b49a05643e6137976637bcde8177e827c52515f0a7c7ceb40"} Aug 02 10:33:36.661840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:36.661811 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:36.662020 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:36.661930 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:36.937525 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:36.937459 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 02 10:33:36.937525 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:36.937461 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" event={"ID":"8c0bab4d-a144-4be4-845e-f17d63330e34","Type":"ContainerStarted","Data":"7972f94b55a1c0162117fe42b9e9615ff1b7313e194128f2a99727804298c3c0"} Aug 02 10:33:36.958264 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:36.958222 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c6d2" podStartSLOduration=2.666103826 podStartE2EDuration="23.958202658s" totalImagesPullingTime="21.292098832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:36.957644571 +0000 UTC m=+24.739999535" watchObservedRunningTime="2026-08-02 10:33:36.958202658 +0000 UTC m=+24.740557625" Aug 02 10:33:37.661625 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:37.661593 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:37.661801 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:37.661634 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:37.661801 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:37.661703 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:37.661801 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:37.661757 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:38.662797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.662598 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:38.663528 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:38.662828 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:38.944955 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.944886 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:33:38.945286 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.945262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"255738c452384e270a0eeda4a82d8701b20042e183ad69733fa4a189cb927769"} Aug 02 10:33:38.945569 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.945509 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:38.945659 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.945624 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:38.945707 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.945665 2554 scope.go:117] "RemoveContainer" containerID="388034172f68c0711b5cc25c37f4236cc46115fe77fb5b7d472e445d7a128086" Aug 02 10:33:38.947173 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.947147 2554 generic.go:356] "Generic (PLEG): container finished" podID="0965e2da-cc3e-491e-b98f-e0dff34143eb" containerID="e5c6571a20aa444aeefc070f9fdb6878db7d3c6fb0d9f962beb1b303d7a7c12b" exitCode=0 Aug 02 10:33:38.947254 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.947190 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerDied","Data":"e5c6571a20aa444aeefc070f9fdb6878db7d3c6fb0d9f962beb1b303d7a7c12b"} Aug 02 10:33:38.962265 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:38.962247 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:39.495008 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.494961 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:39.495261 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.495144 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 02 10:33:39.495743 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.495699 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ctnjw" Aug 02 10:33:39.662109 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.662083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:39.662274 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.662129 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:39.662274 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:39.662236 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:39.662403 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:39.662344 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:39.955652 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.955624 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:33:39.956110 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.956071 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" event={"ID":"2727b693-d5c7-4e0f-9a01-568bab7341ed","Type":"ContainerStarted","Data":"22af53110891a3c39dcad5909a8ec5b22793e4ffeb8a8d5e0c23e70b53e853fc"} Aug 02 10:33:39.956567 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.956546 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:39.974285 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.974205 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:33:39.984177 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:39.983931 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" podStartSLOduration=7.890890532 podStartE2EDuration="26.983912388s" totalImagesPullingTime="19.093021856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:39.982321666 +0000 UTC m=+27.764676628" watchObservedRunningTime="2026-08-02 10:33:39.983912388 +0000 UTC m=+27.766267353" Aug 02 10:33:40.190720 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.190631 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9zzhv"] Aug 02 10:33:40.190870 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.190762 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:40.190928 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:40.190878 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:40.198424 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.198392 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqk48"] Aug 02 10:33:40.198620 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.198487 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sg228"] Aug 02 10:33:40.198620 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.198598 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:40.199677 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:40.199468 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:40.199677 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.199562 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:40.200100 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:40.200073 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:40.960006 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.959977 2554 generic.go:356] "Generic (PLEG): container finished" podID="0965e2da-cc3e-491e-b98f-e0dff34143eb" containerID="7ca30dc103d883eb163cb63fa92b9abd1c5e4a6877798e6c8fb25ea6518fb8b3" exitCode=0 Aug 02 10:33:40.960368 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:40.960059 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerDied","Data":"7ca30dc103d883eb163cb63fa92b9abd1c5e4a6877798e6c8fb25ea6518fb8b3"} Aug 02 10:33:41.662048 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:41.662002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:41.662237 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:41.662023 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:41.662237 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:41.662136 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:41.662237 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:41.662211 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:42.663062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:42.662974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:42.663562 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:42.663075 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:42.966245 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:42.966211 2554 generic.go:356] "Generic (PLEG): container finished" podID="0965e2da-cc3e-491e-b98f-e0dff34143eb" containerID="69576a2668f6928b7f426256f492b9c65e423bfccb88d208abb8e912df5e7c1a" exitCode=0 Aug 02 10:33:42.966395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:42.966258 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerDied","Data":"69576a2668f6928b7f426256f492b9c65e423bfccb88d208abb8e912df5e7c1a"} Aug 02 10:33:43.662273 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:43.662241 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:43.662457 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:43.662362 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:43.662457 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:43.662367 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:43.662554 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:43.662483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:44.662156 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:44.662107 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:44.662540 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:44.662232 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9zzhv" podUID="e19d4e47-67bb-4e6f-a97c-9177040e3552" Aug 02 10:33:45.398246 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:45.398217 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:45.398412 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:45.398262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:45.398412 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:45.398286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:45.398412 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398377 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:45.398519 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398425 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:17.398411558 +0000 UTC m=+65.180766500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 02 10:33:45.398519 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398378 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:45.398519 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398483 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret podName:e19d4e47-67bb-4e6f-a97c-9177040e3552 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:17.398469636 +0000 UTC m=+65.180824581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret") pod "global-pull-secret-syncer-9zzhv" (UID: "e19d4e47-67bb-4e6f-a97c-9177040e3552") : object "kube-system"/"original-pull-secret" not registered Aug 02 10:33:45.398519 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398433 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 02 10:33:45.398519 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398510 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 02 10:33:45.398519 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398522 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vghnl for pod openshift-network-diagnostics/network-check-target-vqk48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:45.398692 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.398556 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl podName:993287d4-2e13-4f3a-9c52-9aae02b5f633 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:17.398545272 +0000 UTC m=+65.180900232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vghnl" (UniqueName: "kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl") pod "network-check-target-vqk48" (UID: "993287d4-2e13-4f3a-9c52-9aae02b5f633") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 02 10:33:45.662195 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:45.662095 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:45.662195 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:45.662161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:45.662541 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.662252 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:33:45.662541 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:45.662356 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqk48" podUID="993287d4-2e13-4f3a-9c52-9aae02b5f633" Aug 02 10:33:46.098452 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.098420 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-208.ec2.internal" event="NodeReady" Aug 02 10:33:46.098610 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.098561 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 02 10:33:46.136583 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.136550 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74db5c755f-gtrw8"] Aug 02 10:33:46.139129 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.139103 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.142102 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.142074 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 02 10:33:46.142271 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.142252 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 02 10:33:46.142374 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.142340 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 02 10:33:46.142374 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.142087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-plb6r\"" Aug 02 10:33:46.147333 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.147294 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 02 10:33:46.156594 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.156569 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wggsn"] Aug 02 10:33:46.158499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.158478 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74db5c755f-gtrw8"] Aug 02 10:33:46.158607 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.158511 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9grhz"] Aug 02 10:33:46.158607 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.158600 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.160387 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.160369 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.161355 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.161310 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 02 10:33:46.161355 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.161316 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nv7kc\"" Aug 02 10:33:46.162338 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.162322 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 02 10:33:46.162769 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.162748 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wbhqw\"" Aug 02 10:33:46.162851 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.162759 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 02 10:33:46.163376 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.163357 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 02 10:33:46.164368 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.164347 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 02 10:33:46.171067 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.171041 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wggsn"] Aug 02 10:33:46.174527 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.174280 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9grhz"] Aug 02 10:33:46.305254 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305261 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4x46\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-kube-api-access-w4x46\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305308 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.305395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thg6w\" (UniqueName: \"kubernetes.io/projected/0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c-kube-api-access-thg6w\") pod \"ingress-canary-9grhz\" (UID: \"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c\") " pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.305395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305360 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-ca-trust-extracted\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-bound-sa-token\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-tmp-dir\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-certificates\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-config-volume\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c-cert\") pod \"ingress-canary-9grhz\" (UID: \"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c\") " pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-installation-pull-secrets\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25dqk\" (UniqueName: \"kubernetes.io/projected/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-kube-api-access-25dqk\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-image-registry-private-configuration\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.305655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.305655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-trusted-ca\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.406609 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25dqk\" (UniqueName: \"kubernetes.io/projected/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-kube-api-access-25dqk\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.406609 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406581 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-image-registry-private-configuration\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.406609 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-trusted-ca\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.406833 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.406833 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4x46\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-kube-api-access-w4x46\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.406833 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.406833 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.406791 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:33:46.406833 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.406797 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:33:46.406833 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.406821 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.406853 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:46.906836426 +0000 UTC m=+34.689191367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.406870 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:46.90686107 +0000 UTC m=+34.689216011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thg6w\" (UniqueName: \"kubernetes.io/projected/0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c-kube-api-access-thg6w\") pod \"ingress-canary-9grhz\" (UID: \"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c\") " pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-ca-trust-extracted\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-bound-sa-token\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.406965 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-tmp-dir\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-certificates\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.407043 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-config-volume\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.407387 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c-cert\") pod \"ingress-canary-9grhz\" (UID: \"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c\") " pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.407387 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-installation-pull-secrets\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.407788 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-certificates\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.407788 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407718 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-ca-trust-extracted\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.407788 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407731 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-tmp-dir\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.407788 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.407748 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-trusted-ca\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.408158 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.408112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-config-volume\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.411738 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.411626 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-image-registry-private-configuration\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.411839 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.411639 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c-cert\") pod \"ingress-canary-9grhz\" (UID: \"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c\") " pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.411839 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.411655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-installation-pull-secrets\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.417570 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.417544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25dqk\" (UniqueName: \"kubernetes.io/projected/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-kube-api-access-25dqk\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.419063 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.419045 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-bound-sa-token\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.419536 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.419515 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4x46\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-kube-api-access-w4x46\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.419685 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.419662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thg6w\" (UniqueName: \"kubernetes.io/projected/0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c-kube-api-access-thg6w\") pod \"ingress-canary-9grhz\" (UID: \"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c\") " pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.476755 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.476717 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9grhz" Aug 02 10:33:46.665737 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.665659 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:33:46.668238 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.668219 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 02 10:33:46.910606 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.910572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:46.910778 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:46.910617 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:46.910778 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.910751 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:33:46.910778 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.910759 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:33:46.910907 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.910782 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:33:46.910907 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.910833 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:47.910814004 +0000 UTC m=+35.693168948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:33:46.910907 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:46.910851 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:47.910844713 +0000 UTC m=+35.693199654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:33:47.262316 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.262294 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9grhz"] Aug 02 10:33:47.264564 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:33:47.264535 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf01d8c_c1c3_46ce_8bca_cdbd039e0c3c.slice/crio-f4905c884205da09de6f26f904c497364f8038f0f2b0c22a3f2829522b11f173 WatchSource:0}: Error finding container f4905c884205da09de6f26f904c497364f8038f0f2b0c22a3f2829522b11f173: Status 404 returned error can't find the container with id f4905c884205da09de6f26f904c497364f8038f0f2b0c22a3f2829522b11f173 Aug 02 10:33:47.662153 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.662108 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:33:47.662344 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.662320 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:33:47.666138 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.666100 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 02 10:33:47.666755 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.666151 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 02 10:33:47.666755 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.666219 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 02 10:33:47.666755 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.666217 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dvcgg\"" Aug 02 10:33:47.666755 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.666246 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9bgf\"" Aug 02 10:33:47.920170 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.920092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:47.920170 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.920146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:47.920320 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:47.920253 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:33:47.920320 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:47.920271 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:33:47.920320 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:47.920275 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:33:47.920407 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:47.920329 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:49.9203119 +0000 UTC m=+37.702666842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:33:47.920407 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:47.920344 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:49.92033796 +0000 UTC m=+37.702692902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:33:47.979556 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.979515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9grhz" event={"ID":"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c","Type":"ContainerStarted","Data":"f4905c884205da09de6f26f904c497364f8038f0f2b0c22a3f2829522b11f173"} Aug 02 10:33:47.982672 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.982648 2554 generic.go:356] "Generic (PLEG): container finished" podID="0965e2da-cc3e-491e-b98f-e0dff34143eb" containerID="d2bc847d1f728bda48190d8fd5cc1e3f2881923627c9046ab60ad228c09bb963" exitCode=0 Aug 02 10:33:47.982789 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:47.982684 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerDied","Data":"d2bc847d1f728bda48190d8fd5cc1e3f2881923627c9046ab60ad228c09bb963"} Aug 02 10:33:48.988786 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:48.988757 2554 generic.go:356] "Generic (PLEG): container finished" podID="0965e2da-cc3e-491e-b98f-e0dff34143eb" containerID="89fc07bd482d50c6cf756a260f1579a2259c24db709b26f0566d5e86c2fcaaf6" exitCode=0 Aug 02 10:33:48.989133 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:48.988801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerDied","Data":"89fc07bd482d50c6cf756a260f1579a2259c24db709b26f0566d5e86c2fcaaf6"} Aug 02 10:33:49.935143 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:49.935098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:49.935302 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:49.935158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:49.935302 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:49.935247 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:33:49.935302 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:49.935258 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:33:49.935302 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:49.935295 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:33:49.935456 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:49.935316 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:53.935302922 +0000 UTC m=+41.717657863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:33:49.935456 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:49.935351 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:53.935331429 +0000 UTC m=+41.717686388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:33:49.994602 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:49.994571 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svb6t" event={"ID":"0965e2da-cc3e-491e-b98f-e0dff34143eb","Type":"ContainerStarted","Data":"51fb34aeec0b2c54a98a63688ce0002fd340aab273700764bbd38c86bc736367"} Aug 02 10:33:50.016821 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:50.016756 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-svb6t" podStartSLOduration=7.700856336 podStartE2EDuration="37.016744614s" totalImagesPullingTime="29.315888278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:50.015442847 +0000 UTC m=+37.797797800" watchObservedRunningTime="2026-08-02 10:33:50.016744614 +0000 UTC m=+37.799099577" Aug 02 10:33:50.998598 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:50.998561 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9grhz" event={"ID":"0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c","Type":"ContainerStarted","Data":"ed5c5e08eae2ee2ad2057682d1e2116af3d418457e211d1cb48372fc31fbf5bf"} Aug 02 10:33:51.015284 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:51.015242 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9grhz" podStartSLOduration=2.217321991 podStartE2EDuration="5.015227648s" totalImagesPullingTime="2.797905657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:51.013930829 +0000 UTC m=+38.796285792" watchObservedRunningTime="2026-08-02 10:33:51.015227648 +0000 UTC m=+38.797582611" Aug 02 10:33:53.959633 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:53.959600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:33:53.960006 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:33:53.959643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:33:53.960006 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:53.959733 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:33:53.960006 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:53.959753 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:33:53.960006 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:53.959738 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:33:53.960006 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:53.959800 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:01.959786182 +0000 UTC m=+49.742141124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:33:53.960006 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:33:53.959813 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:01.959807215 +0000 UTC m=+49.742162156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:34:02.009044 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:02.009006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:34:02.009471 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:02.009074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:34:02.009471 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:02.009168 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:34:02.009471 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:02.009178 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:34:02.009471 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:02.009190 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:34:02.009471 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:02.009226 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:18.00921386 +0000 UTC m=+65.791568801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:34:02.009471 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:02.009268 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:18.009248744 +0000 UTC m=+65.791603689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:34:11.982794 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:11.982761 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bd5dw" Aug 02 10:34:17.408819 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.408772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:34:17.409362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.408832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:34:17.409362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.408861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:34:17.411875 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.411837 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 02 10:34:17.411875 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.411845 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 02 10:34:17.412070 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.411913 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 02 10:34:17.419304 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:17.419274 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 02 10:34:17.419438 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:17.419349 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:35:21.419331901 +0000 UTC m=+129.201686842 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : secret "metrics-daemon-secret" not found Aug 02 10:34:17.421616 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.421596 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 02 10:34:17.423414 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.423390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e19d4e47-67bb-4e6f-a97c-9177040e3552-original-pull-secret\") pod \"global-pull-secret-syncer-9zzhv\" (UID: \"e19d4e47-67bb-4e6f-a97c-9177040e3552\") " pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:34:17.431797 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.431767 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghnl\" (UniqueName: \"kubernetes.io/projected/993287d4-2e13-4f3a-9c52-9aae02b5f633-kube-api-access-vghnl\") pod \"network-check-target-vqk48\" (UID: \"993287d4-2e13-4f3a-9c52-9aae02b5f633\") " pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:34:17.574950 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.574926 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9zzhv" Aug 02 10:34:17.674727 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.674668 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9bgf\"" Aug 02 10:34:17.682877 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.682857 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:34:17.698949 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.698928 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9zzhv"] Aug 02 10:34:17.702102 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:34:17.702077 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19d4e47_67bb_4e6f_a97c_9177040e3552.slice/crio-8d6d633cb10a2e493d6e474e9b27917407ec53cbd3c075e0068b5e903a9a782e WatchSource:0}: Error finding container 8d6d633cb10a2e493d6e474e9b27917407ec53cbd3c075e0068b5e903a9a782e: Status 404 returned error can't find the container with id 8d6d633cb10a2e493d6e474e9b27917407ec53cbd3c075e0068b5e903a9a782e Aug 02 10:34:17.805394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:17.805367 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqk48"] Aug 02 10:34:17.808301 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:34:17.808277 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993287d4_2e13_4f3a_9c52_9aae02b5f633.slice/crio-b1760b6cea61babf1e587d69033eb7ea9bcd0e0b7e209e53202ba5c773898097 WatchSource:0}: Error finding container b1760b6cea61babf1e587d69033eb7ea9bcd0e0b7e209e53202ba5c773898097: Status 404 returned error can't find the container with id b1760b6cea61babf1e587d69033eb7ea9bcd0e0b7e209e53202ba5c773898097 Aug 02 10:34:18.013471 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:18.013449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:34:18.013562 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:18.013490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:34:18.013601 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:18.013595 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:34:18.013634 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:18.013599 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:34:18.013634 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:18.013616 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:34:18.013695 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:18.013638 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:50.013626217 +0000 UTC m=+97.795981158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:34:18.013695 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:18.013667 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:50.013653349 +0000 UTC m=+97.796008303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:34:18.061207 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:18.061181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqk48" event={"ID":"993287d4-2e13-4f3a-9c52-9aae02b5f633","Type":"ContainerStarted","Data":"b1760b6cea61babf1e587d69033eb7ea9bcd0e0b7e209e53202ba5c773898097"} Aug 02 10:34:18.062279 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:18.062261 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9zzhv" event={"ID":"e19d4e47-67bb-4e6f-a97c-9177040e3552","Type":"ContainerStarted","Data":"8d6d633cb10a2e493d6e474e9b27917407ec53cbd3c075e0068b5e903a9a782e"} Aug 02 10:34:23.075720 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:23.075680 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqk48" event={"ID":"993287d4-2e13-4f3a-9c52-9aae02b5f633","Type":"ContainerStarted","Data":"7e7c33847862a22e15fad8f4844660e35d01d25a9f6cb07a2b177df4f23552b2"} Aug 02 10:34:23.076217 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:23.075744 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:34:23.077092 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:23.077028 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9zzhv" event={"ID":"e19d4e47-67bb-4e6f-a97c-9177040e3552","Type":"ContainerStarted","Data":"495056739de59eb5781a59df584530779b06a8ec0f92b1deec5917874d276a60"} Aug 02 10:34:23.091669 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:23.091620 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vqk48" podStartSLOduration=65.531126792 podStartE2EDuration="1m10.091608389s" totalImagesPullingTime="4.560481597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:23.09151529 +0000 UTC m=+70.873870252" watchObservedRunningTime="2026-08-02 10:34:23.091608389 +0000 UTC m=+70.873963343" Aug 02 10:34:23.106493 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:23.106450 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9zzhv" podStartSLOduration=65.4385209 podStartE2EDuration="1m10.106436955s" totalImagesPullingTime="4.667916055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:23.105551466 +0000 UTC m=+70.887906430" watchObservedRunningTime="2026-08-02 10:34:23.106436955 +0000 UTC m=+70.888791951" Aug 02 10:34:50.026467 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:50.026388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:34:50.026886 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:50.026465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:34:50.026886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:50.026539 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:34:50.026886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:50.026598 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:34:50.026886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:50.026615 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:34:50.026886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:50.026620 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:35:54.026603589 +0000 UTC m=+161.808958530 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:34:50.026886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:34:50.026674 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:35:54.026653226 +0000 UTC m=+161.809008227 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:34:54.082692 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:34:54.082657 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vqk48" Aug 02 10:35:21.433294 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:35:21.433251 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:35:21.433805 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:21.433403 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 02 10:35:21.433805 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:21.433473 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:23.433454594 +0000 UTC m=+251.215809538 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : secret "metrics-daemon-secret" not found Aug 02 10:35:49.153560 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:49.153517 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" Aug 02 10:35:49.169625 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:49.169600 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wggsn" podUID="d559cd67-31aa-4392-8ec0-1fcd701b4eb2" Aug 02 10:35:49.277239 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:35:49.277211 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wggsn" Aug 02 10:35:49.277378 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:35:49.277211 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:35:50.676478 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:50.676432 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:35:54.045502 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:35:54.045463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:35:54.045875 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:35:54.045539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:35:54.045875 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:54.045619 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 02 10:35:54.045875 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:54.045640 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74db5c755f-gtrw8: secret "image-registry-tls" not found Aug 02 10:35:54.045875 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:54.045700 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls podName:255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:56.045684463 +0000 UTC m=+283.828039408 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls") pod "image-registry-74db5c755f-gtrw8" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9") : secret "image-registry-tls" not found Aug 02 10:35:54.045875 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:54.045619 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 02 10:35:54.045875 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:35:54.045741 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls podName:d559cd67-31aa-4392-8ec0-1fcd701b4eb2 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:56.045730727 +0000 UTC m=+283.828085682 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls") pod "dns-default-wggsn" (UID: "d559cd67-31aa-4392-8ec0-1fcd701b4eb2") : secret "dns-default-metrics-tls" not found Aug 02 10:36:04.662026 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:36:04.661991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:37:23.520401 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:23.520368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:37:23.520886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:23.520489 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 02 10:37:23.520886 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:23.520542 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs podName:118f5d77-248c-4b45-a0cd-1e9648441505 nodeName:}" failed. No retries permitted until 2026-08-02 10:39:25.520528951 +0000 UTC m=+373.302883892 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs") pod "network-metrics-daemon-sg228" (UID: "118f5d77-248c-4b45-a0cd-1e9648441505") : secret "metrics-daemon-secret" not found Aug 02 10:37:33.270839 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.270797 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5"] Aug 02 10:37:33.275856 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.275829 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.278744 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.278723 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Aug 02 10:37:33.278744 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.278734 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Aug 02 10:37:33.279066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.279044 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Aug 02 10:37:33.279066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.279047 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Aug 02 10:37:33.279411 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.279396 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dbncm\"" Aug 02 10:37:33.293536 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.293514 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5"] Aug 02 10:37:33.366227 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.366198 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr"] Aug 02 10:37:33.367877 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.367862 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:33.369035 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.369011 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb"] Aug 02 10:37:33.371022 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.371002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" Aug 02 10:37:33.371689 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.371671 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 02 10:37:33.371785 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.371706 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 02 10:37:33.371785 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.371759 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 02 10:37:33.371883 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.371795 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2lp2n\"" Aug 02 10:37:33.373550 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.373533 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-rtp4t"] Aug 02 10:37:33.374613 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.374422 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2rstq\"" Aug 02 10:37:33.375315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.375293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.375714 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.375694 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0828ea2-f7b3-4076-b5c3-e5d54431f046-config\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.375808 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.375741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz56n\" (UniqueName: \"kubernetes.io/projected/a0828ea2-f7b3-4076-b5c3-e5d54431f046-kube-api-access-fz56n\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.375873 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.375807 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0828ea2-f7b3-4076-b5c3-e5d54431f046-serving-cert\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.379041 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.379023 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 02 10:37:33.379157 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.379035 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 02 10:37:33.379457 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.379440 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 02 10:37:33.379634 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.379613 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 02 10:37:33.379726 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.379592 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2db9v\"" Aug 02 10:37:33.380090 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.380069 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr"] Aug 02 10:37:33.383917 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.383889 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb"] Aug 02 10:37:33.386682 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.386661 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 02 10:37:33.393171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.393150 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rtp4t"] Aug 02 10:37:33.476446 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0828ea2-f7b3-4076-b5c3-e5d54431f046-serving-cert\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.476538 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e297a6b6-91b5-482d-a721-666326b0876e-serving-cert\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.476538 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6427k\" (UniqueName: \"kubernetes.io/projected/e297a6b6-91b5-482d-a721-666326b0876e-kube-api-access-6427k\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.476538 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpsmq\" (UniqueName: \"kubernetes.io/projected/3340e043-150b-484c-adaf-1cdfdbf8890f-kube-api-access-gpsmq\") pod \"network-check-source-65bdbbff45-xhwxb\" (UID: \"3340e043-150b-484c-adaf-1cdfdbf8890f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" Aug 02 10:37:33.476538 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0828ea2-f7b3-4076-b5c3-e5d54431f046-config\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.476696 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e297a6b6-91b5-482d-a721-666326b0876e-service-ca-bundle\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.476696 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:33.476791 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tgbl\" (UniqueName: \"kubernetes.io/projected/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-kube-api-access-7tgbl\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:33.476845 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz56n\" (UniqueName: \"kubernetes.io/projected/a0828ea2-f7b3-4076-b5c3-e5d54431f046-kube-api-access-fz56n\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.476892 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e297a6b6-91b5-482d-a721-666326b0876e-tmp\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.476892 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e297a6b6-91b5-482d-a721-666326b0876e-snapshots\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.476979 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e297a6b6-91b5-482d-a721-666326b0876e-trusted-ca-bundle\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.477027 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.476993 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0828ea2-f7b3-4076-b5c3-e5d54431f046-config\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.478682 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.478663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0828ea2-f7b3-4076-b5c3-e5d54431f046-serving-cert\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.490249 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.490232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz56n\" (UniqueName: \"kubernetes.io/projected/a0828ea2-f7b3-4076-b5c3-e5d54431f046-kube-api-access-fz56n\") pod \"service-ca-operator-784f97bcf6-wj2k5\" (UID: \"a0828ea2-f7b3-4076-b5c3-e5d54431f046\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.578053 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:33.578053 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tgbl\" (UniqueName: \"kubernetes.io/projected/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-kube-api-access-7tgbl\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e297a6b6-91b5-482d-a721-666326b0876e-tmp\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e297a6b6-91b5-482d-a721-666326b0876e-snapshots\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e297a6b6-91b5-482d-a721-666326b0876e-trusted-ca-bundle\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:33.578146 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e297a6b6-91b5-482d-a721-666326b0876e-serving-cert\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578178 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6427k\" (UniqueName: \"kubernetes.io/projected/e297a6b6-91b5-482d-a721-666326b0876e-kube-api-access-6427k\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:33.578218 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls podName:d05ec6f0-1c63-4e0b-aadf-2c70d1a16822 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:34.078200378 +0000 UTC m=+261.860555350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-ktlkr" (UID: "d05ec6f0-1c63-4e0b-aadf-2c70d1a16822") : secret "samples-operator-tls" not found Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpsmq\" (UniqueName: \"kubernetes.io/projected/3340e043-150b-484c-adaf-1cdfdbf8890f-kube-api-access-gpsmq\") pod \"network-check-source-65bdbbff45-xhwxb\" (UID: \"3340e043-150b-484c-adaf-1cdfdbf8890f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" Aug 02 10:37:33.578314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e297a6b6-91b5-482d-a721-666326b0876e-service-ca-bundle\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578727 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578489 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e297a6b6-91b5-482d-a721-666326b0876e-tmp\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578767 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578743 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e297a6b6-91b5-482d-a721-666326b0876e-service-ca-bundle\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578805 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e297a6b6-91b5-482d-a721-666326b0876e-snapshots\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.578976 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.578957 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e297a6b6-91b5-482d-a721-666326b0876e-trusted-ca-bundle\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.580238 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.580222 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e297a6b6-91b5-482d-a721-666326b0876e-serving-cert\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.584765 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.584747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" Aug 02 10:37:33.586756 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.586730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tgbl\" (UniqueName: \"kubernetes.io/projected/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-kube-api-access-7tgbl\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:33.586838 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.586736 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6427k\" (UniqueName: \"kubernetes.io/projected/e297a6b6-91b5-482d-a721-666326b0876e-kube-api-access-6427k\") pod \"insights-operator-77696685b-rtp4t\" (UID: \"e297a6b6-91b5-482d-a721-666326b0876e\") " pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.586838 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.586811 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpsmq\" (UniqueName: \"kubernetes.io/projected/3340e043-150b-484c-adaf-1cdfdbf8890f-kube-api-access-gpsmq\") pod \"network-check-source-65bdbbff45-xhwxb\" (UID: \"3340e043-150b-484c-adaf-1cdfdbf8890f\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" Aug 02 10:37:33.686728 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.686700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" Aug 02 10:37:33.690477 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.690454 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-rtp4t" Aug 02 10:37:33.698816 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.698791 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5"] Aug 02 10:37:33.702332 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:37:33.702301 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0828ea2_f7b3_4076_b5c3_e5d54431f046.slice/crio-4b767137a9858ca1fe2e7d3517604a02e89b2576049d0cca8da7690ba3fef37b WatchSource:0}: Error finding container 4b767137a9858ca1fe2e7d3517604a02e89b2576049d0cca8da7690ba3fef37b: Status 404 returned error can't find the container with id 4b767137a9858ca1fe2e7d3517604a02e89b2576049d0cca8da7690ba3fef37b Aug 02 10:37:33.813046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.813020 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-rtp4t"] Aug 02 10:37:33.817456 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:37:33.817433 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode297a6b6_91b5_482d_a721_666326b0876e.slice/crio-7af75d2bab4a8682633613170723a2e66bf47171bfb1dd39786260ea821a36cf WatchSource:0}: Error finding container 7af75d2bab4a8682633613170723a2e66bf47171bfb1dd39786260ea821a36cf: Status 404 returned error can't find the container with id 7af75d2bab4a8682633613170723a2e66bf47171bfb1dd39786260ea821a36cf Aug 02 10:37:33.839621 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:33.839568 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb"] Aug 02 10:37:33.841697 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:37:33.841676 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3340e043_150b_484c_adaf_1cdfdbf8890f.slice/crio-f4b788cbee873aef2ba6c0cddd29769b25ec1f83fe40c5f9013e9d7d8894e9a1 WatchSource:0}: Error finding container f4b788cbee873aef2ba6c0cddd29769b25ec1f83fe40c5f9013e9d7d8894e9a1: Status 404 returned error can't find the container with id f4b788cbee873aef2ba6c0cddd29769b25ec1f83fe40c5f9013e9d7d8894e9a1 Aug 02 10:37:34.081853 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:34.081829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:34.082001 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:34.081982 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 10:37:34.082049 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:34.082040 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls podName:d05ec6f0-1c63-4e0b-aadf-2c70d1a16822 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:35.082026662 +0000 UTC m=+262.864381603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-ktlkr" (UID: "d05ec6f0-1c63-4e0b-aadf-2c70d1a16822") : secret "samples-operator-tls" not found Aug 02 10:37:34.524241 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:34.524208 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" event={"ID":"a0828ea2-f7b3-4076-b5c3-e5d54431f046","Type":"ContainerStarted","Data":"4b767137a9858ca1fe2e7d3517604a02e89b2576049d0cca8da7690ba3fef37b"} Aug 02 10:37:34.525476 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:34.525440 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rtp4t" event={"ID":"e297a6b6-91b5-482d-a721-666326b0876e","Type":"ContainerStarted","Data":"7af75d2bab4a8682633613170723a2e66bf47171bfb1dd39786260ea821a36cf"} Aug 02 10:37:34.527079 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:34.527051 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" event={"ID":"3340e043-150b-484c-adaf-1cdfdbf8890f","Type":"ContainerStarted","Data":"72fc4b4c48d184a858990aec272623dc9dd0a7132b8f34d8910a5ff85a1ea748"} Aug 02 10:37:34.527208 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:34.527099 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" event={"ID":"3340e043-150b-484c-adaf-1cdfdbf8890f","Type":"ContainerStarted","Data":"f4b788cbee873aef2ba6c0cddd29769b25ec1f83fe40c5f9013e9d7d8894e9a1"} Aug 02 10:37:34.542684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:34.542544 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-xhwxb" podStartSLOduration=1.5425271010000001 podStartE2EDuration="1.542527101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:34.542338886 +0000 UTC m=+262.324693851" watchObservedRunningTime="2026-08-02 10:37:34.542527101 +0000 UTC m=+262.324882066" Aug 02 10:37:35.089679 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:35.089603 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:35.089831 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:35.089756 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 10:37:35.089831 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:35.089818 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls podName:d05ec6f0-1c63-4e0b-aadf-2c70d1a16822 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:37.089801434 +0000 UTC m=+264.872156387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-ktlkr" (UID: "d05ec6f0-1c63-4e0b-aadf-2c70d1a16822") : secret "samples-operator-tls" not found Aug 02 10:37:36.534670 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:36.534589 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" event={"ID":"a0828ea2-f7b3-4076-b5c3-e5d54431f046","Type":"ContainerStarted","Data":"68faea9d73fa17b946c5c38ae67a515e13055a65803153365bd45a7f6eaa28d9"} Aug 02 10:37:36.536106 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:36.536078 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rtp4t" event={"ID":"e297a6b6-91b5-482d-a721-666326b0876e","Type":"ContainerStarted","Data":"400862450bc0492175def863629e8fba3945838b3ffec771a70b027e9210481f"} Aug 02 10:37:36.551639 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:36.551587 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" podStartSLOduration=0.983222904 podStartE2EDuration="3.55156906s" totalImagesPullingTime="2.568346156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:36.55067764 +0000 UTC m=+264.333032604" watchObservedRunningTime="2026-08-02 10:37:36.55156906 +0000 UTC m=+264.333924027" Aug 02 10:37:36.569183 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:36.569004 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-rtp4t" podStartSLOduration=1.119381405 podStartE2EDuration="3.568986202s" totalImagesPullingTime="2.449604797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:36.567717835 +0000 UTC m=+264.350072799" watchObservedRunningTime="2026-08-02 10:37:36.568986202 +0000 UTC m=+264.351341167" Aug 02 10:37:37.104940 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.104915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:37.105067 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:37.105015 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 10:37:37.105141 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:37.105077 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls podName:d05ec6f0-1c63-4e0b-aadf-2c70d1a16822 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.105059488 +0000 UTC m=+268.887414443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-ktlkr" (UID: "d05ec6f0-1c63-4e0b-aadf-2c70d1a16822") : secret "samples-operator-tls" not found Aug 02 10:37:37.373184 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.373099 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5r7l9"] Aug 02 10:37:37.375299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.375278 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.377637 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.377615 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 02 10:37:37.377765 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.377649 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 02 10:37:37.377875 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.377859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-94g6g\"" Aug 02 10:37:37.388840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.388818 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5r7l9"] Aug 02 10:37:37.507972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.507949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-crio-socket\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.508058 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.507978 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.508058 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.508012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7r8p\" (UniqueName: \"kubernetes.io/projected/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-api-access-s7r8p\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.508140 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.508130 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.508208 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.508187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-data-volume\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.608633 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.608610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-data-volume\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.608922 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.608686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-crio-socket\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.608922 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.608712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.608922 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.608789 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7r8p\" (UniqueName: \"kubernetes.io/projected/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-api-access-s7r8p\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.608922 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.608878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.609143 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:37.608939 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 10:37:37.609143 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.608941 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-data-volume\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.609143 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:37.608999 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:38.108983026 +0000 UTC m=+265.891337986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : configmap "kube-rbac-proxy" not found Aug 02 10:37:37.609143 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:37.609036 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 10:37:37.609143 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.609039 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-crio-socket\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:37.609143 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:37.609083 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:38.109066965 +0000 UTC m=+265.891421910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : secret "insights-runtime-extractor-tls" not found Aug 02 10:37:37.618239 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:37.618221 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7r8p\" (UniqueName: \"kubernetes.io/projected/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-api-access-s7r8p\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:38.112554 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:38.112525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:38.112720 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:38.112662 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 10:37:38.112720 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:38.112685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:38.112720 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:38.112718 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:39.112703915 +0000 UTC m=+266.895058857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : secret "insights-runtime-extractor-tls" not found Aug 02 10:37:38.112889 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:38.112753 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 10:37:38.112889 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:38.112812 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:39.112794357 +0000 UTC m=+266.895149314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : configmap "kube-rbac-proxy" not found Aug 02 10:37:39.119851 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:39.119811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:39.120322 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:39.119878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:39.120322 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:39.119961 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 10:37:39.120322 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:39.119979 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 10:37:39.120322 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:39.120040 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.120024305 +0000 UTC m=+268.902379246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : secret "insights-runtime-extractor-tls" not found Aug 02 10:37:39.120322 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:39.120053 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.120047184 +0000 UTC m=+268.902402125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : configmap "kube-rbac-proxy" not found Aug 02 10:37:40.142444 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:40.142410 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mnx6v_4402ce57-5dd1-4e02-b524-79b116c2f040/dns-node-resolver/0.log" Aug 02 10:37:41.136088 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:41.136046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:41.136088 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:41.136088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:41.136372 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:41.136223 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 02 10:37:41.136372 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:41.136228 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 10:37:41.136372 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:41.136287 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls podName:d05ec6f0-1c63-4e0b-aadf-2c70d1a16822 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:49.136268451 +0000 UTC m=+276.918623393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-ktlkr" (UID: "d05ec6f0-1c63-4e0b-aadf-2c70d1a16822") : secret "samples-operator-tls" not found Aug 02 10:37:41.136372 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:41.136307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:41.136372 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:41.136347 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:45.13633872 +0000 UTC m=+272.918693661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : secret "insights-runtime-extractor-tls" not found Aug 02 10:37:41.136605 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:41.136401 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 10:37:41.136605 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:41.136472 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:45.136452621 +0000 UTC m=+272.918807562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : configmap "kube-rbac-proxy" not found Aug 02 10:37:41.341832 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:41.341809 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5v79_ca39a0ce-4030-4d12-b7d9-99f45bffa241/node-ca/0.log" Aug 02 10:37:42.142343 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:42.142315 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9grhz_0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c/serve-healthcheck-canary/0.log" Aug 02 10:37:45.162868 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:45.162826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:45.163338 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:45.162905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:45.163338 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:45.162991 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 10:37:45.163338 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:45.163021 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 02 10:37:45.163338 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:45.163057 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:53.163040136 +0000 UTC m=+280.945395077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : secret "insights-runtime-extractor-tls" not found Aug 02 10:37:45.163338 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:45.163081 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:37:53.163065492 +0000 UTC m=+280.945420433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : configmap "kube-rbac-proxy" not found Aug 02 10:37:49.197395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:49.197361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:49.199601 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:49.199580 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d05ec6f0-1c63-4e0b-aadf-2c70d1a16822-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-ktlkr\" (UID: \"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:49.277576 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:49.277544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" Aug 02 10:37:49.425528 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:49.425503 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr"] Aug 02 10:37:49.585577 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:49.585543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" event={"ID":"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822","Type":"ContainerStarted","Data":"36f24ad3b36199b6dbe2689a0e29c3ee7fb43e100af7559dbde1755884bf4c5e"} Aug 02 10:37:51.594032 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:51.593992 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" event={"ID":"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822","Type":"ContainerStarted","Data":"2d047b4bdf253d1102dba447aeef1ca00390f9603f398bce0fce565ab4b1b78d"} Aug 02 10:37:51.594455 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:51.594056 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" event={"ID":"d05ec6f0-1c63-4e0b-aadf-2c70d1a16822","Type":"ContainerStarted","Data":"2074e22d55068250b20864a28ff20e47e887dc87c333556883541d4d9c9575c7"} Aug 02 10:37:51.614618 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:51.614566 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-ktlkr" podStartSLOduration=17.176833163 podStartE2EDuration="18.614548891s" totalImagesPullingTime="1.437715728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:51.61375889 +0000 UTC m=+279.396113852" watchObservedRunningTime="2026-08-02 10:37:51.614548891 +0000 UTC m=+279.396903853" Aug 02 10:37:52.277767 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:52.277718 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" Aug 02 10:37:52.277767 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:52.277718 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wggsn" podUID="d559cd67-31aa-4392-8ec0-1fcd701b4eb2" Aug 02 10:37:52.597143 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:52.597061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wggsn" Aug 02 10:37:52.597143 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:52.597074 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:37:53.226374 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:53.226344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:53.226568 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:53.226400 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:53.226568 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:53.226489 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 02 10:37:53.226568 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:37:53.226559 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls podName:0bb500e6-e4fb-4f66-aa28-9b868a7f44db nodeName:}" failed. No retries permitted until 2026-08-02 10:38:09.226540091 +0000 UTC m=+297.008895039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5r7l9" (UID: "0bb500e6-e4fb-4f66-aa28-9b868a7f44db") : secret "insights-runtime-extractor-tls" not found Aug 02 10:37:53.226862 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:53.226840 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:37:56.046399 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.046350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:37:56.046399 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.046394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:37:56.048955 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.048917 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d559cd67-31aa-4392-8ec0-1fcd701b4eb2-metrics-tls\") pod \"dns-default-wggsn\" (UID: \"d559cd67-31aa-4392-8ec0-1fcd701b4eb2\") " pod="openshift-dns/dns-default-wggsn" Aug 02 10:37:56.049160 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.049113 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"image-registry-74db5c755f-gtrw8\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:37:56.201314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.201288 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nv7kc\"" Aug 02 10:37:56.201314 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.201317 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-plb6r\"" Aug 02 10:37:56.208554 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.208525 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:37:56.208677 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.208566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wggsn" Aug 02 10:37:56.354324 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.354297 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74db5c755f-gtrw8"] Aug 02 10:37:56.358382 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:37:56.358359 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255ac2e9_f349_42c3_acc9_bb7c1c7ad5e9.slice/crio-a39a7b8a23ee799dbf4e77b0d6b1e259f14f9ab6ab0bce2656dcac9139978141 WatchSource:0}: Error finding container a39a7b8a23ee799dbf4e77b0d6b1e259f14f9ab6ab0bce2656dcac9139978141: Status 404 returned error can't find the container with id a39a7b8a23ee799dbf4e77b0d6b1e259f14f9ab6ab0bce2656dcac9139978141 Aug 02 10:37:56.368718 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.368697 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wggsn"] Aug 02 10:37:56.371194 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:37:56.371166 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd559cd67_31aa_4392_8ec0_1fcd701b4eb2.slice/crio-1e296a3b5e60360720153556e955f9e83e052e8183d9ec217db950bdf4ab51e6 WatchSource:0}: Error finding container 1e296a3b5e60360720153556e955f9e83e052e8183d9ec217db950bdf4ab51e6: Status 404 returned error can't find the container with id 1e296a3b5e60360720153556e955f9e83e052e8183d9ec217db950bdf4ab51e6 Aug 02 10:37:56.613308 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.613220 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" event={"ID":"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9","Type":"ContainerStarted","Data":"75a0ad3b908221aaddd17410a5d4551b7820c4eb0e9f1211b2c44507f33ac297"} Aug 02 10:37:56.613308 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.613281 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" event={"ID":"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9","Type":"ContainerStarted","Data":"a39a7b8a23ee799dbf4e77b0d6b1e259f14f9ab6ab0bce2656dcac9139978141"} Aug 02 10:37:56.613308 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.613310 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:37:56.614250 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.614222 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wggsn" event={"ID":"d559cd67-31aa-4392-8ec0-1fcd701b4eb2","Type":"ContainerStarted","Data":"1e296a3b5e60360720153556e955f9e83e052e8183d9ec217db950bdf4ab51e6"} Aug 02 10:37:56.634177 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:56.634095 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" podStartSLOduration=283.634079721 podStartE2EDuration="4m43.634079721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:56.633740317 +0000 UTC m=+284.416095281" watchObservedRunningTime="2026-08-02 10:37:56.634079721 +0000 UTC m=+284.416434684" Aug 02 10:37:58.624099 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:58.624062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wggsn" event={"ID":"d559cd67-31aa-4392-8ec0-1fcd701b4eb2","Type":"ContainerStarted","Data":"7c08c317f3e5f389629bb3ffabb54793dc6b8a51436477fabc9810dcf4e0debf"} Aug 02 10:37:58.624476 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:58.624174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wggsn" event={"ID":"d559cd67-31aa-4392-8ec0-1fcd701b4eb2","Type":"ContainerStarted","Data":"9326bfc140174199d2ae42d70950c768599e0a84c37324365602b4c54ea1b0e4"} Aug 02 10:37:58.624476 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:58.624213 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wggsn" Aug 02 10:37:58.642950 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:37:58.642905 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wggsn" podStartSLOduration=250.911042109 podStartE2EDuration="4m12.642891184s" totalImagesPullingTime="1.731849075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:58.642362427 +0000 UTC m=+286.424717389" watchObservedRunningTime="2026-08-02 10:37:58.642891184 +0000 UTC m=+286.425246146" Aug 02 10:38:07.663355 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:07.663309 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sg228" podUID="118f5d77-248c-4b45-a0cd-1e9648441505" Aug 02 10:38:08.039051 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.039011 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d"] Aug 02 10:38:08.041882 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.041857 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:08.044454 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.044436 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Aug 02 10:38:08.044617 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.044599 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k56sf\"" Aug 02 10:38:08.050581 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.050553 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d"] Aug 02 10:38:08.227615 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.227589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8312cf70-c4c4-4e0f-a72f-36337c574ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-lpm5d\" (UID: \"8312cf70-c4c4-4e0f-a72f-36337c574ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:08.328705 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.328643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8312cf70-c4c4-4e0f-a72f-36337c574ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-lpm5d\" (UID: \"8312cf70-c4c4-4e0f-a72f-36337c574ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:08.328811 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:08.328751 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Aug 02 10:38:08.328811 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:08.328806 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8312cf70-c4c4-4e0f-a72f-36337c574ff1-tls-certificates podName:8312cf70-c4c4-4e0f-a72f-36337c574ff1 nodeName:}" failed. No retries permitted until 2026-08-02 10:38:08.828791595 +0000 UTC m=+296.611146536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8312cf70-c4c4-4e0f-a72f-36337c574ff1-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-lpm5d" (UID: "8312cf70-c4c4-4e0f-a72f-36337c574ff1") : secret "prometheus-operator-admission-webhook-tls" not found Aug 02 10:38:08.629630 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.629576 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wggsn" Aug 02 10:38:08.831854 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.831813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8312cf70-c4c4-4e0f-a72f-36337c574ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-lpm5d\" (UID: \"8312cf70-c4c4-4e0f-a72f-36337c574ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:08.834045 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.834022 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8312cf70-c4c4-4e0f-a72f-36337c574ff1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-lpm5d\" (UID: \"8312cf70-c4c4-4e0f-a72f-36337c574ff1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:08.951721 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:08.951675 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:09.069346 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.069317 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d"] Aug 02 10:38:09.071872 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:09.071847 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8312cf70_c4c4_4e0f_a72f_36337c574ff1.slice/crio-a33a177fe17f30cb59904d9ecf5ae6b2f3859f9cdbe8a417d648498bf98cecd2 WatchSource:0}: Error finding container a33a177fe17f30cb59904d9ecf5ae6b2f3859f9cdbe8a417d648498bf98cecd2: Status 404 returned error can't find the container with id a33a177fe17f30cb59904d9ecf5ae6b2f3859f9cdbe8a417d648498bf98cecd2 Aug 02 10:38:09.235272 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.235203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:38:09.237397 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.237377 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0bb500e6-e4fb-4f66-aa28-9b868a7f44db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5r7l9\" (UID: \"0bb500e6-e4fb-4f66-aa28-9b868a7f44db\") " pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:38:09.483418 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.483393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5r7l9" Aug 02 10:38:09.614681 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.614651 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5r7l9"] Aug 02 10:38:09.620960 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:09.620925 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb500e6_e4fb_4f66_aa28_9b868a7f44db.slice/crio-c39b30aa619f42bb52179ede7a49d5cfeb844b30a09e7040f1858c00fe39be55 WatchSource:0}: Error finding container c39b30aa619f42bb52179ede7a49d5cfeb844b30a09e7040f1858c00fe39be55: Status 404 returned error can't find the container with id c39b30aa619f42bb52179ede7a49d5cfeb844b30a09e7040f1858c00fe39be55 Aug 02 10:38:09.665389 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.665361 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7l9" event={"ID":"0bb500e6-e4fb-4f66-aa28-9b868a7f44db","Type":"ContainerStarted","Data":"c39b30aa619f42bb52179ede7a49d5cfeb844b30a09e7040f1858c00fe39be55"} Aug 02 10:38:09.666688 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:09.666653 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" event={"ID":"8312cf70-c4c4-4e0f-a72f-36337c574ff1","Type":"ContainerStarted","Data":"a33a177fe17f30cb59904d9ecf5ae6b2f3859f9cdbe8a417d648498bf98cecd2"} Aug 02 10:38:10.677735 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:10.677661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7l9" event={"ID":"0bb500e6-e4fb-4f66-aa28-9b868a7f44db","Type":"ContainerStarted","Data":"7cde619c7c588c89c6f614866923993d7b404929f698fe3cefd0b57507972ac6"} Aug 02 10:38:10.677735 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:10.677730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7l9" event={"ID":"0bb500e6-e4fb-4f66-aa28-9b868a7f44db","Type":"ContainerStarted","Data":"2cdc6c717f5f6cb6ba19ca8f62c75255fc8d17a978a7de6bf112be2d4a4c7aaf"} Aug 02 10:38:10.679206 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:10.679170 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" event={"ID":"8312cf70-c4c4-4e0f-a72f-36337c574ff1","Type":"ContainerStarted","Data":"24fc7effdd0e54121bdae56a77bd8835218ac4ddca483b339f968d2a03839219"} Aug 02 10:38:10.679417 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:10.679392 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:10.684500 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:10.684477 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" Aug 02 10:38:10.694377 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:10.694334 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-lpm5d" podStartSLOduration=1.645682485 podStartE2EDuration="2.694319455s" totalImagesPullingTime="1.04863697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:10.693251888 +0000 UTC m=+298.475606852" watchObservedRunningTime="2026-08-02 10:38:10.694319455 +0000 UTC m=+298.476674418" Aug 02 10:38:12.555918 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:12.555885 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:38:12.557011 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:12.556987 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:38:12.563699 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:12.563677 2554 kubelet.go:1648] "Image garbage collection succeeded" Aug 02 10:38:12.686380 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:12.686271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5r7l9" event={"ID":"0bb500e6-e4fb-4f66-aa28-9b868a7f44db","Type":"ContainerStarted","Data":"444cf2d9d15f870444e6e0cb1f08b2fe903313098e24f2bfae9c675726f48cb1"} Aug 02 10:38:12.710795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:12.704717 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5r7l9" podStartSLOduration=33.801671539 podStartE2EDuration="35.704704235s" totalImagesPullingTime="1.903032696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:37:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:12.703598172 +0000 UTC m=+300.485953135" watchObservedRunningTime="2026-08-02 10:38:12.704704235 +0000 UTC m=+300.487059197" Aug 02 10:38:15.439240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.439199 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg"] Aug 02 10:38:15.442732 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.442703 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.445738 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.445707 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 02 10:38:15.445864 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.445741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 02 10:38:15.445864 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.445800 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 02 10:38:15.445864 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.445849 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 02 10:38:15.446726 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.446701 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 02 10:38:15.446726 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.446720 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x6vn2\"" Aug 02 10:38:15.452874 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.452843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg"] Aug 02 10:38:15.461743 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.461715 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw"] Aug 02 10:38:15.465012 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.464996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.467215 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.467190 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pbv8c"] Aug 02 10:38:15.468033 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.468008 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Aug 02 10:38:15.468166 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.468031 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Aug 02 10:38:15.468166 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.468090 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d6x2w\"" Aug 02 10:38:15.468297 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.468010 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Aug 02 10:38:15.470616 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.470596 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.473239 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.473087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 02 10:38:15.473382 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.473364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 02 10:38:15.473459 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.473384 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7h556\"" Aug 02 10:38:15.473459 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.473424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 02 10:38:15.477403 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.477382 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw"] Aug 02 10:38:15.483701 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483681 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.483793 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5kh\" (UniqueName: \"kubernetes.io/projected/2819adc9-ec1f-419c-b9c4-8ced7b332449-kube-api-access-qt5kh\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.483793 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-accelerators-collector-config\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.483793 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483759 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.483895 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-sys\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.483895 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483850 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-root\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.483895 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483868 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-wtmp\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.483895 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.484014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-tls\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.484014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2586\" (UniqueName: \"kubernetes.io/projected/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-kube-api-access-c2586\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.484014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.483962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3a6aad5-4498-4317-8575-41ac13aa7ffc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.484014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9p5\" (UniqueName: \"kubernetes.io/projected/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-api-access-jv9p5\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.484142 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.484142 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-textfile\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.484142 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.484142 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6aad5-4498-4317-8575-41ac13aa7ffc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.484263 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2819adc9-ec1f-419c-b9c4-8ced7b332449-metrics-client-ca\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.484263 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.484263 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.484199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585015 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.584990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.585015 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6aad5-4498-4317-8575-41ac13aa7ffc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2819adc9-ec1f-419c-b9c4-8ced7b332449-metrics-client-ca\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585135 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585161 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5kh\" (UniqueName: \"kubernetes.io/projected/2819adc9-ec1f-419c-b9c4-8ced7b332449-kube-api-access-qt5kh\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-accelerators-collector-config\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-sys\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-root\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585293 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-wtmp\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585320 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585345 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-tls\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2586\" (UniqueName: \"kubernetes.io/projected/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-kube-api-access-c2586\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3a6aad5-4498-4317-8575-41ac13aa7ffc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9p5\" (UniqueName: \"kubernetes.io/projected/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-api-access-jv9p5\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585600 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585595 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-wtmp\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-textfile\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585690 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2819adc9-ec1f-419c-b9c4-8ced7b332449-metrics-client-ca\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585755 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3a6aad5-4498-4317-8575-41ac13aa7ffc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:15.585830 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:15.585891 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-tls podName:2819adc9-ec1f-419c-b9c4-8ced7b332449 nodeName:}" failed. No retries permitted until 2026-08-02 10:38:16.085874052 +0000 UTC m=+303.868229012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-tls") pod "node-exporter-pbv8c" (UID: "2819adc9-ec1f-419c-b9c4-8ced7b332449") : secret "node-exporter-tls" not found Aug 02 10:38:15.585969 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585890 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.586394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.585983 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-textfile\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.586394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.586006 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-sys\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.586394 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:15.586098 2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Aug 02 10:38:15.586394 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:15.586223 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls podName:a3a6aad5-4498-4317-8575-41ac13aa7ffc nodeName:}" failed. No retries permitted until 2026-08-02 10:38:16.086205529 +0000 UTC m=+303.868560483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-wxsfw" (UID: "a3a6aad5-4498-4317-8575-41ac13aa7ffc") : secret "kube-state-metrics-tls" not found Aug 02 10:38:15.586394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.586229 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3a6aad5-4498-4317-8575-41ac13aa7ffc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.586394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.586301 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2819adc9-ec1f-419c-b9c4-8ced7b332449-root\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.586695 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.586462 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-accelerators-collector-config\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.586942 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.586921 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.587942 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.587920 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.588049 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.588028 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.588257 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.588240 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.588315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.588296 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.594022 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.594001 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9p5\" (UniqueName: \"kubernetes.io/projected/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-api-access-jv9p5\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:15.594157 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.594103 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5kh\" (UniqueName: \"kubernetes.io/projected/2819adc9-ec1f-419c-b9c4-8ced7b332449-kube-api-access-qt5kh\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:15.594486 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.594466 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2586\" (UniqueName: \"kubernetes.io/projected/aff29baa-8bcd-4d42-ab92-b6c9ec213feb-kube-api-access-c2586\") pod \"openshift-state-metrics-6bb4d7b4dd-mvmpg\" (UID: \"aff29baa-8bcd-4d42-ab92-b6c9ec213feb\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.753769 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.753750 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" Aug 02 10:38:15.877438 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.877410 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg"] Aug 02 10:38:15.880845 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:15.880823 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff29baa_8bcd_4d42_ab92_b6c9ec213feb.slice/crio-f9bda387b05cb8e2e9f1e71db27a6d7a4e2c08c44e522b31320643b335acb94f WatchSource:0}: Error finding container f9bda387b05cb8e2e9f1e71db27a6d7a4e2c08c44e522b31320643b335acb94f: Status 404 returned error can't find the container with id f9bda387b05cb8e2e9f1e71db27a6d7a4e2c08c44e522b31320643b335acb94f Aug 02 10:38:15.983452 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:15.983435 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 10:38:16.089496 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.089436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-tls\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:16.089496 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.089492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:16.089625 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:16.089584 2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Aug 02 10:38:16.089660 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:38:16.089630 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls podName:a3a6aad5-4498-4317-8575-41ac13aa7ffc nodeName:}" failed. No retries permitted until 2026-08-02 10:38:17.089616333 +0000 UTC m=+304.871971275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-wxsfw" (UID: "a3a6aad5-4498-4317-8575-41ac13aa7ffc") : secret "kube-state-metrics-tls" not found Aug 02 10:38:16.091486 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.091456 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2819adc9-ec1f-419c-b9c4-8ced7b332449-node-exporter-tls\") pod \"node-exporter-pbv8c\" (UID: \"2819adc9-ec1f-419c-b9c4-8ced7b332449\") " pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:16.212834 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.212803 2554 patch_prober.go:28] interesting pod/image-registry-74db5c755f-gtrw8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 02 10:38:16.212932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.212847 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 02 10:38:16.382618 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.382551 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pbv8c" Aug 02 10:38:16.393222 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:16.393192 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2819adc9_ec1f_419c_b9c4_8ced7b332449.slice/crio-116981892d40e34aaf62b7ed116175bc3d26a77a2e8abf17c7e14d4efb80dbd3 WatchSource:0}: Error finding container 116981892d40e34aaf62b7ed116175bc3d26a77a2e8abf17c7e14d4efb80dbd3: Status 404 returned error can't find the container with id 116981892d40e34aaf62b7ed116175bc3d26a77a2e8abf17c7e14d4efb80dbd3 Aug 02 10:38:16.543470 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.543443 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:38:16.547144 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.547106 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.549865 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.549715 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pt498\"" Aug 02 10:38:16.549865 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.549719 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 02 10:38:16.549865 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.549763 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 02 10:38:16.549865 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.549722 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 02 10:38:16.550091 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.549942 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 02 10:38:16.550241 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.550226 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 02 10:38:16.550305 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.550287 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 02 10:38:16.550389 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.550372 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 02 10:38:16.550454 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.550420 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 02 10:38:16.550528 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.550504 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 02 10:38:16.562298 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.562279 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:38:16.593278 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593393 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593286 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593393 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593307 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593393 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593330 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593558 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593558 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593558 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-web-config\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-out\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593684 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593851 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593712 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.593851 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.593740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zz4w\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-kube-api-access-9zz4w\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695103 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695103 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-web-config\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-out\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695179 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zz4w\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-kube-api-access-9zz4w\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695223 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695250 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695299 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695648 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695648 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695382 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695648 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695407 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695648 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.695845 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.695752 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.697273 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.697242 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.698220 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.698184 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.698699 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.698655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.698970 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.698940 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.699352 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.699302 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-web-config\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.699533 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.699511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-out\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.699979 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.699923 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.700073 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.700032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.700156 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.700088 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.700760 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.700721 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.701024 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.700997 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.702452 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.702424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbv8c" event={"ID":"2819adc9-ec1f-419c-b9c4-8ced7b332449","Type":"ContainerStarted","Data":"116981892d40e34aaf62b7ed116175bc3d26a77a2e8abf17c7e14d4efb80dbd3"} Aug 02 10:38:16.703580 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.703548 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zz4w\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-kube-api-access-9zz4w\") pod \"alertmanager-main-0\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:16.704324 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.704300 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" event={"ID":"aff29baa-8bcd-4d42-ab92-b6c9ec213feb","Type":"ContainerStarted","Data":"5b414b0d12c3055fac63bcbf40a2f5e0d5ba0f37e5b52a3ba562fe2644d70745"} Aug 02 10:38:16.704404 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.704354 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" event={"ID":"aff29baa-8bcd-4d42-ab92-b6c9ec213feb","Type":"ContainerStarted","Data":"97eae2d4111134d127cb49bcf8596f29ebc0fc9bad9a55ced5e34921e0179b5c"} Aug 02 10:38:16.704404 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.704385 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" event={"ID":"aff29baa-8bcd-4d42-ab92-b6c9ec213feb","Type":"ContainerStarted","Data":"f9bda387b05cb8e2e9f1e71db27a6d7a4e2c08c44e522b31320643b335acb94f"} Aug 02 10:38:16.858293 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:16.858255 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:38:17.059560 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.059528 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:38:17.098430 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.098393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:17.101102 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.101075 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a6aad5-4498-4317-8575-41ac13aa7ffc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-wxsfw\" (UID: \"a3a6aad5-4498-4317-8575-41ac13aa7ffc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:17.174282 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:17.174257 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799d1052_ea4a_4396_88c8_ea1c7c05ae8c.slice/crio-2af98374033b26ba17f477a06759ec63ad06762fdd69150284e1d74eac2c2c78 WatchSource:0}: Error finding container 2af98374033b26ba17f477a06759ec63ad06762fdd69150284e1d74eac2c2c78: Status 404 returned error can't find the container with id 2af98374033b26ba17f477a06759ec63ad06762fdd69150284e1d74eac2c2c78 Aug 02 10:38:17.276452 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.276431 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" Aug 02 10:38:17.399369 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.399344 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw"] Aug 02 10:38:17.418924 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:17.418900 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a6aad5_4498_4317_8575_41ac13aa7ffc.slice/crio-4d99a05fb95305abe1f304c10ea553c8f87de9c932a281b557b2421f4d496fcb WatchSource:0}: Error finding container 4d99a05fb95305abe1f304c10ea553c8f87de9c932a281b557b2421f4d496fcb: Status 404 returned error can't find the container with id 4d99a05fb95305abe1f304c10ea553c8f87de9c932a281b557b2421f4d496fcb Aug 02 10:38:17.624498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.624445 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:38:17.709878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.709842 2554 generic.go:356] "Generic (PLEG): container finished" podID="2819adc9-ec1f-419c-b9c4-8ced7b332449" containerID="6eb4a3eabab139b9c51b326c4e45be226758f66b4f3d8a1550b1b726a3df99db" exitCode=0 Aug 02 10:38:17.710099 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.709932 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbv8c" event={"ID":"2819adc9-ec1f-419c-b9c4-8ced7b332449","Type":"ContainerDied","Data":"6eb4a3eabab139b9c51b326c4e45be226758f66b4f3d8a1550b1b726a3df99db"} Aug 02 10:38:17.712803 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.712778 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" event={"ID":"aff29baa-8bcd-4d42-ab92-b6c9ec213feb","Type":"ContainerStarted","Data":"d0ff707471b198c7021394a83ccce7c63132177944d62f05f73e1010605cf847"} Aug 02 10:38:17.714679 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.714652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" event={"ID":"a3a6aad5-4498-4317-8575-41ac13aa7ffc","Type":"ContainerStarted","Data":"4d99a05fb95305abe1f304c10ea553c8f87de9c932a281b557b2421f4d496fcb"} Aug 02 10:38:17.716196 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.716100 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"2af98374033b26ba17f477a06759ec63ad06762fdd69150284e1d74eac2c2c78"} Aug 02 10:38:17.776013 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:17.775961 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mvmpg" podStartSLOduration=1.5800410870000001 podStartE2EDuration="2.775940935s" totalImagesPullingTime="1.195899848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:17.773516538 +0000 UTC m=+305.555871501" watchObservedRunningTime="2026-08-02 10:38:17.775940935 +0000 UTC m=+305.558295898" Aug 02 10:38:18.721234 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:18.721207 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db" exitCode=0 Aug 02 10:38:18.721565 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:18.721291 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db"} Aug 02 10:38:18.723550 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:18.723529 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbv8c" event={"ID":"2819adc9-ec1f-419c-b9c4-8ced7b332449","Type":"ContainerStarted","Data":"9ae50f50d2fcb457111b65f9233a3c759fe6dfef20051e13b264abf176e188a5"} Aug 02 10:38:18.723635 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:18.723576 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbv8c" event={"ID":"2819adc9-ec1f-419c-b9c4-8ced7b332449","Type":"ContainerStarted","Data":"74d1aa6e5bd69734dad6e5bb36a50177cf3e0a300c9d6794e90ad6f04beb449a"} Aug 02 10:38:18.772566 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:18.772523 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pbv8c" podStartSLOduration=2.879239845 podStartE2EDuration="3.772502988s" totalImagesPullingTime="824.243541ms" totalInitContainerRuntime="69.019602ms" isStatefulPod=true podCreationTimestamp="2026-08-02 10:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:18.771848027 +0000 UTC m=+306.554202986" watchObservedRunningTime="2026-08-02 10:38:18.772502988 +0000 UTC m=+306.554857955" Aug 02 10:38:19.729925 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.729769 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" event={"ID":"a3a6aad5-4498-4317-8575-41ac13aa7ffc","Type":"ContainerStarted","Data":"8f050278efb8c1f597772429d8434f52c20b85025f2b2caf47d8c730f8e092c7"} Aug 02 10:38:19.729925 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.729879 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" event={"ID":"a3a6aad5-4498-4317-8575-41ac13aa7ffc","Type":"ContainerStarted","Data":"064557fb329647775bdb4774bc372a286181fccb07e5aa86a2326c396bb28a90"} Aug 02 10:38:19.729925 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.729899 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" event={"ID":"a3a6aad5-4498-4317-8575-41ac13aa7ffc","Type":"ContainerStarted","Data":"ff98c5c0cd041f6c6e13f7b3137a001375cad58f7a9f9f729c49ccdb1be0db5c"} Aug 02 10:38:19.749870 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.749827 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-wxsfw" podStartSLOduration=3.451299533 podStartE2EDuration="4.74981166s" totalImagesPullingTime="1.298512127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:19.7483113 +0000 UTC m=+307.530666262" watchObservedRunningTime="2026-08-02 10:38:19.74981166 +0000 UTC m=+307.532166623" Aug 02 10:38:19.910191 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.910160 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d48f86fdf-wc62b"] Aug 02 10:38:19.914485 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.914460 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:19.917488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.917226 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Aug 02 10:38:19.917488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.917286 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Aug 02 10:38:19.917488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.917329 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2blbub49v6e2g\"" Aug 02 10:38:19.917488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.917226 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Aug 02 10:38:19.917488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.917226 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 02 10:38:19.917775 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.917611 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xgpbc\"" Aug 02 10:38:19.924428 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:19.924376 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d48f86fdf-wc62b"] Aug 02 10:38:20.024194 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024107 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-secret-metrics-server-client-certs\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.024309 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-secret-metrics-server-tls\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.024309 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024261 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/276fe4c4-b411-4735-bd80-ca4a321b6639-audit-log\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.024309 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/276fe4c4-b411-4735-bd80-ca4a321b6639-metrics-server-audit-profiles\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.024430 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024318 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276fe4c4-b411-4735-bd80-ca4a321b6639-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.024430 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024350 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-client-ca-bundle\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.024430 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.024367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqrl\" (UniqueName: \"kubernetes.io/projected/276fe4c4-b411-4735-bd80-ca4a321b6639-kube-api-access-tzqrl\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125665 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-client-ca-bundle\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125766 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqrl\" (UniqueName: \"kubernetes.io/projected/276fe4c4-b411-4735-bd80-ca4a321b6639-kube-api-access-tzqrl\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125766 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-secret-metrics-server-client-certs\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125766 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-secret-metrics-server-tls\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125919 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/276fe4c4-b411-4735-bd80-ca4a321b6639-audit-log\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125919 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/276fe4c4-b411-4735-bd80-ca4a321b6639-metrics-server-audit-profiles\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.125919 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.125852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276fe4c4-b411-4735-bd80-ca4a321b6639-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.126176 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.126105 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/276fe4c4-b411-4735-bd80-ca4a321b6639-audit-log\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.126638 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.126614 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276fe4c4-b411-4735-bd80-ca4a321b6639-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.126970 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.126948 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/276fe4c4-b411-4735-bd80-ca4a321b6639-metrics-server-audit-profiles\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.127836 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.127813 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-secret-metrics-server-client-certs\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.128170 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.128152 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-client-ca-bundle\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.129035 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.129012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/276fe4c4-b411-4735-bd80-ca4a321b6639-secret-metrics-server-tls\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.136547 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.136527 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqrl\" (UniqueName: \"kubernetes.io/projected/276fe4c4-b411-4735-bd80-ca4a321b6639-kube-api-access-tzqrl\") pod \"metrics-server-6d48f86fdf-wc62b\" (UID: \"276fe4c4-b411-4735-bd80-ca4a321b6639\") " pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.225714 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.225688 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:20.359963 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.359898 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d48f86fdf-wc62b"] Aug 02 10:38:20.362554 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:20.362531 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276fe4c4_b411_4735_bd80_ca4a321b6639.slice/crio-105cfc2479d720da19dc76a8a10af1a4cd16395f8f34d5e72499197e8f755c81 WatchSource:0}: Error finding container 105cfc2479d720da19dc76a8a10af1a4cd16395f8f34d5e72499197e8f755c81: Status 404 returned error can't find the container with id 105cfc2479d720da19dc76a8a10af1a4cd16395f8f34d5e72499197e8f755c81 Aug 02 10:38:20.662178 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.662110 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:38:20.734443 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.734415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" event={"ID":"276fe4c4-b411-4735-bd80-ca4a321b6639","Type":"ContainerStarted","Data":"105cfc2479d720da19dc76a8a10af1a4cd16395f8f34d5e72499197e8f755c81"} Aug 02 10:38:20.737289 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.737267 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4"} Aug 02 10:38:20.737377 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.737321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8"} Aug 02 10:38:20.737377 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.737347 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e"} Aug 02 10:38:20.737377 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.737375 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23"} Aug 02 10:38:20.737488 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:20.737399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6"} Aug 02 10:38:21.728064 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.728032 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:38:21.731743 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.731726 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.734243 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.734207 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 02 10:38:21.736171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.734803 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 02 10:38:21.736171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.735074 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hjnvz\"" Aug 02 10:38:21.736171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.735178 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 02 10:38:21.736171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.735543 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-14ouf91cf3l9n\"" Aug 02 10:38:21.736171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.735815 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 02 10:38:21.736171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.736075 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 02 10:38:21.736769 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.736387 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 02 10:38:21.737614 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.737186 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 02 10:38:21.740635 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.740611 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 02 10:38:21.740940 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.740917 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 02 10:38:21.741031 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.740919 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 02 10:38:21.741142 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.741105 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 02 10:38:21.741199 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.741138 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 02 10:38:21.741319 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.741304 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 02 10:38:21.742893 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.742872 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 02 10:38:21.750630 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.750612 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:38:21.753053 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.753029 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerStarted","Data":"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d"} Aug 02 10:38:21.814455 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.814418 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.622383429 podStartE2EDuration="5.814404895s" totalImagesPullingTime="3.174413204s" totalInitContainerRuntime="17.608262ms" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:21.812386341 +0000 UTC m=+309.594741307" watchObservedRunningTime="2026-08-02 10:38:21.814404895 +0000 UTC m=+309.596759857" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.840915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8564\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-kube-api-access-q8564\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841095 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841371 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.841439 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841511 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-config\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841606 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.842055 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.841657 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942288 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942288 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.942516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-config\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943010 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.942985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943141 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943010 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943141 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943141 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943312 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943312 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943312 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943312 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943507 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8564\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-kube-api-access-q8564\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943507 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943507 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943507 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943507 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943507 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.943857 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.943834 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.944354 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.944168 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.944477 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.944451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.944822 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.944796 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.945578 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.945552 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.946050 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.945684 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.946050 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.945695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.946050 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.945963 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-config\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.946050 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.946042 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.947637 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.947613 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.947723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.947703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.947917 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.947895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.948626 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.948601 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.948963 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.948942 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.949047 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.948971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.949219 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.949197 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.949277 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.949222 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.950328 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.950302 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:21.958346 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:21.958322 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8564\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-kube-api-access-q8564\") pod \"prometheus-k8s-0\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:22.048556 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.048504 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:22.185233 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.185206 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:38:22.188072 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:38:22.188047 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc33e6e_41f2_4408_b6a2_6914032624c7.slice/crio-c6ffb024f1ab46cb12af7ff0396f328ee091944be7ba08df44fa1c13dd4f5996 WatchSource:0}: Error finding container c6ffb024f1ab46cb12af7ff0396f328ee091944be7ba08df44fa1c13dd4f5996: Status 404 returned error can't find the container with id c6ffb024f1ab46cb12af7ff0396f328ee091944be7ba08df44fa1c13dd4f5996 Aug 02 10:38:22.758002 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.757963 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" exitCode=0 Aug 02 10:38:22.758457 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.758046 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} Aug 02 10:38:22.758457 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.758112 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"c6ffb024f1ab46cb12af7ff0396f328ee091944be7ba08df44fa1c13dd4f5996"} Aug 02 10:38:22.759761 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.759712 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" event={"ID":"276fe4c4-b411-4735-bd80-ca4a321b6639","Type":"ContainerStarted","Data":"b60f2192f40915e61eb4f5c01c7b514a76c0f0593c20cbad36dd1ddd5f38f4e0"} Aug 02 10:38:22.809322 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:22.809283 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" podStartSLOduration=2.403435036 podStartE2EDuration="3.8092708s" totalImagesPullingTime="1.405835764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:22.807997505 +0000 UTC m=+310.590352500" watchObservedRunningTime="2026-08-02 10:38:22.8092708 +0000 UTC m=+310.591625762" Aug 02 10:38:24.708009 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:24.707981 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74db5c755f-gtrw8"] Aug 02 10:38:25.778919 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:25.778848 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} Aug 02 10:38:25.779290 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:25.778929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} Aug 02 10:38:27.789577 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:27.789542 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} Aug 02 10:38:27.790066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:27.789621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} Aug 02 10:38:27.790066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:27.789665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} Aug 02 10:38:27.790066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:27.789709 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerStarted","Data":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} Aug 02 10:38:27.821303 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:27.821251 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.408932559 podStartE2EDuration="6.821234305s" totalImagesPullingTime="4.392341258s" totalInitContainerRuntime="19.960488ms" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:27.819473586 +0000 UTC m=+315.601828555" watchObservedRunningTime="2026-08-02 10:38:27.821234305 +0000 UTC m=+315.603589246" Aug 02 10:38:32.049306 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:32.049263 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:38:40.226386 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:40.226354 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:40.226781 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:40.226414 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:38:49.727689 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:49.727642 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" containerName="registry" containerID="cri-o://75a0ad3b908221aaddd17410a5d4551b7820c4eb0e9f1211b2c44507f33ac297" gracePeriod=30 Aug 02 10:38:49.876697 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:49.876664 2554 generic.go:356] "Generic (PLEG): container finished" podID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" containerID="75a0ad3b908221aaddd17410a5d4551b7820c4eb0e9f1211b2c44507f33ac297" exitCode=0 Aug 02 10:38:49.876837 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:49.876746 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" event={"ID":"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9","Type":"ContainerDied","Data":"75a0ad3b908221aaddd17410a5d4551b7820c4eb0e9f1211b2c44507f33ac297"} Aug 02 10:38:49.966322 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:49.966299 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:38:50.073835 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.073783 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-certificates\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.073835 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.073815 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-installation-pull-secrets\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.073982 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.073865 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-trusted-ca\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.074044 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.073981 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4x46\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-kube-api-access-w4x46\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.074044 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074031 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-image-registry-private-configuration\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.074170 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074063 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.074170 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074097 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-bound-sa-token\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.074264 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074169 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-ca-trust-extracted\") pod \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\" (UID: \"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9\") " Aug 02 10:38:50.074264 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074177 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:38:50.074264 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074195 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:38:50.074443 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074427 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-trusted-ca\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.074498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.074448 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-certificates\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.076365 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.076313 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:38:50.076365 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.076322 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-kube-api-access-w4x46" (OuterVolumeSpecName: "kube-api-access-w4x46") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "kube-api-access-w4x46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:38:50.076536 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.076425 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:38:50.076641 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.076622 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:38:50.076690 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.076665 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:38:50.083023 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.082996 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" (UID: "255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:38:50.175005 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.174972 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-ca-trust-extracted\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.175005 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.175002 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-installation-pull-secrets\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.175005 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.175013 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4x46\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-kube-api-access-w4x46\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.175176 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.175023 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-image-registry-private-configuration\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.175176 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.175033 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-registry-tls\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.175176 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.175041 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9-bound-sa-token\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:38:50.882296 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.882271 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" Aug 02 10:38:50.882629 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.882266 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db5c755f-gtrw8" event={"ID":"255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9","Type":"ContainerDied","Data":"a39a7b8a23ee799dbf4e77b0d6b1e259f14f9ab6ab0bce2656dcac9139978141"} Aug 02 10:38:50.882629 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.882405 2554 scope.go:117] "RemoveContainer" containerID="75a0ad3b908221aaddd17410a5d4551b7820c4eb0e9f1211b2c44507f33ac297" Aug 02 10:38:50.899986 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.899961 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74db5c755f-gtrw8"] Aug 02 10:38:50.902988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:50.902963 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74db5c755f-gtrw8"] Aug 02 10:38:52.666631 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:38:52.666589 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" path="/var/lib/kubelet/pods/255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9/volumes" Aug 02 10:39:00.232214 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:00.232184 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:39:00.236201 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:00.236175 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d48f86fdf-wc62b" Aug 02 10:39:01.927543 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:01.927511 2554 generic.go:356] "Generic (PLEG): container finished" podID="e297a6b6-91b5-482d-a721-666326b0876e" containerID="400862450bc0492175def863629e8fba3945838b3ffec771a70b027e9210481f" exitCode=0 Aug 02 10:39:01.927834 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:01.927581 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rtp4t" event={"ID":"e297a6b6-91b5-482d-a721-666326b0876e","Type":"ContainerDied","Data":"400862450bc0492175def863629e8fba3945838b3ffec771a70b027e9210481f"} Aug 02 10:39:01.927907 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:01.927891 2554 scope.go:117] "RemoveContainer" containerID="400862450bc0492175def863629e8fba3945838b3ffec771a70b027e9210481f" Aug 02 10:39:02.932763 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:02.932728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-rtp4t" event={"ID":"e297a6b6-91b5-482d-a721-666326b0876e","Type":"ContainerStarted","Data":"d09ba142d6e998c6277c9bcbdb2917f415dfa9b1647345d36bd166d50f7c1bb0"} Aug 02 10:39:07.954383 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:07.954343 2554 generic.go:356] "Generic (PLEG): container finished" podID="a0828ea2-f7b3-4076-b5c3-e5d54431f046" containerID="68faea9d73fa17b946c5c38ae67a515e13055a65803153365bd45a7f6eaa28d9" exitCode=0 Aug 02 10:39:07.954800 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:07.954415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" event={"ID":"a0828ea2-f7b3-4076-b5c3-e5d54431f046","Type":"ContainerDied","Data":"68faea9d73fa17b946c5c38ae67a515e13055a65803153365bd45a7f6eaa28d9"} Aug 02 10:39:07.954800 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:07.954732 2554 scope.go:117] "RemoveContainer" containerID="68faea9d73fa17b946c5c38ae67a515e13055a65803153365bd45a7f6eaa28d9" Aug 02 10:39:08.961010 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:08.960974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-wj2k5" event={"ID":"a0828ea2-f7b3-4076-b5c3-e5d54431f046","Type":"ContainerStarted","Data":"8d7cc79f4cf633bb4de1cba41128e571518b9a8251e0917a605e6cffa2d8bf27"} Aug 02 10:39:22.049268 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:22.049234 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:22.068341 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:22.068314 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:23.043210 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:23.043176 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:25.548021 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:25.547972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:39:25.550589 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:25.550562 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118f5d77-248c-4b45-a0cd-1e9648441505-metrics-certs\") pod \"network-metrics-daemon-sg228\" (UID: \"118f5d77-248c-4b45-a0cd-1e9648441505\") " pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:39:25.765352 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:25.765318 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dvcgg\"" Aug 02 10:39:25.773572 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:25.773547 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sg228" Aug 02 10:39:25.894601 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:25.894576 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sg228"] Aug 02 10:39:25.896803 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:39:25.896780 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118f5d77_248c_4b45_a0cd_1e9648441505.slice/crio-09ef49abd7a969609209fc7088446ce04062c1a4a17c86a711bba58bbdb7dc8b WatchSource:0}: Error finding container 09ef49abd7a969609209fc7088446ce04062c1a4a17c86a711bba58bbdb7dc8b: Status 404 returned error can't find the container with id 09ef49abd7a969609209fc7088446ce04062c1a4a17c86a711bba58bbdb7dc8b Aug 02 10:39:26.040221 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:26.040183 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sg228" event={"ID":"118f5d77-248c-4b45-a0cd-1e9648441505","Type":"ContainerStarted","Data":"09ef49abd7a969609209fc7088446ce04062c1a4a17c86a711bba58bbdb7dc8b"} Aug 02 10:39:27.046240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:27.046209 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sg228" event={"ID":"118f5d77-248c-4b45-a0cd-1e9648441505","Type":"ContainerStarted","Data":"e089c6ab3022765ae4f496aa4a30da9e4561723b7e0087eadcb8ddb874bcef4e"} Aug 02 10:39:28.052469 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:28.052429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sg228" event={"ID":"118f5d77-248c-4b45-a0cd-1e9648441505","Type":"ContainerStarted","Data":"ba15b105b3374b3ce52dda8554e4a8bdedd79adef2620289d8d5437fb8a0bef0"} Aug 02 10:39:28.070312 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:28.070264 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sg228" podStartSLOduration=374.049830766 podStartE2EDuration="6m15.07024831s" totalImagesPullingTime="1.020417544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:39:28.068259797 +0000 UTC m=+375.850614760" watchObservedRunningTime="2026-08-02 10:39:28.07024831 +0000 UTC m=+375.852603273" Aug 02 10:39:35.811535 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811497 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:39:35.812066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811796 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="alertmanager" containerID="cri-o://5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6" gracePeriod=120 Aug 02 10:39:35.812066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811855 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-metric" containerID="cri-o://3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4" gracePeriod=120 Aug 02 10:39:35.812066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811897 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-web" containerID="cri-o://d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e" gracePeriod=120 Aug 02 10:39:35.812066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811927 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="config-reloader" containerID="cri-o://d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23" gracePeriod=120 Aug 02 10:39:35.812066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811951 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy" containerID="cri-o://f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8" gracePeriod=120 Aug 02 10:39:35.812066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:35.811999 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="prom-label-proxy" containerID="cri-o://3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d" gracePeriod=120 Aug 02 10:39:36.090400 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090340 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d" exitCode=0 Aug 02 10:39:36.090400 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090367 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8" exitCode=0 Aug 02 10:39:36.090400 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090375 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23" exitCode=0 Aug 02 10:39:36.090400 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090381 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6" exitCode=0 Aug 02 10:39:36.090593 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d"} Aug 02 10:39:36.090593 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8"} Aug 02 10:39:36.090593 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090519 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23"} Aug 02 10:39:36.090593 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:36.090543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6"} Aug 02 10:39:37.050199 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.050178 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.097704 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097670 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4" exitCode=0 Aug 02 10:39:37.097704 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097702 2554 generic.go:356] "Generic (PLEG): container finished" podID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerID="d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e" exitCode=0 Aug 02 10:39:37.097856 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097741 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.097856 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4"} Aug 02 10:39:37.097856 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097821 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e"} Aug 02 10:39:37.097966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097865 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"799d1052-ea4a-4396-88c8-ea1c7c05ae8c","Type":"ContainerDied","Data":"2af98374033b26ba17f477a06759ec63ad06762fdd69150284e1d74eac2c2c78"} Aug 02 10:39:37.097966 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.097894 2554 scope.go:117] "RemoveContainer" containerID="3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d" Aug 02 10:39:37.104971 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.104947 2554 scope.go:117] "RemoveContainer" containerID="3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4" Aug 02 10:39:37.113346 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.113330 2554 scope.go:117] "RemoveContainer" containerID="f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8" Aug 02 10:39:37.119631 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.119603 2554 scope.go:117] "RemoveContainer" containerID="d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e" Aug 02 10:39:37.126087 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.126072 2554 scope.go:117] "RemoveContainer" containerID="d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23" Aug 02 10:39:37.131193 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131169 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-main-tls\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131278 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131209 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131278 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131237 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131278 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131257 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-trusted-ca-bundle\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131437 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131291 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-out\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131437 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131332 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-web-config\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131437 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131363 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-metrics-client-ca\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131437 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131386 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131456 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-volume\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131483 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zz4w\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-kube-api-access-9zz4w\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131533 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-main-db\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131559 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-cluster-tls-config\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.131664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.131598 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-tls-assets\") pod \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\" (UID: \"799d1052-ea4a-4396-88c8-ea1c7c05ae8c\") " Aug 02 10:39:37.132626 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.132180 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:37.132626 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.132379 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:39:37.132626 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.132457 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:37.133251 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.133140 2554 scope.go:117] "RemoveContainer" containerID="5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6" Aug 02 10:39:37.134074 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.133994 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.134350 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.134325 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-out" (OuterVolumeSpecName: "config-out") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:39:37.134445 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.134406 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:39:37.134664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.134625 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.135388 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.135360 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.135548 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.135513 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-kube-api-access-9zz4w" (OuterVolumeSpecName: "kube-api-access-9zz4w") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "kube-api-access-9zz4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:39:37.135752 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.135717 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.135889 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.135864 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-volume" (OuterVolumeSpecName: "config-volume") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.139329 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.139273 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.145105 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.145083 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-web-config" (OuterVolumeSpecName: "web-config") pod "799d1052-ea4a-4396-88c8-ea1c7c05ae8c" (UID: "799d1052-ea4a-4396-88c8-ea1c7c05ae8c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:37.147474 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.147458 2554 scope.go:117] "RemoveContainer" containerID="0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db" Aug 02 10:39:37.155991 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.155974 2554 scope.go:117] "RemoveContainer" containerID="3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d" Aug 02 10:39:37.156319 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.156290 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d\": container with ID starting with 3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d not found: ID does not exist" containerID="3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d" Aug 02 10:39:37.156370 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.156328 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d"} err="failed to get container status \"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d\": rpc error: code = NotFound desc = could not find container \"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d\": container with ID starting with 3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d not found: ID does not exist" Aug 02 10:39:37.156370 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.156356 2554 scope.go:117] "RemoveContainer" containerID="3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4" Aug 02 10:39:37.156589 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.156569 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4\": container with ID starting with 3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4 not found: ID does not exist" containerID="3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4" Aug 02 10:39:37.156630 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.156595 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4"} err="failed to get container status \"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4\": rpc error: code = NotFound desc = could not find container \"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4\": container with ID starting with 3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4 not found: ID does not exist" Aug 02 10:39:37.156630 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.156612 2554 scope.go:117] "RemoveContainer" containerID="f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8" Aug 02 10:39:37.156813 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.156796 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8\": container with ID starting with f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8 not found: ID does not exist" containerID="f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8" Aug 02 10:39:37.156844 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.156819 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8"} err="failed to get container status \"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8\": rpc error: code = NotFound desc = could not find container \"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8\": container with ID starting with f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8 not found: ID does not exist" Aug 02 10:39:37.156844 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.156839 2554 scope.go:117] "RemoveContainer" containerID="d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e" Aug 02 10:39:37.157019 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.157002 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e\": container with ID starting with d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e not found: ID does not exist" containerID="d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e" Aug 02 10:39:37.157052 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157023 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e"} err="failed to get container status \"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e\": rpc error: code = NotFound desc = could not find container \"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e\": container with ID starting with d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e not found: ID does not exist" Aug 02 10:39:37.157052 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157034 2554 scope.go:117] "RemoveContainer" containerID="d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23" Aug 02 10:39:37.157279 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.157259 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23\": container with ID starting with d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23 not found: ID does not exist" containerID="d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23" Aug 02 10:39:37.157348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157296 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23"} err="failed to get container status \"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23\": rpc error: code = NotFound desc = could not find container \"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23\": container with ID starting with d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23 not found: ID does not exist" Aug 02 10:39:37.157348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157319 2554 scope.go:117] "RemoveContainer" containerID="5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6" Aug 02 10:39:37.157549 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.157531 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6\": container with ID starting with 5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6 not found: ID does not exist" containerID="5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6" Aug 02 10:39:37.157587 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157553 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6"} err="failed to get container status \"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6\": rpc error: code = NotFound desc = could not find container \"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6\": container with ID starting with 5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6 not found: ID does not exist" Aug 02 10:39:37.157587 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157568 2554 scope.go:117] "RemoveContainer" containerID="0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db" Aug 02 10:39:37.157768 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:37.157753 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db\": container with ID starting with 0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db not found: ID does not exist" containerID="0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db" Aug 02 10:39:37.157819 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157770 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db"} err="failed to get container status \"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db\": rpc error: code = NotFound desc = could not find container \"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db\": container with ID starting with 0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db not found: ID does not exist" Aug 02 10:39:37.157819 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157781 2554 scope.go:117] "RemoveContainer" containerID="3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d" Aug 02 10:39:37.157983 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157965 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d"} err="failed to get container status \"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d\": rpc error: code = NotFound desc = could not find container \"3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d\": container with ID starting with 3f815e3650dedc5ff9a558af350ee38265d970cbc3ed5e6a3bd278483c187f7d not found: ID does not exist" Aug 02 10:39:37.158036 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.157984 2554 scope.go:117] "RemoveContainer" containerID="3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4" Aug 02 10:39:37.158229 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158212 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4"} err="failed to get container status \"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4\": rpc error: code = NotFound desc = could not find container \"3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4\": container with ID starting with 3b827433ec07b40c78b91fd36d6bc0d9699d48d33623495053bbb50ea9d66da4 not found: ID does not exist" Aug 02 10:39:37.158274 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158229 2554 scope.go:117] "RemoveContainer" containerID="f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8" Aug 02 10:39:37.158422 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158405 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8"} err="failed to get container status \"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8\": rpc error: code = NotFound desc = could not find container \"f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8\": container with ID starting with f3ac2dcf4ff71df4b285d5e386c056ef4822bd75b1655f20f0de0238b51a3bb8 not found: ID does not exist" Aug 02 10:39:37.158468 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158424 2554 scope.go:117] "RemoveContainer" containerID="d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e" Aug 02 10:39:37.158644 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158629 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e"} err="failed to get container status \"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e\": rpc error: code = NotFound desc = could not find container \"d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e\": container with ID starting with d6b7ff19d9d29de8f9605f92a6605aa4c2b9f8f0f541e2036cb6f933b0cde74e not found: ID does not exist" Aug 02 10:39:37.158681 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158644 2554 scope.go:117] "RemoveContainer" containerID="d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23" Aug 02 10:39:37.158814 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158799 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23"} err="failed to get container status \"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23\": rpc error: code = NotFound desc = could not find container \"d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23\": container with ID starting with d592a9d4e45989cce39e3075d2d90eeb48e8f28d71e598f9e30487b086111a23 not found: ID does not exist" Aug 02 10:39:37.158859 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158816 2554 scope.go:117] "RemoveContainer" containerID="5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6" Aug 02 10:39:37.158977 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158963 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6"} err="failed to get container status \"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6\": rpc error: code = NotFound desc = could not find container \"5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6\": container with ID starting with 5024bfb006bf33339a163aa8e5f401912cc32ddbace78a6c4dd5c49e0f876fd6 not found: ID does not exist" Aug 02 10:39:37.159022 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.158978 2554 scope.go:117] "RemoveContainer" containerID="0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db" Aug 02 10:39:37.159177 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.159159 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db"} err="failed to get container status \"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db\": rpc error: code = NotFound desc = could not find container \"0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db\": container with ID starting with 0fe51107d3eda36254bb392d3974476f03ad961ef9f8ea0bca8d4c7649acf1db not found: ID does not exist" Aug 02 10:39:37.232383 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232362 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232383 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232381 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232393 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-out\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232401 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-web-config\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232409 2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-metrics-client-ca\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232419 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232427 2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232435 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zz4w\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-kube-api-access-9zz4w\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232442 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-alertmanager-main-db\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232450 2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-cluster-tls-config\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232457 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-tls-assets\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232465 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.232498 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.232472 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/799d1052-ea4a-4396-88c8-ea1c7c05ae8c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:37.423521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.423496 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:39:37.428337 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.428318 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:39:37.457348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457302 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:39:37.457571 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457557 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy" Aug 02 10:39:37.457571 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457571 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457580 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="prom-label-proxy" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457585 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="prom-label-proxy" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457600 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="alertmanager" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457604 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="alertmanager" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457610 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-web" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457615 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-web" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457621 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="init-config-reloader" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457626 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="init-config-reloader" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457633 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-metric" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457637 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-metric" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457644 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" containerName="registry" Aug 02 10:39:37.457643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457649 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" containerName="registry" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457654 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="config-reloader" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457659 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="config-reloader" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457697 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="255ac2e9-f349-42c3-acc9-bb7c1c7ad5e9" containerName="registry" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457705 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457710 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="prom-label-proxy" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457716 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-metric" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457723 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="kube-rbac-proxy-web" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457729 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="alertmanager" Aug 02 10:39:37.457987 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.457735 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" containerName="config-reloader" Aug 02 10:39:37.462378 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.462364 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.464962 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.464976 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.464969 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.465006 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.465009 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.465070 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 02 10:39:37.465108 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.465097 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 02 10:39:37.465479 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.465373 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 02 10:39:37.465559 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.465541 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pt498\"" Aug 02 10:39:37.469279 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.469259 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 02 10:39:37.478878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.478859 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:39:37.535217 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535311 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535311 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535237 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-web-config\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535311 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535327 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl9d9\" (UniqueName: \"kubernetes.io/projected/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-kube-api-access-pl9d9\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535393 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-config-volume\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-config-out\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.535521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.535516 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636537 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-config-out\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636617 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636617 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636617 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636722 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636722 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636722 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-web-config\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636722 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636901 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl9d9\" (UniqueName: \"kubernetes.io/projected/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-kube-api-access-pl9d9\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636901 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636787 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636901 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636901 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.636901 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.636878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-config-volume\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.637508 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.637485 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.638300 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.638274 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639369 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-config-out\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639615 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-config-volume\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639638 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639835 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639846 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-web-config\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.639878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.639851 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.640711 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.640694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.641363 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.641337 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.645839 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.645823 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl9d9\" (UniqueName: \"kubernetes.io/projected/b23b4a80-af6a-4b98-9532-0fa5adc89ba2-kube-api-access-pl9d9\") pod \"alertmanager-main-0\" (UID: \"b23b4a80-af6a-4b98-9532-0fa5adc89ba2\") " pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.770935 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.770910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 02 10:39:37.904510 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:37.904490 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 02 10:39:37.906822 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:39:37.906797 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23b4a80_af6a_4b98_9532_0fa5adc89ba2.slice/crio-e1ed079af1fc58d2eafa75033121518a296b07d4e6af2900321c32d8d27370b4 WatchSource:0}: Error finding container e1ed079af1fc58d2eafa75033121518a296b07d4e6af2900321c32d8d27370b4: Status 404 returned error can't find the container with id e1ed079af1fc58d2eafa75033121518a296b07d4e6af2900321c32d8d27370b4 Aug 02 10:39:38.103497 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:38.103441 2554 generic.go:356] "Generic (PLEG): container finished" podID="b23b4a80-af6a-4b98-9532-0fa5adc89ba2" containerID="377369b06c763118133bb863ef3539925628d59f5c3d8f5a22574e63a4c0ea37" exitCode=0 Aug 02 10:39:38.103766 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:38.103528 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerDied","Data":"377369b06c763118133bb863ef3539925628d59f5c3d8f5a22574e63a4c0ea37"} Aug 02 10:39:38.103766 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:38.103603 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"e1ed079af1fc58d2eafa75033121518a296b07d4e6af2900321c32d8d27370b4"} Aug 02 10:39:38.667300 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:38.667224 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="799d1052-ea4a-4396-88c8-ea1c7c05ae8c" path="/var/lib/kubelet/pods/799d1052-ea4a-4396-88c8-ea1c7c05ae8c/volumes" Aug 02 10:39:39.111672 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.111638 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"5c38dbc9f0545424e4534bbd59049bcd300ec19d5735c9ee0e95ebb758f5651b"} Aug 02 10:39:39.112046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.111698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"273907dcea595d415f95274db1a3328cbb446ccf603855fa1c70c6cb39292454"} Aug 02 10:39:39.112046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.111724 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"627e0a9bbf4d1591e26c8deae4fcefa4a3d65832891fc327c0183dcb2dd1a2d5"} Aug 02 10:39:39.112046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.111748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"1f37a80d9208b566df5073edc958bbba8ce0db234ce0d3e974c636b13930bad1"} Aug 02 10:39:39.112046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.111773 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"19be499e53cf3d5364d4a6c4d83c3a59f955642db8271b47e08004252dc04da9"} Aug 02 10:39:39.112046 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.111795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b23b4a80-af6a-4b98-9532-0fa5adc89ba2","Type":"ContainerStarted","Data":"8d1f781c308aa3c3ed7bcf3f23e9cff0add4b8838b1f8208c10189535de76ba0"} Aug 02 10:39:39.138728 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:39.138673 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.12325363 podStartE2EDuration="2.138656417s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.402787ms" isStatefulPod=false podCreationTimestamp="2026-08-02 10:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:39:39.136634814 +0000 UTC m=+386.918989777" watchObservedRunningTime="2026-08-02 10:39:39.138656417 +0000 UTC m=+386.921011380" Aug 02 10:39:40.171396 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171367 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:39:40.171771 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171608 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="prometheus" containerID="cri-o://d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" gracePeriod=600 Aug 02 10:39:40.171771 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171631 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy" containerID="cri-o://e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" gracePeriod=600 Aug 02 10:39:40.171771 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171656 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" gracePeriod=600 Aug 02 10:39:40.171771 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171691 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-web" containerID="cri-o://2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" gracePeriod=600 Aug 02 10:39:40.171771 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171693 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="config-reloader" containerID="cri-o://bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" gracePeriod=600 Aug 02 10:39:40.171771 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.171658 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="thanos-sidecar" containerID="cri-o://941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" gracePeriod=600 Aug 02 10:39:40.404036 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.404014 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:40.458996 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.458968 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459156 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459016 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-config-out\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459156 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459051 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-trusted-ca-bundle\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459156 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459080 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-1\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459156 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459104 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-web-config\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459376 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459333 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-serving-certs-ca-bundle\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459431 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459383 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8564\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-kube-api-access-q8564\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459485 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459447 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459569 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-grpc-tls\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459682 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-0\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459703 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459715 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-db\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459759 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-metrics-client-certs\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459792 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-tls-assets\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.459932 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459822 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459849 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-kube-rbac-proxy\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460142 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-config\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460174 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-2\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460201 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-kubelet-serving-ca-bundle\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460232 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-metrics-client-ca\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460264 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-thanos-prometheus-http-client-file\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460348 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460297 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-tls\") pod \"3fc33e6e-41f2-4408-b6a2-6914032624c7\" (UID: \"3fc33e6e-41f2-4408-b6a2-6914032624c7\") " Aug 02 10:39:40.460689 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460552 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.460689 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.460570 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.461709 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.459755 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.461824 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.461433 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.462051 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.462028 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:39:40.462811 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.462571 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-config-out" (OuterVolumeSpecName: "config-out") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 10:39:40.462811 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.462572 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.462811 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.462643 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.463018 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.462867 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.463286 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.463252 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 10:39:40.463639 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.463602 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.463639 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.463629 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-kube-api-access-q8564" (OuterVolumeSpecName: "kube-api-access-q8564") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "kube-api-access-q8564". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:39:40.463897 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.463865 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.464616 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.464449 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.464908 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.464884 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.465451 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.465406 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.465555 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.465517 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.465555 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.465527 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-config" (OuterVolumeSpecName: "config") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.466171 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.466147 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 10:39:40.472961 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.472937 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-web-config" (OuterVolumeSpecName: "web-config") pod "3fc33e6e-41f2-4408-b6a2-6914032624c7" (UID: "3fc33e6e-41f2-4408-b6a2-6914032624c7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 10:39:40.561203 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561184 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-db\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561203 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561202 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-metrics-client-certs\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561211 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-tls-assets\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561221 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561230 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-kube-rbac-proxy\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561238 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-config\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561246 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561256 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561264 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-metrics-client-ca\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561273 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561283 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561291 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561299 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fc33e6e-41f2-4408-b6a2-6914032624c7-config-out\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561307 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-web-config\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561314 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561692 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561322 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8564\" (UniqueName: \"kubernetes.io/projected/3fc33e6e-41f2-4408-b6a2-6914032624c7-kube-api-access-q8564\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561692 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561330 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3fc33e6e-41f2-4408-b6a2-6914032624c7-secret-grpc-tls\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:40.561692 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:40.561346 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3fc33e6e-41f2-4408-b6a2-6914032624c7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 10:39:41.124624 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124586 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" exitCode=0 Aug 02 10:39:41.124624 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124618 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" exitCode=0 Aug 02 10:39:41.124624 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124625 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" exitCode=0 Aug 02 10:39:41.124624 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124631 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" exitCode=0 Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124637 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" exitCode=0 Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124643 2554 generic.go:356] "Generic (PLEG): container finished" podID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" exitCode=0 Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124679 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124680 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124789 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124818 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} Aug 02 10:39:41.124840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124843 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} Aug 02 10:39:41.125112 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124859 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.125112 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} Aug 02 10:39:41.125112 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} Aug 02 10:39:41.125112 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.124929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3fc33e6e-41f2-4408-b6a2-6914032624c7","Type":"ContainerDied","Data":"c6ffb024f1ab46cb12af7ff0396f328ee091944be7ba08df44fa1c13dd4f5996"} Aug 02 10:39:41.133726 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.133693 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.141347 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.141327 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.147149 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.147097 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:39:41.148972 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.148937 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.155394 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.155370 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:39:41.156534 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.156515 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.163371 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.163352 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.170416 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.170400 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.179218 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.179012 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.179627 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.179598 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.179685 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.179626 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} err="failed to get container status \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" Aug 02 10:39:41.179685 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.179646 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.179933 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.179915 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.179986 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.179937 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} err="failed to get container status \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" Aug 02 10:39:41.179986 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.179954 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.180246 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.180223 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.180340 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.180248 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} err="failed to get container status \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" Aug 02 10:39:41.180340 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.180264 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.180568 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.180543 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.180690 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.180569 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} err="failed to get container status \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" Aug 02 10:39:41.180690 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.180585 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.180947 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.180925 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.181137 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.181091 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} err="failed to get container status \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" Aug 02 10:39:41.181253 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.181236 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.181525 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.181505 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.181590 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.181535 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} err="failed to get container status \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" Aug 02 10:39:41.181590 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.181554 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.181863 ip-10-0-141-208 kubenswrapper[2554]: E0802 10:39:41.181841 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.181974 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.181865 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} err="failed to get container status \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" Aug 02 10:39:41.181974 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.181878 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.182164 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182144 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} err="failed to get container status \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" Aug 02 10:39:41.182217 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182166 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.182418 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182399 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} err="failed to get container status \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" Aug 02 10:39:41.182484 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182420 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.182649 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182632 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} err="failed to get container status \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" Aug 02 10:39:41.182649 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182649 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.182869 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182848 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} err="failed to get container status \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" Aug 02 10:39:41.182916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.182869 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.183088 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183073 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} err="failed to get container status \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" Aug 02 10:39:41.183209 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183089 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.183367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183349 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} err="failed to get container status \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" Aug 02 10:39:41.183417 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183369 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.183417 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183405 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:39:41.183605 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183583 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} err="failed to get container status \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" Aug 02 10:39:41.183653 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183606 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.183826 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183804 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="init-config-reloader" Aug 02 10:39:41.183896 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183832 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="init-config-reloader" Aug 02 10:39:41.183896 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183839 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} err="failed to get container status \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" Aug 02 10:39:41.183896 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183869 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183852 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183939 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183954 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="thanos-sidecar" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183962 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="thanos-sidecar" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183977 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="prometheus" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183985 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="prometheus" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.183996 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="config-reloader" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184004 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="config-reloader" Aug 02 10:39:41.184017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184015 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-web" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184023 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-web" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184034 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-thanos" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184043 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-thanos" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184139 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="prometheus" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184149 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-web" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184157 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="thanos-sidecar" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184163 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184169 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="kube-rbac-proxy-thanos" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184175 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" containerName="config-reloader" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184138 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} err="failed to get container status \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" Aug 02 10:39:41.184362 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184232 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.184762 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184472 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} err="failed to get container status \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" Aug 02 10:39:41.184762 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184501 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.184836 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184791 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} err="failed to get container status \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" Aug 02 10:39:41.184836 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.184815 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.185111 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185089 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} err="failed to get container status \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" Aug 02 10:39:41.185219 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185112 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.185414 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185390 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} err="failed to get container status \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" Aug 02 10:39:41.185414 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185410 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.185688 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185663 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} err="failed to get container status \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" Aug 02 10:39:41.185733 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185691 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.185927 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185909 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} err="failed to get container status \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" Aug 02 10:39:41.185967 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.185928 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.186152 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186108 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} err="failed to get container status \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" Aug 02 10:39:41.186214 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186153 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.186615 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186427 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} err="failed to get container status \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" Aug 02 10:39:41.186615 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186444 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.186748 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186656 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} err="failed to get container status \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" Aug 02 10:39:41.186748 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186682 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.187028 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186942 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} err="failed to get container status \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" Aug 02 10:39:41.187028 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.186961 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.187284 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187185 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} err="failed to get container status \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" Aug 02 10:39:41.187284 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187206 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.187499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187385 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} err="failed to get container status \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" Aug 02 10:39:41.187499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187410 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.187738 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187642 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} err="failed to get container status \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" Aug 02 10:39:41.187738 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187659 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.187941 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187855 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} err="failed to get container status \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" Aug 02 10:39:41.187941 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.187870 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.188203 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188078 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} err="failed to get container status \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" Aug 02 10:39:41.188203 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188095 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.188379 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188354 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} err="failed to get container status \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" Aug 02 10:39:41.188436 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188380 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.188664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188638 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} err="failed to get container status \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" Aug 02 10:39:41.188749 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188666 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.188970 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188937 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} err="failed to get container status \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" Aug 02 10:39:41.189061 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.188971 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.189292 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189254 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} err="failed to get container status \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" Aug 02 10:39:41.189292 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189284 2554 scope.go:117] "RemoveContainer" containerID="2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33" Aug 02 10:39:41.189618 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189581 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33"} err="failed to get container status \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": rpc error: code = NotFound desc = could not find container \"2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33\": container with ID starting with 2e3d466f80f54ab3debc92b172983d19d212178dd0058f2be3fc3463fcfada33 not found: ID does not exist" Aug 02 10:39:41.189713 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189619 2554 scope.go:117] "RemoveContainer" containerID="e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d" Aug 02 10:39:41.189836 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.189954 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189930 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d"} err="failed to get container status \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": rpc error: code = NotFound desc = could not find container \"e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d\": container with ID starting with e32ba3fb2993de9fcd96547809b9f2854a915afee545c11069da5fd12f26090d not found: ID does not exist" Aug 02 10:39:41.190028 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.189956 2554 scope.go:117] "RemoveContainer" containerID="2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee" Aug 02 10:39:41.190661 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.190629 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee"} err="failed to get container status \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": rpc error: code = NotFound desc = could not find container \"2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee\": container with ID starting with 2e823d48f87d19b9fe90f0b3991b38d36281b64f57169eebb540bc44b949f8ee not found: ID does not exist" Aug 02 10:39:41.190661 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.190655 2554 scope.go:117] "RemoveContainer" containerID="941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6" Aug 02 10:39:41.190992 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.190969 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6"} err="failed to get container status \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": rpc error: code = NotFound desc = could not find container \"941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6\": container with ID starting with 941a6ec4ed22244851721a2f6d155fe3a08c6860f5f91b4c315e93de4f9c4bf6 not found: ID does not exist" Aug 02 10:39:41.191064 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.190995 2554 scope.go:117] "RemoveContainer" containerID="bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06" Aug 02 10:39:41.191359 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.191335 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06"} err="failed to get container status \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": rpc error: code = NotFound desc = could not find container \"bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06\": container with ID starting with bfd03f8b2bd9a02eb3ccacd5eafab7ae52c78de48722b5cb551d846d4c005f06 not found: ID does not exist" Aug 02 10:39:41.191428 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.191360 2554 scope.go:117] "RemoveContainer" containerID="d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470" Aug 02 10:39:41.191667 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.191643 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470"} err="failed to get container status \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": rpc error: code = NotFound desc = could not find container \"d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470\": container with ID starting with d91207463f1923aa704f73647630c146f2d0c62a21fda0c44d9bb8388eb8f470 not found: ID does not exist" Aug 02 10:39:41.191732 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.191671 2554 scope.go:117] "RemoveContainer" containerID="bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8" Aug 02 10:39:41.191961 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.191938 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8"} err="failed to get container status \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": rpc error: code = NotFound desc = could not find container \"bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8\": container with ID starting with bdb875e23d62af548297e1adf467a738dab3c312129223e3bc1804c12664f8a8 not found: ID does not exist" Aug 02 10:39:41.192517 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.192496 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 02 10:39:41.192517 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.192505 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 02 10:39:41.192787 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.192576 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 02 10:39:41.192787 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.192631 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-14ouf91cf3l9n\"" Aug 02 10:39:41.192884 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.192817 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 02 10:39:41.192884 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.192835 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 02 10:39:41.193195 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.193175 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hjnvz\"" Aug 02 10:39:41.193274 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.193234 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 02 10:39:41.193327 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.193232 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 02 10:39:41.193411 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.193385 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 02 10:39:41.193648 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.193632 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 02 10:39:41.194027 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.193996 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 02 10:39:41.194137 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.194061 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 02 10:39:41.194787 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.194769 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 02 10:39:41.196028 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.196008 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 02 10:39:41.197546 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.197528 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 02 10:39:41.208795 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.208774 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:39:41.266297 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266379 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266379 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266327 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d7decf5-2658-4795-a039-c193c98e737c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266379 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5jr2\" (UniqueName: \"kubernetes.io/projected/4d7decf5-2658-4795-a039-c193c98e737c-kube-api-access-v5jr2\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266543 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266445 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d7decf5-2658-4795-a039-c193c98e737c-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266543 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266543 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266508 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266543 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266587 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-config\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266846 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.266916 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.266872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367187 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367303 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367303 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367303 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367303 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367331 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-config\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367499 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367482 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d7decf5-2658-4795-a039-c193c98e737c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jr2\" (UniqueName: \"kubernetes.io/projected/4d7decf5-2658-4795-a039-c193c98e737c-kube-api-access-v5jr2\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d7decf5-2658-4795-a039-c193c98e737c-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.367770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.367743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.368478 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.368418 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.368587 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.368494 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.368976 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.368762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.369169 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.369145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.370014 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.369712 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.370455 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.370429 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.370668 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.370647 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.370747 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.370679 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-config\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.371278 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.371240 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d7decf5-2658-4795-a039-c193c98e737c-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.371803 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.371688 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d7decf5-2658-4795-a039-c193c98e737c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.372147 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.372084 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.372224 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.372207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d7decf5-2658-4795-a039-c193c98e737c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.372483 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.372458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.372926 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.372899 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.372995 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.372933 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.372995 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.372977 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.373228 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.373208 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.373547 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.373531 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d7decf5-2658-4795-a039-c193c98e737c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.377240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.377200 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jr2\" (UniqueName: \"kubernetes.io/projected/4d7decf5-2658-4795-a039-c193c98e737c-kube-api-access-v5jr2\") pod \"prometheus-k8s-0\" (UID: \"4d7decf5-2658-4795-a039-c193c98e737c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.506172 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.506149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:39:41.642655 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:41.642584 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 02 10:39:41.645767 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:39:41.645743 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7decf5_2658_4795_a039_c193c98e737c.slice/crio-d42a17149c2ad8cab9842ce397874e4ebe564c0fafe91f6ea0464aa06f2d2d5a WatchSource:0}: Error finding container d42a17149c2ad8cab9842ce397874e4ebe564c0fafe91f6ea0464aa06f2d2d5a: Status 404 returned error can't find the container with id d42a17149c2ad8cab9842ce397874e4ebe564c0fafe91f6ea0464aa06f2d2d5a Aug 02 10:39:42.132328 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:42.132283 2554 generic.go:356] "Generic (PLEG): container finished" podID="4d7decf5-2658-4795-a039-c193c98e737c" containerID="cb294227c4bf0916eb046774b17d7e90345b6f5d36731247a87c0bc8469a0acb" exitCode=0 Aug 02 10:39:42.132478 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:42.132363 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerDied","Data":"cb294227c4bf0916eb046774b17d7e90345b6f5d36731247a87c0bc8469a0acb"} Aug 02 10:39:42.132478 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:42.132441 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"d42a17149c2ad8cab9842ce397874e4ebe564c0fafe91f6ea0464aa06f2d2d5a"} Aug 02 10:39:42.672228 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:42.672156 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc33e6e-41f2-4408-b6a2-6914032624c7" path="/var/lib/kubelet/pods/3fc33e6e-41f2-4408-b6a2-6914032624c7/volumes" Aug 02 10:39:43.140953 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.140917 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"f7a27bcf1c838c70477a0a87878ef36c287667fc79c985dc7e5570bcd0fc2910"} Aug 02 10:39:43.141167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.140985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"7b8436d92012777071fa6bd8a56bf2089598f3677bedff07b6aeb75708357eb9"} Aug 02 10:39:43.141167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.141013 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"682fd950ac3827972c67072ec90475a2957967721bc9c218518a8acd8450028d"} Aug 02 10:39:43.141167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.141045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"5169a7a0eb336b10ba1db0a00c1f5c3911dd3d2189a8924c68988e43dc5a59bf"} Aug 02 10:39:43.141167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.141069 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"d98920ca64f2ed2af2948f369132379b49ed56ac0dff153896964602990ae781"} Aug 02 10:39:43.141167 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.141095 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d7decf5-2658-4795-a039-c193c98e737c","Type":"ContainerStarted","Data":"0c4911686c46588f3e12f3f2db336e0a74bc7820a8fb9c17d34f9efea8129e33"} Aug 02 10:39:43.176319 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:43.176267 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.154496756 podStartE2EDuration="2.176249161s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.752405ms" isStatefulPod=false podCreationTimestamp="2026-08-02 10:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:39:43.173605963 +0000 UTC m=+390.955960970" watchObservedRunningTime="2026-08-02 10:39:43.176249161 +0000 UTC m=+390.958604123" Aug 02 10:39:46.506645 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:39:46.506594 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:40:41.507331 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:40:41.507242 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:40:41.522549 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:40:41.522517 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:40:42.396185 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:40:42.396156 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 02 10:42:33.106442 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.104171 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8rw82"] Aug 02 10:42:33.108349 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.108323 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.112318 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.112295 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 02 10:42:33.113355 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.113332 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5pg78\"" Aug 02 10:42:33.113477 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.113360 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 02 10:42:33.117760 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.117730 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8rw82"] Aug 02 10:42:33.170062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.170029 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvsfr\" (UniqueName: \"kubernetes.io/projected/f752b2f3-3c32-466e-b8b2-113a7b497fb2-kube-api-access-fvsfr\") pod \"cert-manager-cainjector-559cdd8c87-8rw82\" (UID: \"f752b2f3-3c32-466e-b8b2-113a7b497fb2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.170244 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.170076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f752b2f3-3c32-466e-b8b2-113a7b497fb2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8rw82\" (UID: \"f752b2f3-3c32-466e-b8b2-113a7b497fb2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.271017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.270975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvsfr\" (UniqueName: \"kubernetes.io/projected/f752b2f3-3c32-466e-b8b2-113a7b497fb2-kube-api-access-fvsfr\") pod \"cert-manager-cainjector-559cdd8c87-8rw82\" (UID: \"f752b2f3-3c32-466e-b8b2-113a7b497fb2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.271017 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.271021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f752b2f3-3c32-466e-b8b2-113a7b497fb2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8rw82\" (UID: \"f752b2f3-3c32-466e-b8b2-113a7b497fb2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.280181 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.280153 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f752b2f3-3c32-466e-b8b2-113a7b497fb2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8rw82\" (UID: \"f752b2f3-3c32-466e-b8b2-113a7b497fb2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.280300 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.280207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvsfr\" (UniqueName: \"kubernetes.io/projected/f752b2f3-3c32-466e-b8b2-113a7b497fb2-kube-api-access-fvsfr\") pod \"cert-manager-cainjector-559cdd8c87-8rw82\" (UID: \"f752b2f3-3c32-466e-b8b2-113a7b497fb2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.429192 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.429097 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" Aug 02 10:42:33.555617 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.555585 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8rw82"] Aug 02 10:42:33.560512 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:42:33.560472 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf752b2f3_3c32_466e_b8b2_113a7b497fb2.slice/crio-304ec38d54fe73b213d34a9b15ec99804196292b1d3441a6c5782730bccb70d2 WatchSource:0}: Error finding container 304ec38d54fe73b213d34a9b15ec99804196292b1d3441a6c5782730bccb70d2: Status 404 returned error can't find the container with id 304ec38d54fe73b213d34a9b15ec99804196292b1d3441a6c5782730bccb70d2 Aug 02 10:42:33.806315 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:33.806281 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" event={"ID":"f752b2f3-3c32-466e-b8b2-113a7b497fb2","Type":"ContainerStarted","Data":"304ec38d54fe73b213d34a9b15ec99804196292b1d3441a6c5782730bccb70d2"} Aug 02 10:42:36.821080 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:36.820978 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" event={"ID":"f752b2f3-3c32-466e-b8b2-113a7b497fb2","Type":"ContainerStarted","Data":"5eb47e4064aeb5c2bb6a07a4e10a3a521df96eb01ac4dac76750d0d27606a1d4"} Aug 02 10:42:36.843301 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:36.843252 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8rw82" podStartSLOduration=0.892737209 podStartE2EDuration="3.843236089s" totalImagesPullingTime="2.95049888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:42:36.842177056 +0000 UTC m=+564.624532020" watchObservedRunningTime="2026-08-02 10:42:36.843236089 +0000 UTC m=+564.625591050" Aug 02 10:42:43.093677 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.093643 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4"] Aug 02 10:42:43.096798 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.096782 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.099691 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.099670 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Aug 02 10:42:43.099798 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.099728 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Aug 02 10:42:43.100840 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.100825 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g7dqs\"" Aug 02 10:42:43.108239 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.108217 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4"] Aug 02 10:42:43.157810 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.157790 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzdlb\" (UniqueName: \"kubernetes.io/projected/e36f09c8-4f28-41d4-84d0-1dc69b09e387-kube-api-access-gzdlb\") pod \"openshift-lws-operator-fd8ccff4c-24hc4\" (UID: \"e36f09c8-4f28-41d4-84d0-1dc69b09e387\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.157913 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.157824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e36f09c8-4f28-41d4-84d0-1dc69b09e387-tmp\") pod \"openshift-lws-operator-fd8ccff4c-24hc4\" (UID: \"e36f09c8-4f28-41d4-84d0-1dc69b09e387\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.258613 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.258590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzdlb\" (UniqueName: \"kubernetes.io/projected/e36f09c8-4f28-41d4-84d0-1dc69b09e387-kube-api-access-gzdlb\") pod \"openshift-lws-operator-fd8ccff4c-24hc4\" (UID: \"e36f09c8-4f28-41d4-84d0-1dc69b09e387\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.258701 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.258621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e36f09c8-4f28-41d4-84d0-1dc69b09e387-tmp\") pod \"openshift-lws-operator-fd8ccff4c-24hc4\" (UID: \"e36f09c8-4f28-41d4-84d0-1dc69b09e387\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.259026 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.259007 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e36f09c8-4f28-41d4-84d0-1dc69b09e387-tmp\") pod \"openshift-lws-operator-fd8ccff4c-24hc4\" (UID: \"e36f09c8-4f28-41d4-84d0-1dc69b09e387\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.268238 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.268216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzdlb\" (UniqueName: \"kubernetes.io/projected/e36f09c8-4f28-41d4-84d0-1dc69b09e387-kube-api-access-gzdlb\") pod \"openshift-lws-operator-fd8ccff4c-24hc4\" (UID: \"e36f09c8-4f28-41d4-84d0-1dc69b09e387\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.405018 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.404964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" Aug 02 10:42:43.534327 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.534306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4"] Aug 02 10:42:43.536669 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:42:43.536636 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode36f09c8_4f28_41d4_84d0_1dc69b09e387.slice/crio-4a572eefbdee83cc5120d5a1c83d9a638b6f2baafb454da944886e3a309228a5 WatchSource:0}: Error finding container 4a572eefbdee83cc5120d5a1c83d9a638b6f2baafb454da944886e3a309228a5: Status 404 returned error can't find the container with id 4a572eefbdee83cc5120d5a1c83d9a638b6f2baafb454da944886e3a309228a5 Aug 02 10:42:43.850306 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:43.850271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" event={"ID":"e36f09c8-4f28-41d4-84d0-1dc69b09e387","Type":"ContainerStarted","Data":"4a572eefbdee83cc5120d5a1c83d9a638b6f2baafb454da944886e3a309228a5"} Aug 02 10:42:46.866407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:46.866373 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" event={"ID":"e36f09c8-4f28-41d4-84d0-1dc69b09e387","Type":"ContainerStarted","Data":"26620f3593b99abfdc2c1b39255c4c3aeee31d81753473761f7c56921e6a4b0e"} Aug 02 10:42:46.883421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:42:46.883370 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-24hc4" podStartSLOduration=1.406502083 podStartE2EDuration="3.883354776s" totalImagesPullingTime="2.476852693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:42:46.88274577 +0000 UTC m=+574.665100733" watchObservedRunningTime="2026-08-02 10:42:46.883354776 +0000 UTC m=+574.665709741" Aug 02 10:43:02.581275 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.581247 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg"] Aug 02 10:43:02.584976 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.584958 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.587776 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.587738 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 02 10:43:02.587776 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.587772 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-64kwn\"" Aug 02 10:43:02.587931 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.587745 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 02 10:43:02.587931 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.587840 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 02 10:43:02.587931 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.587852 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 02 10:43:02.602289 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.602264 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg"] Aug 02 10:43:02.711735 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.711702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/801a4879-c943-4c0c-a9f1-cea2f0a3908b-manifests\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.711883 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.711739 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/801a4879-c943-4c0c-a9f1-cea2f0a3908b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.711883 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.711760 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/801a4879-c943-4c0c-a9f1-cea2f0a3908b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.711883 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.711812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt72q\" (UniqueName: \"kubernetes.io/projected/801a4879-c943-4c0c-a9f1-cea2f0a3908b-kube-api-access-kt72q\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.711883 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.711837 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/801a4879-c943-4c0c-a9f1-cea2f0a3908b-tmp\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.812239 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.812213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/801a4879-c943-4c0c-a9f1-cea2f0a3908b-manifests\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.812239 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.812240 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/801a4879-c943-4c0c-a9f1-cea2f0a3908b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.812477 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.812260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/801a4879-c943-4c0c-a9f1-cea2f0a3908b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.812477 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.812286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt72q\" (UniqueName: \"kubernetes.io/projected/801a4879-c943-4c0c-a9f1-cea2f0a3908b-kube-api-access-kt72q\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.812477 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.812307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/801a4879-c943-4c0c-a9f1-cea2f0a3908b-tmp\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.812725 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.812701 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/801a4879-c943-4c0c-a9f1-cea2f0a3908b-manifests\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.814496 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.814473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/801a4879-c943-4c0c-a9f1-cea2f0a3908b-tmp\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.814628 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.814536 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/801a4879-c943-4c0c-a9f1-cea2f0a3908b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.814628 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.814603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/801a4879-c943-4c0c-a9f1-cea2f0a3908b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.822338 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.822316 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt72q\" (UniqueName: \"kubernetes.io/projected/801a4879-c943-4c0c-a9f1-cea2f0a3908b-kube-api-access-kt72q\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-mdflg\" (UID: \"801a4879-c943-4c0c-a9f1-cea2f0a3908b\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:02.895223 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:02.895166 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:03.033680 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:03.032037 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg"] Aug 02 10:43:03.039801 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:43:03.039772 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801a4879_c943_4c0c_a9f1_cea2f0a3908b.slice/crio-6827e120ae7cde8bb539329ec8c2e0cf7d60a78449571fd352cc58bd6d1a9490 WatchSource:0}: Error finding container 6827e120ae7cde8bb539329ec8c2e0cf7d60a78449571fd352cc58bd6d1a9490: Status 404 returned error can't find the container with id 6827e120ae7cde8bb539329ec8c2e0cf7d60a78449571fd352cc58bd6d1a9490 Aug 02 10:43:03.938402 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:03.938330 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" event={"ID":"801a4879-c943-4c0c-a9f1-cea2f0a3908b","Type":"ContainerStarted","Data":"6827e120ae7cde8bb539329ec8c2e0cf7d60a78449571fd352cc58bd6d1a9490"} Aug 02 10:43:05.948240 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:05.948205 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" event={"ID":"801a4879-c943-4c0c-a9f1-cea2f0a3908b","Type":"ContainerStarted","Data":"697254bf0a15eb4b67a9bceb62adeba869e352e50442583577fe77d92f59e2ed"} Aug 02 10:43:06.954367 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:06.954334 2554 generic.go:356] "Generic (PLEG): container finished" podID="801a4879-c943-4c0c-a9f1-cea2f0a3908b" containerID="697254bf0a15eb4b67a9bceb62adeba869e352e50442583577fe77d92f59e2ed" exitCode=0 Aug 02 10:43:06.954670 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:06.954393 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" event={"ID":"801a4879-c943-4c0c-a9f1-cea2f0a3908b","Type":"ContainerDied","Data":"697254bf0a15eb4b67a9bceb62adeba869e352e50442583577fe77d92f59e2ed"} Aug 02 10:43:07.960030 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:07.959994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" event={"ID":"801a4879-c943-4c0c-a9f1-cea2f0a3908b","Type":"ContainerStarted","Data":"cd3ef0f0f769e28c7f96a186ac1a3c0c86153e4c526c9eff04a5d33713806cff"} Aug 02 10:43:07.960438 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:07.960149 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:07.988040 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:07.987985 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" podStartSLOduration=1.858632273 podStartE2EDuration="5.987968987s" totalImagesPullingTime="3.151627235s" totalInitContainerRuntime="977.709479ms" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:07.987380381 +0000 UTC m=+595.769735345" watchObservedRunningTime="2026-08-02 10:43:07.987968987 +0000 UTC m=+595.770323954" Aug 02 10:43:12.584876 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:12.584852 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:43:12.584876 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:12.584869 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:43:18.966847 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:18.966821 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-mdflg" Aug 02 10:43:33.450296 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.450261 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xsz7s"] Aug 02 10:43:33.454456 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.454440 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.457619 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.457596 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Aug 02 10:43:33.458766 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.458749 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xsdqs\"" Aug 02 10:43:33.468319 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.468297 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xsz7s"] Aug 02 10:43:33.546449 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.546423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4db938-1995-446f-a2b1-2d0b7eb07ebe-tls-certs\") pod \"model-serving-api-54d89bd5fc-xsz7s\" (UID: \"6c4db938-1995-446f-a2b1-2d0b7eb07ebe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.546562 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.546465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppxs\" (UniqueName: \"kubernetes.io/projected/6c4db938-1995-446f-a2b1-2d0b7eb07ebe-kube-api-access-nppxs\") pod \"model-serving-api-54d89bd5fc-xsz7s\" (UID: \"6c4db938-1995-446f-a2b1-2d0b7eb07ebe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.647407 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.647380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nppxs\" (UniqueName: \"kubernetes.io/projected/6c4db938-1995-446f-a2b1-2d0b7eb07ebe-kube-api-access-nppxs\") pod \"model-serving-api-54d89bd5fc-xsz7s\" (UID: \"6c4db938-1995-446f-a2b1-2d0b7eb07ebe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.647551 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.647446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4db938-1995-446f-a2b1-2d0b7eb07ebe-tls-certs\") pod \"model-serving-api-54d89bd5fc-xsz7s\" (UID: \"6c4db938-1995-446f-a2b1-2d0b7eb07ebe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.649648 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.649627 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4db938-1995-446f-a2b1-2d0b7eb07ebe-tls-certs\") pod \"model-serving-api-54d89bd5fc-xsz7s\" (UID: \"6c4db938-1995-446f-a2b1-2d0b7eb07ebe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.658282 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.658263 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppxs\" (UniqueName: \"kubernetes.io/projected/6c4db938-1995-446f-a2b1-2d0b7eb07ebe-kube-api-access-nppxs\") pod \"model-serving-api-54d89bd5fc-xsz7s\" (UID: \"6c4db938-1995-446f-a2b1-2d0b7eb07ebe\") " pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.764781 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.764708 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:33.922586 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.922552 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xsz7s"] Aug 02 10:43:33.927298 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:43:33.927272 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4db938_1995_446f_a2b1_2d0b7eb07ebe.slice/crio-6efb24883fd8005de16577ee40fc927a11c74d095b0ea143b2019bbfef66566a WatchSource:0}: Error finding container 6efb24883fd8005de16577ee40fc927a11c74d095b0ea143b2019bbfef66566a: Status 404 returned error can't find the container with id 6efb24883fd8005de16577ee40fc927a11c74d095b0ea143b2019bbfef66566a Aug 02 10:43:33.929690 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:33.929671 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 10:43:34.072930 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:34.072851 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" event={"ID":"6c4db938-1995-446f-a2b1-2d0b7eb07ebe","Type":"ContainerStarted","Data":"6efb24883fd8005de16577ee40fc927a11c74d095b0ea143b2019bbfef66566a"} Aug 02 10:43:37.090246 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:37.090205 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" event={"ID":"6c4db938-1995-446f-a2b1-2d0b7eb07ebe","Type":"ContainerStarted","Data":"ff1ee25686d33e963f138c7b1da6dd0507ada3814a9ce0be90537fb7b3063ae8"} Aug 02 10:43:37.090660 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:37.090307 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:37.111035 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:37.110983 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" podStartSLOduration=1.838562929 podStartE2EDuration="4.110968416s" totalImagesPullingTime="2.272405487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:37.109678608 +0000 UTC m=+624.892033571" watchObservedRunningTime="2026-08-02 10:43:37.110968416 +0000 UTC m=+624.893323378" Aug 02 10:43:40.302546 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.302512 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2"] Aug 02 10:43:40.309584 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.309554 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.312926 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.312897 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 02 10:43:40.313066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.312939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Aug 02 10:43:40.313066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.312967 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v9mrl\"" Aug 02 10:43:40.313066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.312978 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Aug 02 10:43:40.313066 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.312897 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 02 10:43:40.313317 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.313303 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Aug 02 10:43:40.313389 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.313357 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 02 10:43:40.332207 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.332181 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2"] Aug 02 10:43:40.410389 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.410532 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410400 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.410532 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8htw\" (UniqueName: \"kubernetes.io/projected/281a51cb-41f6-4c3b-92f7-f483232576dc-kube-api-access-s8htw\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.410532 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410477 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/281a51cb-41f6-4c3b-92f7-f483232576dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.410532 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410506 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.410532 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.410728 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.410545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511060 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/281a51cb-41f6-4c3b-92f7-f483232576dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511060 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511244 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511244 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511230 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511321 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511373 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511434 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8htw\" (UniqueName: \"kubernetes.io/projected/281a51cb-41f6-4c3b-92f7-f483232576dc-kube-api-access-s8htw\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.511831 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.511801 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.513433 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.513414 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/281a51cb-41f6-4c3b-92f7-f483232576dc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.513629 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.513607 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.513705 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.513640 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.513705 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.513611 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.534924 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.534898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8htw\" (UniqueName: \"kubernetes.io/projected/281a51cb-41f6-4c3b-92f7-f483232576dc-kube-api-access-s8htw\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.539018 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.539001 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/281a51cb-41f6-4c3b-92f7-f483232576dc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l68v2\" (UID: \"281a51cb-41f6-4c3b-92f7-f483232576dc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.621292 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.621235 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:40.773033 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.773008 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2"] Aug 02 10:43:40.774584 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:43:40.774555 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281a51cb_41f6_4c3b_92f7_f483232576dc.slice/crio-09808ee3837e928c304b368b1c8f088bf516d3cfb3c264b69cf64c6ed72d1460 WatchSource:0}: Error finding container 09808ee3837e928c304b368b1c8f088bf516d3cfb3c264b69cf64c6ed72d1460: Status 404 returned error can't find the container with id 09808ee3837e928c304b368b1c8f088bf516d3cfb3c264b69cf64c6ed72d1460 Aug 02 10:43:40.836527 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.836499 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-669466dd64-fjf42"] Aug 02 10:43:40.839718 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.839700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:40.843173 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.843151 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Aug 02 10:43:40.843516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.843496 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Aug 02 10:43:40.843855 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.843832 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-54cq6\"" Aug 02 10:43:40.843945 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.843915 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Aug 02 10:43:40.856201 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.856178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-669466dd64-fjf42"] Aug 02 10:43:40.914984 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.914893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plswl\" (UniqueName: \"kubernetes.io/projected/4437378c-12fa-47e7-8e98-71e8160f77a8-kube-api-access-plswl\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:40.914984 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.914948 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4437378c-12fa-47e7-8e98-71e8160f77a8-metrics-cert\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:40.915217 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.915080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4437378c-12fa-47e7-8e98-71e8160f77a8-cert\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:40.915217 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:40.915131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4437378c-12fa-47e7-8e98-71e8160f77a8-manager-config\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.016098 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.016071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4437378c-12fa-47e7-8e98-71e8160f77a8-cert\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.016244 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.016104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4437378c-12fa-47e7-8e98-71e8160f77a8-manager-config\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.016244 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.016184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plswl\" (UniqueName: \"kubernetes.io/projected/4437378c-12fa-47e7-8e98-71e8160f77a8-kube-api-access-plswl\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.016244 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.016210 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4437378c-12fa-47e7-8e98-71e8160f77a8-metrics-cert\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.016813 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.016784 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4437378c-12fa-47e7-8e98-71e8160f77a8-manager-config\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.018568 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.018545 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4437378c-12fa-47e7-8e98-71e8160f77a8-metrics-cert\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.018664 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.018574 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4437378c-12fa-47e7-8e98-71e8160f77a8-cert\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.026410 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.026385 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plswl\" (UniqueName: \"kubernetes.io/projected/4437378c-12fa-47e7-8e98-71e8160f77a8-kube-api-access-plswl\") pod \"lws-controller-manager-669466dd64-fjf42\" (UID: \"4437378c-12fa-47e7-8e98-71e8160f77a8\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.109624 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.109595 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" event={"ID":"281a51cb-41f6-4c3b-92f7-f483232576dc","Type":"ContainerStarted","Data":"09808ee3837e928c304b368b1c8f088bf516d3cfb3c264b69cf64c6ed72d1460"} Aug 02 10:43:41.153296 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.153275 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:41.284303 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:41.284281 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-669466dd64-fjf42"] Aug 02 10:43:41.286480 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:43:41.286452 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4437378c_12fa_47e7_8e98_71e8160f77a8.slice/crio-5ad9354d86d4dbdb4ac2a18060cfb2569a7bc7fbf81bea300bf7246864e8ec2a WatchSource:0}: Error finding container 5ad9354d86d4dbdb4ac2a18060cfb2569a7bc7fbf81bea300bf7246864e8ec2a: Status 404 returned error can't find the container with id 5ad9354d86d4dbdb4ac2a18060cfb2569a7bc7fbf81bea300bf7246864e8ec2a Aug 02 10:43:42.121387 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:42.121347 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" event={"ID":"4437378c-12fa-47e7-8e98-71e8160f77a8","Type":"ContainerStarted","Data":"5ad9354d86d4dbdb4ac2a18060cfb2569a7bc7fbf81bea300bf7246864e8ec2a"} Aug 02 10:43:43.621643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:43.621573 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:43:43.621643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:43.621639 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 02 10:43:44.142878 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.142835 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" event={"ID":"4437378c-12fa-47e7-8e98-71e8160f77a8","Type":"ContainerStarted","Data":"885504a8513985502ff23cc2e50268a8520ccd53e4e9e85519558ea273669c2d"} Aug 02 10:43:44.143083 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.142935 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:43:44.144707 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.144676 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" event={"ID":"281a51cb-41f6-4c3b-92f7-f483232576dc","Type":"ContainerStarted","Data":"adfd91fd45c1646fbca69c4c401c64d43f5db0e9e615423cccf7303bd6629b5a"} Aug 02 10:43:44.144827 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.144731 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:44.146511 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.146486 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-l68v2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 02 10:43:44.146630 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.146546 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" podUID="281a51cb-41f6-4c3b-92f7-f483232576dc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 02 10:43:44.190421 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.190372 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" podStartSLOduration=1.855936435 podStartE2EDuration="4.190358012s" totalImagesPullingTime="2.334421577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:44.188600702 +0000 UTC m=+631.970955665" watchObservedRunningTime="2026-08-02 10:43:44.190358012 +0000 UTC m=+631.972712974" Aug 02 10:43:44.255094 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:44.255050 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" podStartSLOduration=1.410153107 podStartE2EDuration="4.255035548s" totalImagesPullingTime="2.844882441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:44.253439807 +0000 UTC m=+632.035794770" watchObservedRunningTime="2026-08-02 10:43:44.255035548 +0000 UTC m=+632.037390510" Aug 02 10:43:45.151853 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:45.151783 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l68v2" Aug 02 10:43:48.099061 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:48.099029 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xsz7s" Aug 02 10:43:55.153268 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:43:55.153236 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-669466dd64-fjf42" Aug 02 10:45:33.192071 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.192035 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:45:33.195442 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.195426 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.198419 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.198395 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Aug 02 10:45:33.198534 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.198434 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zz2mr\"" Aug 02 10:45:33.198534 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.198500 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 02 10:45:33.199262 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.199245 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 02 10:45:33.214532 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.214510 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:45:33.256650 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.256630 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:45:33.295516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.295496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzsq\" (UniqueName: \"kubernetes.io/projected/eba8ffef-9f1c-490d-8dc2-059f50c428fa-kube-api-access-lmzsq\") pod \"limitador-limitador-85d9db4d5d-7mphf\" (UID: \"eba8ffef-9f1c-490d-8dc2-059f50c428fa\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.295601 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.295539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eba8ffef-9f1c-490d-8dc2-059f50c428fa-config-file\") pod \"limitador-limitador-85d9db4d5d-7mphf\" (UID: \"eba8ffef-9f1c-490d-8dc2-059f50c428fa\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.396521 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.396494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzsq\" (UniqueName: \"kubernetes.io/projected/eba8ffef-9f1c-490d-8dc2-059f50c428fa-kube-api-access-lmzsq\") pod \"limitador-limitador-85d9db4d5d-7mphf\" (UID: \"eba8ffef-9f1c-490d-8dc2-059f50c428fa\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.396668 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.396545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eba8ffef-9f1c-490d-8dc2-059f50c428fa-config-file\") pod \"limitador-limitador-85d9db4d5d-7mphf\" (UID: \"eba8ffef-9f1c-490d-8dc2-059f50c428fa\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.397233 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.397215 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eba8ffef-9f1c-490d-8dc2-059f50c428fa-config-file\") pod \"limitador-limitador-85d9db4d5d-7mphf\" (UID: \"eba8ffef-9f1c-490d-8dc2-059f50c428fa\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.405287 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.405268 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzsq\" (UniqueName: \"kubernetes.io/projected/eba8ffef-9f1c-490d-8dc2-059f50c428fa-kube-api-access-lmzsq\") pod \"limitador-limitador-85d9db4d5d-7mphf\" (UID: \"eba8ffef-9f1c-490d-8dc2-059f50c428fa\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.505550 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.505528 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:33.629988 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.629957 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:45:33.633289 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:45:33.633265 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba8ffef_9f1c_490d_8dc2_059f50c428fa.slice/crio-484fda7a4c049a88150e1d03e2b0d33f0352fb2b17fe1c72d6cfc275e8ac8d41 WatchSource:0}: Error finding container 484fda7a4c049a88150e1d03e2b0d33f0352fb2b17fe1c72d6cfc275e8ac8d41: Status 404 returned error can't find the container with id 484fda7a4c049a88150e1d03e2b0d33f0352fb2b17fe1c72d6cfc275e8ac8d41 Aug 02 10:45:33.640332 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:33.640303 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" event={"ID":"eba8ffef-9f1c-490d-8dc2-059f50c428fa","Type":"ContainerStarted","Data":"484fda7a4c049a88150e1d03e2b0d33f0352fb2b17fe1c72d6cfc275e8ac8d41"} Aug 02 10:45:35.652062 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:35.652029 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" event={"ID":"eba8ffef-9f1c-490d-8dc2-059f50c428fa","Type":"ContainerStarted","Data":"d875f2d86be184cb4739b1a0794e43a697101ba68ab4792ce67dc65fed9dfe9c"} Aug 02 10:45:35.652378 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:35.652098 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:45:35.672454 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:35.672414 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" podStartSLOduration=0.731129136 podStartE2EDuration="2.672396946s" totalImagesPullingTime="1.94126781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:45:35.670862204 +0000 UTC m=+743.453217183" watchObservedRunningTime="2026-08-02 10:45:35.672396946 +0000 UTC m=+743.454751910" Aug 02 10:45:46.657435 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:45:46.657396 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-7mphf" Aug 02 10:46:44.203602 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:44.203561 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:46:59.967594 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.967552 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs"] Aug 02 10:46:59.978346 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.978308 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:46:59.983747 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.983703 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 02 10:46:59.984143 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.983946 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fkv5b\"" Aug 02 10:46:59.984515 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.984489 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 02 10:46:59.984625 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.984556 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Aug 02 10:46:59.986493 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:46:59.986465 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs"] Aug 02 10:47:00.101721 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.101692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4g6s\" (UniqueName: \"kubernetes.io/projected/59d39082-dd47-4e2b-945f-b014ec3be17c-kube-api-access-x4g6s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.101852 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.101732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.101852 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.101761 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59d39082-dd47-4e2b-945f-b014ec3be17c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.101923 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.101844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.101923 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.101880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.101992 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.101901 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.202904 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.202876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203024 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.202915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59d39082-dd47-4e2b-945f-b014ec3be17c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203024 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.202951 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203024 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.202982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203024 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.203006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203261 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.203046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4g6s\" (UniqueName: \"kubernetes.io/projected/59d39082-dd47-4e2b-945f-b014ec3be17c-kube-api-access-x4g6s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203363 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.203329 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203363 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.203350 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.203485 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.203440 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.205238 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.205213 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59d39082-dd47-4e2b-945f-b014ec3be17c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.205582 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.205563 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59d39082-dd47-4e2b-945f-b014ec3be17c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.212569 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.212546 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4g6s\" (UniqueName: \"kubernetes.io/projected/59d39082-dd47-4e2b-945f-b014ec3be17c-kube-api-access-x4g6s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs\" (UID: \"59d39082-dd47-4e2b-945f-b014ec3be17c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.290875 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.290819 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:00.418627 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.418605 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs"] Aug 02 10:47:00.420688 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:47:00.420665 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d39082_dd47_4e2b_945f_b014ec3be17c.slice/crio-a6add4889441774857ebe2ce6c7a2fe070d7c4ed643ceaefa5215aa6c8e094a7 WatchSource:0}: Error finding container a6add4889441774857ebe2ce6c7a2fe070d7c4ed643ceaefa5215aa6c8e094a7: Status 404 returned error can't find the container with id a6add4889441774857ebe2ce6c7a2fe070d7c4ed643ceaefa5215aa6c8e094a7 Aug 02 10:47:00.548395 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:00.548328 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:47:01.041815 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:01.041779 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" event={"ID":"59d39082-dd47-4e2b-945f-b014ec3be17c","Type":"ContainerStarted","Data":"a6add4889441774857ebe2ce6c7a2fe070d7c4ed643ceaefa5215aa6c8e094a7"} Aug 02 10:47:02.048879 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:02.048840 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" event={"ID":"59d39082-dd47-4e2b-945f-b014ec3be17c","Type":"ContainerStarted","Data":"e46873c4aea6ede213ac4e040b61ced537086008e1e9202bc2f3588ecf9a5a2f"} Aug 02 10:47:02.069939 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:02.069887 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" podStartSLOduration=2.048968163 podStartE2EDuration="3.069871518s" totalImagesPullingTime="1.020903355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:47:02.068489324 +0000 UTC m=+829.850844286" watchObservedRunningTime="2026-08-02 10:47:02.069871518 +0000 UTC m=+829.852226480" Aug 02 10:47:09.056178 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:09.056144 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:47:10.291601 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:10.291566 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:10.292037 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:10.291863 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:10.303823 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:10.303796 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:11.109503 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:11.109471 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs" Aug 02 10:47:15.054623 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.054584 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89"] Aug 02 10:47:15.057960 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.057942 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.060754 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.060728 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Aug 02 10:47:15.070531 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.070506 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89"] Aug 02 10:47:15.120053 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.120033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.120197 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.120063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kqqk\" (UniqueName: \"kubernetes.io/projected/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-kube-api-access-4kqqk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.120197 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.120108 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.120197 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.120171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.120197 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.120188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.120356 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.120209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.220938 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.220909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221034 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.220942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kqqk\" (UniqueName: \"kubernetes.io/projected/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-kube-api-access-4kqqk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221034 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.220972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221181 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.221103 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221181 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.221170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221294 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.221208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221586 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.221562 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221698 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.221669 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.221772 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.221693 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.223687 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.223664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.224353 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.224331 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.229451 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.229426 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kqqk\" (UniqueName: \"kubernetes.io/projected/b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d-kube-api-access-4kqqk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z5b89\" (UID: \"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.368851 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.368792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:15.493654 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:15.493617 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89"] Aug 02 10:47:15.495777 ip-10-0-141-208 kubenswrapper[2554]: W0802 10:47:15.495749 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7732b2b_6db6_4dfa_88a1_e9e1266a0b2d.slice/crio-bc19e0b5d14f2be92db71aa53625cbe8a6112c605639e592699a04ee556a87df WatchSource:0}: Error finding container bc19e0b5d14f2be92db71aa53625cbe8a6112c605639e592699a04ee556a87df: Status 404 returned error can't find the container with id bc19e0b5d14f2be92db71aa53625cbe8a6112c605639e592699a04ee556a87df Aug 02 10:47:16.062679 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:16.062654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:47:16.116975 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:16.116944 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" event={"ID":"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d","Type":"ContainerStarted","Data":"d689fe2614dbbb6793464c299c8c8cae6d5cb77ed92429f775b047efca47935c"} Aug 02 10:47:16.117106 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:16.116989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" event={"ID":"b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d","Type":"ContainerStarted","Data":"bc19e0b5d14f2be92db71aa53625cbe8a6112c605639e592699a04ee556a87df"} Aug 02 10:47:16.156896 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:16.156854 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" podStartSLOduration=0.996544552 podStartE2EDuration="1.156841032s" totalImagesPullingTime="160.29648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:47:16.154206498 +0000 UTC m=+843.936561461" watchObservedRunningTime="2026-08-02 10:47:16.156841032 +0000 UTC m=+843.939195995" Aug 02 10:47:25.369453 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:25.369414 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:25.369969 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:25.369535 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:25.381595 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:25.381570 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:26.176748 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:26.176724 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z5b89" Aug 02 10:47:36.459366 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:36.459333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:47:43.052520 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:43.052486 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:47:58.447770 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:47:58.447736 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:48:12.611837 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:48:12.611809 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:48:12.615261 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:48:12.615235 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:49:15.245113 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:49:15.245075 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:49:25.046662 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:49:25.046627 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:49:36.549668 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:49:36.549596 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:51:16.043345 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:51:16.043312 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:51:25.744317 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:51:25.744287 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:52:23.745527 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:52:23.745495 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:52:30.944195 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:52:30.944154 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:52:46.248403 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:52:46.248370 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:52:52.238516 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:52:52.238483 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:53:01.752492 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:01.752460 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:53:10.042663 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:10.042631 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:53:12.642632 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:12.642600 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:53:12.646247 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:12.646225 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:53:22.651583 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:22.651547 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:53:27.742215 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:27.742175 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:53:34.760545 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:34.760516 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:53:54.447764 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:53:54.447729 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:54:05.242861 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:54:05.242782 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:54:28.155834 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:54:28.155796 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:54:38.539463 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:54:38.539429 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:54:44.341997 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:54:44.341960 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:54:51.749197 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:54:51.749161 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:54:59.145831 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:54:59.145796 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:04.344554 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:04.344516 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:10.044308 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:10.044269 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:18.752597 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:18.752564 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:27.048643 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:27.048611 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:41.336633 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:41.336553 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:46.547166 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:46.547098 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:55:56.441784 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:55:56.441750 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:56:07.347380 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:56:07.347345 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:56:13.943723 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:56:13.943690 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:56:23.446059 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:56:23.446016 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:58:12.681632 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:58:12.681604 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:58:12.685620 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:58:12.685599 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 10:58:40.347693 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:58:40.347612 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:58:45.437399 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:58:45.437362 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:59:11.546025 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:59:11.545993 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:59:31.439345 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:59:31.439313 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:59:41.644544 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:59:41.644509 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:59:46.739286 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:59:46.739254 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 10:59:51.746530 ip-10-0-141-208 kubenswrapper[2554]: I0802 10:59:51.746498 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:01.845910 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:01.845874 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:08.239560 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:08.239524 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:17.236086 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:17.236047 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:22.249965 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:22.249932 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:32.242092 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:32.242047 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:38.648319 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:38.648280 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:00:47.942752 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:00:47.942717 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:01:12.038535 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:01:12.038504 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:01:17.138891 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:01:17.138856 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:01:41.739599 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:01:41.739525 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:01:51.853871 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:01:51.853840 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:02:18.751135 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:02:18.751093 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:02:27.949258 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:02:27.949227 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:02:34.243943 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:02:34.243908 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:02:44.037192 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:02:44.037155 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:02:51.145488 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:02:51.145453 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:03:07.438495 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:07.438461 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:03:12.710645 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:12.710615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:03:12.715920 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:12.715893 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:03:15.234559 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:15.234520 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:03:27.648101 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:27.648065 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:03:32.647227 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:32.647194 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:03:49.939446 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:49.939414 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:03:55.135025 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:03:55.134989 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:08.544561 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:08.544520 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:13.844704 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:13.844663 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:20.141317 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:20.141281 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:24.944879 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:24.944845 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:31.141727 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:31.141686 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:40.840478 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:40.840396 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:47.838819 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:47.838780 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:04:58.040606 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:04:58.040563 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:05:07.640432 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:05:07.640392 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:05:15.034201 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:05:15.034168 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:05:29.844170 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:05:29.844134 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:05:35.743581 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:05:35.743540 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:05:41.236025 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:05:41.235989 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:05:53.547398 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:05:53.547356 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:06:01.839413 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:01.839378 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:06:07.240997 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:07.240960 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:06:19.008404 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.008368 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr"] Aug 02 11:06:19.011617 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.011601 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.014165 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.014107 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-07fc5de8\"" Aug 02 11:06:19.014310 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.014289 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-07fc5de8-dockercfg-khnmg\"" Aug 02 11:06:19.020610 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.020585 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr"] Aug 02 11:06:19.027383 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.027353 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-plugins-config-volume\") pod \"payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.027500 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.027474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb46l\" (UniqueName: \"kubernetes.io/projected/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-kube-api-access-fb46l\") pod \"payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.128456 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.128419 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-plugins-config-volume\") pod \"payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.128663 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.128503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb46l\" (UniqueName: \"kubernetes.io/projected/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-kube-api-access-fb46l\") pod \"payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.129231 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.129207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-plugins-config-volume\") pod \"payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.136203 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.136178 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb46l\" (UniqueName: \"kubernetes.io/projected/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-kube-api-access-fb46l\") pod \"payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.323356 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.323264 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:19.454859 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.454830 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr"] Aug 02 11:06:19.456424 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:06:19.456396 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82fe7f2_b32e_4d72_9dcd_85ea800c1022.slice/crio-89dfcc6efa870642df1b6eccb1982ab15e67c9d3f0af937fe397919173b7e525 WatchSource:0}: Error finding container 89dfcc6efa870642df1b6eccb1982ab15e67c9d3f0af937fe397919173b7e525: Status 404 returned error can't find the container with id 89dfcc6efa870642df1b6eccb1982ab15e67c9d3f0af937fe397919173b7e525 Aug 02 11:06:19.458327 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:19.458311 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 02 11:06:20.438569 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:20.438531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" event={"ID":"a82fe7f2-b32e-4d72-9dcd-85ea800c1022","Type":"ContainerStarted","Data":"89dfcc6efa870642df1b6eccb1982ab15e67c9d3f0af937fe397919173b7e525"} Aug 02 11:06:21.444716 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:21.444621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" event={"ID":"a82fe7f2-b32e-4d72-9dcd-85ea800c1022","Type":"ContainerStarted","Data":"3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446"} Aug 02 11:06:21.445170 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:21.444723 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:21.461843 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:21.461788 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" podStartSLOduration=1.892752576 podStartE2EDuration="3.461771386s" totalImagesPullingTime="1.56901881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:06:21.459793792 +0000 UTC m=+1989.242148757" watchObservedRunningTime="2026-08-02 11:06:21.461771386 +0000 UTC m=+1989.244126327" Aug 02 11:06:21.539585 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:21.539551 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:06:32.452056 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:32.452029 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:42.979738 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:42.979699 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr"] Aug 02 11:06:42.980307 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:42.979960 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" podUID="a82fe7f2-b32e-4d72-9dcd-85ea800c1022" containerName="payload-processing" containerID="cri-o://3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446" gracePeriod=30 Aug 02 11:06:43.242695 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.242671 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:43.344868 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.344839 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb46l\" (UniqueName: \"kubernetes.io/projected/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-kube-api-access-fb46l\") pod \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " Aug 02 11:06:43.345054 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.344923 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-plugins-config-volume\") pod \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\" (UID: \"a82fe7f2-b32e-4d72-9dcd-85ea800c1022\") " Aug 02 11:06:43.345347 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.345321 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a82fe7f2-b32e-4d72-9dcd-85ea800c1022" (UID: "a82fe7f2-b32e-4d72-9dcd-85ea800c1022"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:06:43.347342 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.347312 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-kube-api-access-fb46l" (OuterVolumeSpecName: "kube-api-access-fb46l") pod "a82fe7f2-b32e-4d72-9dcd-85ea800c1022" (UID: "a82fe7f2-b32e-4d72-9dcd-85ea800c1022"). InnerVolumeSpecName "kube-api-access-fb46l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:06:43.446065 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.446028 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:06:43.446065 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.446058 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb46l\" (UniqueName: \"kubernetes.io/projected/a82fe7f2-b32e-4d72-9dcd-85ea800c1022-kube-api-access-fb46l\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:06:43.555153 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.555046 2554 generic.go:356] "Generic (PLEG): container finished" podID="a82fe7f2-b32e-4d72-9dcd-85ea800c1022" containerID="3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446" exitCode=0 Aug 02 11:06:43.555153 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.555087 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" Aug 02 11:06:43.555153 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.555144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" event={"ID":"a82fe7f2-b32e-4d72-9dcd-85ea800c1022","Type":"ContainerDied","Data":"3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446"} Aug 02 11:06:43.555403 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.555195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr" event={"ID":"a82fe7f2-b32e-4d72-9dcd-85ea800c1022","Type":"ContainerDied","Data":"89dfcc6efa870642df1b6eccb1982ab15e67c9d3f0af937fe397919173b7e525"} Aug 02 11:06:43.555403 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.555217 2554 scope.go:117] "RemoveContainer" containerID="3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446" Aug 02 11:06:43.563876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.563846 2554 scope.go:117] "RemoveContainer" containerID="3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446" Aug 02 11:06:43.564160 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:06:43.564107 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446\": container with ID starting with 3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446 not found: ID does not exist" containerID="3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446" Aug 02 11:06:43.564266 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.564170 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446"} err="failed to get container status \"3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446\": rpc error: code = NotFound desc = could not find container \"3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446\": container with ID starting with 3a8aa02c706a728c8ee2886b65183edc0748ebec5e46007784a9e295ff082446 not found: ID does not exist" Aug 02 11:06:43.574742 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.574715 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr"] Aug 02 11:06:43.580059 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:43.580033 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-07fc5de8-c7c67c97b-dvstr"] Aug 02 11:06:44.667717 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:44.667688 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82fe7f2-b32e-4d72-9dcd-85ea800c1022" path="/var/lib/kubelet/pods/a82fe7f2-b32e-4d72-9dcd-85ea800c1022/volumes" Aug 02 11:06:45.942811 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:45.942778 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:06:53.636349 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:06:53.636314 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:07:14.641215 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:14.641163 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:07:17.180588 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.180552 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6"] Aug 02 11:07:17.181063 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.181044 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82fe7f2-b32e-4d72-9dcd-85ea800c1022" containerName="payload-processing" Aug 02 11:07:17.181145 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.181066 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82fe7f2-b32e-4d72-9dcd-85ea800c1022" containerName="payload-processing" Aug 02 11:07:17.181213 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.181164 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a82fe7f2-b32e-4d72-9dcd-85ea800c1022" containerName="payload-processing" Aug 02 11:07:17.184487 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.184467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.187241 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.187216 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a9cb70b3\"" Aug 02 11:07:17.187363 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.187264 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a9cb70b3-dockercfg-bvng9\"" Aug 02 11:07:17.194481 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.194448 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6"] Aug 02 11:07:17.202753 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.202731 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f"] Aug 02 11:07:17.205963 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.205945 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.214427 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.214405 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f"] Aug 02 11:07:17.253275 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.253247 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b78931a-fb36-4a6b-9c8c-165c3244e73a-plugins-config-volume\") pod \"payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.253417 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.253381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffdzm\" (UniqueName: \"kubernetes.io/projected/1b78931a-fb36-4a6b-9c8c-165c3244e73a-kube-api-access-ffdzm\") pod \"payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.253478 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.253443 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbwx\" (UniqueName: \"kubernetes.io/projected/2277c46a-b779-43f4-b4bf-0205a8d0ac01-kube-api-access-hkbwx\") pod \"payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.253533 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.253496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2277c46a-b779-43f4-b4bf-0205a8d0ac01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.363352 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.363314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffdzm\" (UniqueName: \"kubernetes.io/projected/1b78931a-fb36-4a6b-9c8c-165c3244e73a-kube-api-access-ffdzm\") pod \"payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.363553 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.363396 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbwx\" (UniqueName: \"kubernetes.io/projected/2277c46a-b779-43f4-b4bf-0205a8d0ac01-kube-api-access-hkbwx\") pod \"payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.363553 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.363462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2277c46a-b779-43f4-b4bf-0205a8d0ac01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.363553 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.363490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b78931a-fb36-4a6b-9c8c-165c3244e73a-plugins-config-volume\") pod \"payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.364308 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.364282 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2277c46a-b779-43f4-b4bf-0205a8d0ac01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.364438 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.364337 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b78931a-fb36-4a6b-9c8c-165c3244e73a-plugins-config-volume\") pod \"payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.372740 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.372711 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffdzm\" (UniqueName: \"kubernetes.io/projected/1b78931a-fb36-4a6b-9c8c-165c3244e73a-kube-api-access-ffdzm\") pod \"payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.373303 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.373282 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbwx\" (UniqueName: \"kubernetes.io/projected/2277c46a-b779-43f4-b4bf-0205a8d0ac01-kube-api-access-hkbwx\") pod \"payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.497533 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.497496 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.517705 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.517647 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:17.650784 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.650731 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6"] Aug 02 11:07:17.654375 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:07:17.654327 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2277c46a_b779_43f4_b4bf_0205a8d0ac01.slice/crio-582c184d51ab410c8eec26c31e815428262f2635133e65103562544aab664d2b WatchSource:0}: Error finding container 582c184d51ab410c8eec26c31e815428262f2635133e65103562544aab664d2b: Status 404 returned error can't find the container with id 582c184d51ab410c8eec26c31e815428262f2635133e65103562544aab664d2b Aug 02 11:07:17.675603 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.675575 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f"] Aug 02 11:07:17.686291 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:07:17.686266 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b78931a_fb36_4a6b_9c8c_165c3244e73a.slice/crio-62b8e3bd6fb0cc1b9afecebb9cd9dcfe75443178c4f54c5e2675b8ae10fe1159 WatchSource:0}: Error finding container 62b8e3bd6fb0cc1b9afecebb9cd9dcfe75443178c4f54c5e2675b8ae10fe1159: Status 404 returned error can't find the container with id 62b8e3bd6fb0cc1b9afecebb9cd9dcfe75443178c4f54c5e2675b8ae10fe1159 Aug 02 11:07:17.721859 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.721829 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" event={"ID":"1b78931a-fb36-4a6b-9c8c-165c3244e73a","Type":"ContainerStarted","Data":"62b8e3bd6fb0cc1b9afecebb9cd9dcfe75443178c4f54c5e2675b8ae10fe1159"} Aug 02 11:07:17.723450 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.723426 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" event={"ID":"2277c46a-b779-43f4-b4bf-0205a8d0ac01","Type":"ContainerStarted","Data":"836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253"} Aug 02 11:07:17.723546 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.723465 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" event={"ID":"2277c46a-b779-43f4-b4bf-0205a8d0ac01","Type":"ContainerStarted","Data":"582c184d51ab410c8eec26c31e815428262f2635133e65103562544aab664d2b"} Aug 02 11:07:17.723546 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.723508 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:17.738863 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:17.738821 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" podStartSLOduration=0.738808175 podStartE2EDuration="738.808175ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:07:17.738344171 +0000 UTC m=+2045.520699137" watchObservedRunningTime="2026-08-02 11:07:17.738808175 +0000 UTC m=+2045.521163139" Aug 02 11:07:18.729549 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:18.729515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" event={"ID":"1b78931a-fb36-4a6b-9c8c-165c3244e73a","Type":"ContainerStarted","Data":"d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c"} Aug 02 11:07:18.729923 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:18.729598 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:18.746328 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:18.746282 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" podStartSLOduration=1.746267603 podStartE2EDuration="1.746267603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:07:18.744485366 +0000 UTC m=+2046.526840330" watchObservedRunningTime="2026-08-02 11:07:18.746267603 +0000 UTC m=+2046.528622566" Aug 02 11:07:22.837699 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:22.837672 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:07:28.732169 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:28.732140 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:29.737253 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:29.737225 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:41.542850 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.542767 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f"] Aug 02 11:07:41.543315 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.542992 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" podUID="1b78931a-fb36-4a6b-9c8c-165c3244e73a" containerName="payload-processing" containerID="cri-o://d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c" gracePeriod=30 Aug 02 11:07:41.547481 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.547396 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6"] Aug 02 11:07:41.547955 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.547879 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" podUID="2277c46a-b779-43f4-b4bf-0205a8d0ac01" containerName="payload-pre-processing" containerID="cri-o://836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253" gracePeriod=30 Aug 02 11:07:41.799754 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.799692 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:41.822876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.822851 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:41.838174 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.838141 2554 generic.go:356] "Generic (PLEG): container finished" podID="1b78931a-fb36-4a6b-9c8c-165c3244e73a" containerID="d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c" exitCode=0 Aug 02 11:07:41.838174 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.838168 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" Aug 02 11:07:41.838339 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.838210 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" event={"ID":"1b78931a-fb36-4a6b-9c8c-165c3244e73a","Type":"ContainerDied","Data":"d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c"} Aug 02 11:07:41.838339 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.838266 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f" event={"ID":"1b78931a-fb36-4a6b-9c8c-165c3244e73a","Type":"ContainerDied","Data":"62b8e3bd6fb0cc1b9afecebb9cd9dcfe75443178c4f54c5e2675b8ae10fe1159"} Aug 02 11:07:41.838339 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.838295 2554 scope.go:117] "RemoveContainer" containerID="d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c" Aug 02 11:07:41.839654 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.839619 2554 generic.go:356] "Generic (PLEG): container finished" podID="2277c46a-b779-43f4-b4bf-0205a8d0ac01" containerID="836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253" exitCode=0 Aug 02 11:07:41.839760 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.839665 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" Aug 02 11:07:41.839760 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.839665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" event={"ID":"2277c46a-b779-43f4-b4bf-0205a8d0ac01","Type":"ContainerDied","Data":"836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253"} Aug 02 11:07:41.839760 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.839738 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6" event={"ID":"2277c46a-b779-43f4-b4bf-0205a8d0ac01","Type":"ContainerDied","Data":"582c184d51ab410c8eec26c31e815428262f2635133e65103562544aab664d2b"} Aug 02 11:07:41.849440 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.849423 2554 scope.go:117] "RemoveContainer" containerID="d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c" Aug 02 11:07:41.849739 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:07:41.849712 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c\": container with ID starting with d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c not found: ID does not exist" containerID="d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c" Aug 02 11:07:41.849787 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.849746 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c"} err="failed to get container status \"d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c\": rpc error: code = NotFound desc = could not find container \"d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c\": container with ID starting with d044563f92a3d4160e7df20e26b843733522a99c02d823f1e3b4fcaafe1d9e3c not found: ID does not exist" Aug 02 11:07:41.849787 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.849764 2554 scope.go:117] "RemoveContainer" containerID="836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253" Aug 02 11:07:41.860301 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.860257 2554 scope.go:117] "RemoveContainer" containerID="836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253" Aug 02 11:07:41.860775 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:07:41.860744 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253\": container with ID starting with 836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253 not found: ID does not exist" containerID="836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253" Aug 02 11:07:41.860862 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.860785 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253"} err="failed to get container status \"836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253\": rpc error: code = NotFound desc = could not find container \"836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253\": container with ID starting with 836227dcbe4c2e4bb53c29f5e0ffc609ed8ad05a819d307b91f33d0b9885d253 not found: ID does not exist" Aug 02 11:07:41.871205 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871188 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffdzm\" (UniqueName: \"kubernetes.io/projected/1b78931a-fb36-4a6b-9c8c-165c3244e73a-kube-api-access-ffdzm\") pod \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " Aug 02 11:07:41.871298 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871241 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2277c46a-b779-43f4-b4bf-0205a8d0ac01-plugins-config-volume\") pod \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " Aug 02 11:07:41.871381 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871364 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkbwx\" (UniqueName: \"kubernetes.io/projected/2277c46a-b779-43f4-b4bf-0205a8d0ac01-kube-api-access-hkbwx\") pod \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\" (UID: \"2277c46a-b779-43f4-b4bf-0205a8d0ac01\") " Aug 02 11:07:41.871441 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871404 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b78931a-fb36-4a6b-9c8c-165c3244e73a-plugins-config-volume\") pod \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\" (UID: \"1b78931a-fb36-4a6b-9c8c-165c3244e73a\") " Aug 02 11:07:41.871561 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871540 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2277c46a-b779-43f4-b4bf-0205a8d0ac01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2277c46a-b779-43f4-b4bf-0205a8d0ac01" (UID: "2277c46a-b779-43f4-b4bf-0205a8d0ac01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:07:41.871721 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871693 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2277c46a-b779-43f4-b4bf-0205a8d0ac01-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:07:41.871826 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.871718 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b78931a-fb36-4a6b-9c8c-165c3244e73a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b78931a-fb36-4a6b-9c8c-165c3244e73a" (UID: "1b78931a-fb36-4a6b-9c8c-165c3244e73a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:07:41.873084 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.873067 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b78931a-fb36-4a6b-9c8c-165c3244e73a-kube-api-access-ffdzm" (OuterVolumeSpecName: "kube-api-access-ffdzm") pod "1b78931a-fb36-4a6b-9c8c-165c3244e73a" (UID: "1b78931a-fb36-4a6b-9c8c-165c3244e73a"). InnerVolumeSpecName "kube-api-access-ffdzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:07:41.873365 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.873344 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2277c46a-b779-43f4-b4bf-0205a8d0ac01-kube-api-access-hkbwx" (OuterVolumeSpecName: "kube-api-access-hkbwx") pod "2277c46a-b779-43f4-b4bf-0205a8d0ac01" (UID: "2277c46a-b779-43f4-b4bf-0205a8d0ac01"). InnerVolumeSpecName "kube-api-access-hkbwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:07:41.972569 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.972548 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkbwx\" (UniqueName: \"kubernetes.io/projected/2277c46a-b779-43f4-b4bf-0205a8d0ac01-kube-api-access-hkbwx\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:07:41.972664 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.972572 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b78931a-fb36-4a6b-9c8c-165c3244e73a-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:07:41.972664 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:41.972585 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffdzm\" (UniqueName: \"kubernetes.io/projected/1b78931a-fb36-4a6b-9c8c-165c3244e73a-kube-api-access-ffdzm\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:07:42.162194 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:42.162170 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6"] Aug 02 11:07:42.167658 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:42.167629 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a9cb70b3-574c995bb8-c55k6"] Aug 02 11:07:42.177456 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:42.177434 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f"] Aug 02 11:07:42.183470 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:42.183444 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a9cb70b3-56466ccf4-fnh9f"] Aug 02 11:07:42.667663 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:42.667634 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b78931a-fb36-4a6b-9c8c-165c3244e73a" path="/var/lib/kubelet/pods/1b78931a-fb36-4a6b-9c8c-165c3244e73a/volumes" Aug 02 11:07:42.668001 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:42.667987 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2277c46a-b779-43f4-b4bf-0205a8d0ac01" path="/var/lib/kubelet/pods/2277c46a-b779-43f4-b4bf-0205a8d0ac01/volumes" Aug 02 11:07:45.974958 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:45.974925 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:07:47.496702 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.496669 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk"] Aug 02 11:07:47.497060 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.497044 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2277c46a-b779-43f4-b4bf-0205a8d0ac01" containerName="payload-pre-processing" Aug 02 11:07:47.497060 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.497057 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2277c46a-b779-43f4-b4bf-0205a8d0ac01" containerName="payload-pre-processing" Aug 02 11:07:47.497172 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.497082 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b78931a-fb36-4a6b-9c8c-165c3244e73a" containerName="payload-processing" Aug 02 11:07:47.497172 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.497088 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b78931a-fb36-4a6b-9c8c-165c3244e73a" containerName="payload-processing" Aug 02 11:07:47.497172 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.497167 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2277c46a-b779-43f4-b4bf-0205a8d0ac01" containerName="payload-pre-processing" Aug 02 11:07:47.497273 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.497177 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b78931a-fb36-4a6b-9c8c-165c3244e73a" containerName="payload-processing" Aug 02 11:07:47.500004 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.499985 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.502615 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.502593 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-75b9be26\"" Aug 02 11:07:47.502707 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.502629 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-75b9be26-dockercfg-lx2sh\"" Aug 02 11:07:47.510585 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.510531 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk"] Aug 02 11:07:47.517462 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.517438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.517568 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.517507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4k42\" (UniqueName: \"kubernetes.io/projected/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-kube-api-access-t4k42\") pod \"payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.521540 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.521518 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k"] Aug 02 11:07:47.524744 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.524725 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.532739 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.532715 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k"] Aug 02 11:07:47.618435 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.618403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwjts\" (UniqueName: \"kubernetes.io/projected/e80ba9bd-3652-4fd9-8dc4-a931f5119451-kube-api-access-fwjts\") pod \"payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.618617 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.618466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k42\" (UniqueName: \"kubernetes.io/projected/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-kube-api-access-t4k42\") pod \"payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.618617 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.618535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.618617 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.618567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e80ba9bd-3652-4fd9-8dc4-a931f5119451-plugins-config-volume\") pod \"payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.619226 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.619207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.626069 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.626044 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4k42\" (UniqueName: \"kubernetes.io/projected/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-kube-api-access-t4k42\") pod \"payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.719659 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.719630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e80ba9bd-3652-4fd9-8dc4-a931f5119451-plugins-config-volume\") pod \"payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.719776 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.719684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwjts\" (UniqueName: \"kubernetes.io/projected/e80ba9bd-3652-4fd9-8dc4-a931f5119451-kube-api-access-fwjts\") pod \"payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.720288 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.720270 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e80ba9bd-3652-4fd9-8dc4-a931f5119451-plugins-config-volume\") pod \"payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.727417 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.727399 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwjts\" (UniqueName: \"kubernetes.io/projected/e80ba9bd-3652-4fd9-8dc4-a931f5119451-kube-api-access-fwjts\") pod \"payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.810566 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.810503 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:47.836034 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.836010 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:47.954830 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.954805 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk"] Aug 02 11:07:47.957370 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:07:47.957331 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c5154c_6f5c_42cb_9ddf_6df16c0de3fa.slice/crio-0c9ea987aab65463f58d576a25109c7d7a208315d5f122feaed7183be61a6ac0 WatchSource:0}: Error finding container 0c9ea987aab65463f58d576a25109c7d7a208315d5f122feaed7183be61a6ac0: Status 404 returned error can't find the container with id 0c9ea987aab65463f58d576a25109c7d7a208315d5f122feaed7183be61a6ac0 Aug 02 11:07:47.976670 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:47.976597 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k"] Aug 02 11:07:47.979425 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:07:47.979394 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80ba9bd_3652_4fd9_8dc4_a931f5119451.slice/crio-5ec0932156812594baa5d65c5f3eae81a802c7a5cb701f71f677223c8e60bc9e WatchSource:0}: Error finding container 5ec0932156812594baa5d65c5f3eae81a802c7a5cb701f71f677223c8e60bc9e: Status 404 returned error can't find the container with id 5ec0932156812594baa5d65c5f3eae81a802c7a5cb701f71f677223c8e60bc9e Aug 02 11:07:48.879187 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.879141 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" event={"ID":"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa","Type":"ContainerStarted","Data":"54395765afcb90cccb5ecef00f9cb55a21a310367d603dd9fc85162580d1348d"} Aug 02 11:07:48.879656 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.879220 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:48.879656 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.879248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" event={"ID":"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa","Type":"ContainerStarted","Data":"0c9ea987aab65463f58d576a25109c7d7a208315d5f122feaed7183be61a6ac0"} Aug 02 11:07:48.880663 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.880638 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" event={"ID":"e80ba9bd-3652-4fd9-8dc4-a931f5119451","Type":"ContainerStarted","Data":"298bfd0916d6d0894e65d5b80ac96ce2965def4f6863eadd0191e1ca9e630d4d"} Aug 02 11:07:48.880795 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.880686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" event={"ID":"e80ba9bd-3652-4fd9-8dc4-a931f5119451","Type":"ContainerStarted","Data":"5ec0932156812594baa5d65c5f3eae81a802c7a5cb701f71f677223c8e60bc9e"} Aug 02 11:07:48.880795 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.880737 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:07:48.896612 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.896567 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" podStartSLOduration=1.896553393 podStartE2EDuration="1.896553393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:07:48.89421491 +0000 UTC m=+2076.676569875" watchObservedRunningTime="2026-08-02 11:07:48.896553393 +0000 UTC m=+2076.678908357" Aug 02 11:07:48.910333 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:48.910292 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" podStartSLOduration=1.9102795970000002 podStartE2EDuration="1.910279597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:07:48.908639528 +0000 UTC m=+2076.690994562" watchObservedRunningTime="2026-08-02 11:07:48.910279597 +0000 UTC m=+2076.692634624" Aug 02 11:07:52.846967 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:52.846933 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:07:59.887653 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:59.887622 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:07:59.888039 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:07:59.887698 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:08:10.779778 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.779744 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k"] Aug 02 11:08:10.780267 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.780177 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" podUID="e80ba9bd-3652-4fd9-8dc4-a931f5119451" containerName="payload-processing" containerID="cri-o://298bfd0916d6d0894e65d5b80ac96ce2965def4f6863eadd0191e1ca9e630d4d" gracePeriod=30 Aug 02 11:08:10.786313 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.786285 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk"] Aug 02 11:08:10.786698 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.786669 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" podUID="25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" containerName="payload-pre-processing" containerID="cri-o://54395765afcb90cccb5ecef00f9cb55a21a310367d603dd9fc85162580d1348d" gracePeriod=30 Aug 02 11:08:10.987171 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.987138 2554 generic.go:356] "Generic (PLEG): container finished" podID="25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" containerID="54395765afcb90cccb5ecef00f9cb55a21a310367d603dd9fc85162580d1348d" exitCode=0 Aug 02 11:08:10.987171 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.987152 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" event={"ID":"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa","Type":"ContainerDied","Data":"54395765afcb90cccb5ecef00f9cb55a21a310367d603dd9fc85162580d1348d"} Aug 02 11:08:10.988829 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.988800 2554 generic.go:356] "Generic (PLEG): container finished" podID="e80ba9bd-3652-4fd9-8dc4-a931f5119451" containerID="298bfd0916d6d0894e65d5b80ac96ce2965def4f6863eadd0191e1ca9e630d4d" exitCode=0 Aug 02 11:08:10.988947 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:10.988868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" event={"ID":"e80ba9bd-3652-4fd9-8dc4-a931f5119451","Type":"ContainerDied","Data":"298bfd0916d6d0894e65d5b80ac96ce2965def4f6863eadd0191e1ca9e630d4d"} Aug 02 11:08:11.050849 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.050825 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:08:11.067629 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.067605 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:08:11.111621 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.111596 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e80ba9bd-3652-4fd9-8dc4-a931f5119451-plugins-config-volume\") pod \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " Aug 02 11:08:11.111750 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.111653 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwjts\" (UniqueName: \"kubernetes.io/projected/e80ba9bd-3652-4fd9-8dc4-a931f5119451-kube-api-access-fwjts\") pod \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\" (UID: \"e80ba9bd-3652-4fd9-8dc4-a931f5119451\") " Aug 02 11:08:11.111924 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.111903 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80ba9bd-3652-4fd9-8dc4-a931f5119451-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e80ba9bd-3652-4fd9-8dc4-a931f5119451" (UID: "e80ba9bd-3652-4fd9-8dc4-a931f5119451"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:08:11.113660 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.113637 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e80ba9bd-3652-4fd9-8dc4-a931f5119451-kube-api-access-fwjts" (OuterVolumeSpecName: "kube-api-access-fwjts") pod "e80ba9bd-3652-4fd9-8dc4-a931f5119451" (UID: "e80ba9bd-3652-4fd9-8dc4-a931f5119451"). InnerVolumeSpecName "kube-api-access-fwjts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:08:11.212761 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.212736 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4k42\" (UniqueName: \"kubernetes.io/projected/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-kube-api-access-t4k42\") pod \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " Aug 02 11:08:11.212876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.212837 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-plugins-config-volume\") pod \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\" (UID: \"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa\") " Aug 02 11:08:11.213015 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.213004 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e80ba9bd-3652-4fd9-8dc4-a931f5119451-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:08:11.213066 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.213017 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwjts\" (UniqueName: \"kubernetes.io/projected/e80ba9bd-3652-4fd9-8dc4-a931f5119451-kube-api-access-fwjts\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:08:11.213232 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.213210 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" (UID: "25c5154c-6f5c-42cb-9ddf-6df16c0de3fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:08:11.214691 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.214673 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-kube-api-access-t4k42" (OuterVolumeSpecName: "kube-api-access-t4k42") pod "25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" (UID: "25c5154c-6f5c-42cb-9ddf-6df16c0de3fa"). InnerVolumeSpecName "kube-api-access-t4k42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:08:11.314317 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.314265 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4k42\" (UniqueName: \"kubernetes.io/projected/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-kube-api-access-t4k42\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:08:11.314317 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.314284 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:08:11.994466 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.994435 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" Aug 02 11:08:11.994466 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.994454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk" event={"ID":"25c5154c-6f5c-42cb-9ddf-6df16c0de3fa","Type":"ContainerDied","Data":"0c9ea987aab65463f58d576a25109c7d7a208315d5f122feaed7183be61a6ac0"} Aug 02 11:08:11.994934 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.994520 2554 scope.go:117] "RemoveContainer" containerID="54395765afcb90cccb5ecef00f9cb55a21a310367d603dd9fc85162580d1348d" Aug 02 11:08:11.995831 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.995808 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" Aug 02 11:08:11.995916 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:11.995830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k" event={"ID":"e80ba9bd-3652-4fd9-8dc4-a931f5119451","Type":"ContainerDied","Data":"5ec0932156812594baa5d65c5f3eae81a802c7a5cb701f71f677223c8e60bc9e"} Aug 02 11:08:12.004366 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.004345 2554 scope.go:117] "RemoveContainer" containerID="298bfd0916d6d0894e65d5b80ac96ce2965def4f6863eadd0191e1ca9e630d4d" Aug 02 11:08:12.017485 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.017462 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk"] Aug 02 11:08:12.021649 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.021631 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-75b9be26-b48cb67d8-kznnk"] Aug 02 11:08:12.031761 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.031737 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k"] Aug 02 11:08:12.035999 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.035980 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-75b9be26-559fc8676b-pmb2k"] Aug 02 11:08:12.673901 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.673867 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" path="/var/lib/kubelet/pods/25c5154c-6f5c-42cb-9ddf-6df16c0de3fa/volumes" Aug 02 11:08:12.674241 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.674228 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e80ba9bd-3652-4fd9-8dc4-a931f5119451" path="/var/lib/kubelet/pods/e80ba9bd-3652-4fd9-8dc4-a931f5119451/volumes" Aug 02 11:08:12.744682 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.744658 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:08:12.749747 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:12.749725 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:08:13.638107 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:13.638075 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:08:26.733663 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:08:26.733630 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:09:59.545111 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:09:59.545066 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:10:04.046938 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:04.046904 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:10:13.801002 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.800966 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt"] Aug 02 11:10:13.801451 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.801372 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" containerName="payload-pre-processing" Aug 02 11:10:13.801451 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.801388 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" containerName="payload-pre-processing" Aug 02 11:10:13.801451 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.801400 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80ba9bd-3652-4fd9-8dc4-a931f5119451" containerName="payload-processing" Aug 02 11:10:13.801451 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.801406 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80ba9bd-3652-4fd9-8dc4-a931f5119451" containerName="payload-processing" Aug 02 11:10:13.801583 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.801470 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80ba9bd-3652-4fd9-8dc4-a931f5119451" containerName="payload-processing" Aug 02 11:10:13.801583 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.801484 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="25c5154c-6f5c-42cb-9ddf-6df16c0de3fa" containerName="payload-pre-processing" Aug 02 11:10:13.805874 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.805850 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:13.809280 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.809251 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8126169a-dockercfg-v968m\"" Aug 02 11:10:13.809423 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.809361 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8126169a\"" Aug 02 11:10:13.814984 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.814957 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt"] Aug 02 11:10:13.960515 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.960475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79pkn\" (UniqueName: \"kubernetes.io/projected/64b90930-fa23-4d4a-98a4-763c3f4cec32-kube-api-access-79pkn\") pod \"payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:13.960710 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:13.960538 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64b90930-fa23-4d4a-98a4-763c3f4cec32-plugins-config-volume\") pod \"payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.061605 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.061532 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79pkn\" (UniqueName: \"kubernetes.io/projected/64b90930-fa23-4d4a-98a4-763c3f4cec32-kube-api-access-79pkn\") pod \"payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.061605 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.061583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64b90930-fa23-4d4a-98a4-763c3f4cec32-plugins-config-volume\") pod \"payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.062264 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.062246 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64b90930-fa23-4d4a-98a4-763c3f4cec32-plugins-config-volume\") pod \"payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.069440 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.069407 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79pkn\" (UniqueName: \"kubernetes.io/projected/64b90930-fa23-4d4a-98a4-763c3f4cec32-kube-api-access-79pkn\") pod \"payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.120879 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.120846 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.252097 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.252068 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt"] Aug 02 11:10:14.254071 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:10:14.254042 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b90930_fa23_4d4a_98a4_763c3f4cec32.slice/crio-f8fcdaccac0516d521e2ae924dad39523f8c32196fac48a1d3b426ddadda9d9f WatchSource:0}: Error finding container f8fcdaccac0516d521e2ae924dad39523f8c32196fac48a1d3b426ddadda9d9f: Status 404 returned error can't find the container with id f8fcdaccac0516d521e2ae924dad39523f8c32196fac48a1d3b426ddadda9d9f Aug 02 11:10:14.578484 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.578399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" event={"ID":"64b90930-fa23-4d4a-98a4-763c3f4cec32","Type":"ContainerStarted","Data":"d172221ba7d0e027f7fda655209f0eced6826d3f8525210aae3e55dc9a2cdb9e"} Aug 02 11:10:14.578484 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.578451 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" event={"ID":"64b90930-fa23-4d4a-98a4-763c3f4cec32","Type":"ContainerStarted","Data":"f8fcdaccac0516d521e2ae924dad39523f8c32196fac48a1d3b426ddadda9d9f"} Aug 02 11:10:14.578691 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.578541 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:14.594624 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:14.594577 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" podStartSLOduration=1.594563674 podStartE2EDuration="1.594563674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:10:14.592807512 +0000 UTC m=+2222.375162476" watchObservedRunningTime="2026-08-02 11:10:14.594563674 +0000 UTC m=+2222.376918616" Aug 02 11:10:15.638761 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:15.638732 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:10:25.585740 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:25.585708 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:44.567352 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.567262 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt"] Aug 02 11:10:44.567849 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.567538 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" podUID="64b90930-fa23-4d4a-98a4-763c3f4cec32" containerName="payload-processing" containerID="cri-o://d172221ba7d0e027f7fda655209f0eced6826d3f8525210aae3e55dc9a2cdb9e" gracePeriod=30 Aug 02 11:10:44.729921 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.729886 2554 generic.go:356] "Generic (PLEG): container finished" podID="64b90930-fa23-4d4a-98a4-763c3f4cec32" containerID="d172221ba7d0e027f7fda655209f0eced6826d3f8525210aae3e55dc9a2cdb9e" exitCode=0 Aug 02 11:10:44.730096 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.729945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" event={"ID":"64b90930-fa23-4d4a-98a4-763c3f4cec32","Type":"ContainerDied","Data":"d172221ba7d0e027f7fda655209f0eced6826d3f8525210aae3e55dc9a2cdb9e"} Aug 02 11:10:44.833907 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.833877 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:44.908856 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.908816 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64b90930-fa23-4d4a-98a4-763c3f4cec32-plugins-config-volume\") pod \"64b90930-fa23-4d4a-98a4-763c3f4cec32\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " Aug 02 11:10:44.909046 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.908917 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79pkn\" (UniqueName: \"kubernetes.io/projected/64b90930-fa23-4d4a-98a4-763c3f4cec32-kube-api-access-79pkn\") pod \"64b90930-fa23-4d4a-98a4-763c3f4cec32\" (UID: \"64b90930-fa23-4d4a-98a4-763c3f4cec32\") " Aug 02 11:10:44.909251 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.909226 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b90930-fa23-4d4a-98a4-763c3f4cec32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64b90930-fa23-4d4a-98a4-763c3f4cec32" (UID: "64b90930-fa23-4d4a-98a4-763c3f4cec32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:10:44.911068 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:44.911033 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b90930-fa23-4d4a-98a4-763c3f4cec32-kube-api-access-79pkn" (OuterVolumeSpecName: "kube-api-access-79pkn") pod "64b90930-fa23-4d4a-98a4-763c3f4cec32" (UID: "64b90930-fa23-4d4a-98a4-763c3f4cec32"). InnerVolumeSpecName "kube-api-access-79pkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:10:45.009704 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.009658 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79pkn\" (UniqueName: \"kubernetes.io/projected/64b90930-fa23-4d4a-98a4-763c3f4cec32-kube-api-access-79pkn\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:10:45.009704 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.009697 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64b90930-fa23-4d4a-98a4-763c3f4cec32-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:10:45.735589 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.735556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" event={"ID":"64b90930-fa23-4d4a-98a4-763c3f4cec32","Type":"ContainerDied","Data":"f8fcdaccac0516d521e2ae924dad39523f8c32196fac48a1d3b426ddadda9d9f"} Aug 02 11:10:45.735589 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.735590 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt" Aug 02 11:10:45.736073 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.735615 2554 scope.go:117] "RemoveContainer" containerID="d172221ba7d0e027f7fda655209f0eced6826d3f8525210aae3e55dc9a2cdb9e" Aug 02 11:10:45.768329 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.768297 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt"] Aug 02 11:10:45.781605 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:45.781571 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8126169a-5877b4599d-2rsbt"] Aug 02 11:10:46.668405 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:46.668370 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b90930-fa23-4d4a-98a4-763c3f4cec32" path="/var/lib/kubelet/pods/64b90930-fa23-4d4a-98a4-763c3f4cec32/volumes" Aug 02 11:10:46.837290 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:10:46.837252 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:11:25.440429 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:11:25.440394 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:13:09.646773 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:09.646740 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:13:11.950262 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.950224 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw"] Aug 02 11:13:11.950642 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.950624 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b90930-fa23-4d4a-98a4-763c3f4cec32" containerName="payload-processing" Aug 02 11:13:11.950690 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.950644 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b90930-fa23-4d4a-98a4-763c3f4cec32" containerName="payload-processing" Aug 02 11:13:11.950725 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.950701 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b90930-fa23-4d4a-98a4-763c3f4cec32" containerName="payload-processing" Aug 02 11:13:11.953842 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.953822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:11.956184 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.956165 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a9dd0457\"" Aug 02 11:13:11.956290 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.956261 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a9dd0457-dockercfg-ftdsr\"" Aug 02 11:13:11.967033 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:11.967004 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw"] Aug 02 11:13:12.072982 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.072953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68l4q\" (UniqueName: \"kubernetes.io/projected/646a37d4-c16a-4e8e-8fba-9021eac333b7-kube-api-access-68l4q\") pod \"payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.073156 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.073000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/646a37d4-c16a-4e8e-8fba-9021eac333b7-plugins-config-volume\") pod \"payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.173704 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.173668 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68l4q\" (UniqueName: \"kubernetes.io/projected/646a37d4-c16a-4e8e-8fba-9021eac333b7-kube-api-access-68l4q\") pod \"payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.173868 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.173721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/646a37d4-c16a-4e8e-8fba-9021eac333b7-plugins-config-volume\") pod \"payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.174418 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.174395 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/646a37d4-c16a-4e8e-8fba-9021eac333b7-plugins-config-volume\") pod \"payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.181060 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.181033 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68l4q\" (UniqueName: \"kubernetes.io/projected/646a37d4-c16a-4e8e-8fba-9021eac333b7-kube-api-access-68l4q\") pod \"payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.265049 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.264991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:12.393037 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.392981 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw"] Aug 02 11:13:12.395355 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:13:12.395326 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646a37d4_c16a_4e8e_8fba_9021eac333b7.slice/crio-c3d16a990a18836ff08919d8aa1988a57a0663ca3dd63d09d9691f64633ff516 WatchSource:0}: Error finding container c3d16a990a18836ff08919d8aa1988a57a0663ca3dd63d09d9691f64633ff516: Status 404 returned error can't find the container with id c3d16a990a18836ff08919d8aa1988a57a0663ca3dd63d09d9691f64633ff516 Aug 02 11:13:12.409560 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.409537 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" event={"ID":"646a37d4-c16a-4e8e-8fba-9021eac333b7","Type":"ContainerStarted","Data":"c3d16a990a18836ff08919d8aa1988a57a0663ca3dd63d09d9691f64633ff516"} Aug 02 11:13:12.774693 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.774663 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:13:12.781538 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:12.781518 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:13:13.415435 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:13.415402 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" event={"ID":"646a37d4-c16a-4e8e-8fba-9021eac333b7","Type":"ContainerStarted","Data":"eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d"} Aug 02 11:13:13.415817 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:13.415530 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:13.432044 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:13.432000 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" podStartSLOduration=2.431986377 podStartE2EDuration="2.431986377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:13:13.430103067 +0000 UTC m=+2401.212458012" watchObservedRunningTime="2026-08-02 11:13:13.431986377 +0000 UTC m=+2401.214341355" Aug 02 11:13:18.452859 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:18.452816 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:13:24.422776 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:24.422746 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:13:54.636014 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:13:54.635925 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:14:10.837026 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:14:10.836988 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:17:25.435194 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:25.435164 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:17:27.858979 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:27.858945 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw"] Aug 02 11:17:27.859410 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:27.859161 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" podUID="646a37d4-c16a-4e8e-8fba-9021eac333b7" containerName="payload-processing" containerID="cri-o://eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d" gracePeriod=30 Aug 02 11:17:28.109435 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.109383 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:17:28.219088 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.219066 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/646a37d4-c16a-4e8e-8fba-9021eac333b7-plugins-config-volume\") pod \"646a37d4-c16a-4e8e-8fba-9021eac333b7\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " Aug 02 11:17:28.219238 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.219162 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68l4q\" (UniqueName: \"kubernetes.io/projected/646a37d4-c16a-4e8e-8fba-9021eac333b7-kube-api-access-68l4q\") pod \"646a37d4-c16a-4e8e-8fba-9021eac333b7\" (UID: \"646a37d4-c16a-4e8e-8fba-9021eac333b7\") " Aug 02 11:17:28.219409 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.219387 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646a37d4-c16a-4e8e-8fba-9021eac333b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "646a37d4-c16a-4e8e-8fba-9021eac333b7" (UID: "646a37d4-c16a-4e8e-8fba-9021eac333b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:17:28.221168 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.221145 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/646a37d4-c16a-4e8e-8fba-9021eac333b7-kube-api-access-68l4q" (OuterVolumeSpecName: "kube-api-access-68l4q") pod "646a37d4-c16a-4e8e-8fba-9021eac333b7" (UID: "646a37d4-c16a-4e8e-8fba-9021eac333b7"). InnerVolumeSpecName "kube-api-access-68l4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:17:28.319886 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.319860 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68l4q\" (UniqueName: \"kubernetes.io/projected/646a37d4-c16a-4e8e-8fba-9021eac333b7-kube-api-access-68l4q\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:17:28.319886 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.319881 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/646a37d4-c16a-4e8e-8fba-9021eac333b7-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:17:28.636576 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.636544 2554 generic.go:356] "Generic (PLEG): container finished" podID="646a37d4-c16a-4e8e-8fba-9021eac333b7" containerID="eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d" exitCode=0 Aug 02 11:17:28.636709 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.636588 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" Aug 02 11:17:28.636709 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.636608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" event={"ID":"646a37d4-c16a-4e8e-8fba-9021eac333b7","Type":"ContainerDied","Data":"eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d"} Aug 02 11:17:28.636709 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.636661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw" event={"ID":"646a37d4-c16a-4e8e-8fba-9021eac333b7","Type":"ContainerDied","Data":"c3d16a990a18836ff08919d8aa1988a57a0663ca3dd63d09d9691f64633ff516"} Aug 02 11:17:28.636709 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.636686 2554 scope.go:117] "RemoveContainer" containerID="eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d" Aug 02 11:17:28.645565 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.645547 2554 scope.go:117] "RemoveContainer" containerID="eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d" Aug 02 11:17:28.645796 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:17:28.645780 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d\": container with ID starting with eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d not found: ID does not exist" containerID="eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d" Aug 02 11:17:28.645848 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.645804 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d"} err="failed to get container status \"eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d\": rpc error: code = NotFound desc = could not find container \"eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d\": container with ID starting with eef020f813f7c745bdc426fb9082d89d52b52d8ebb24f05d085c5315197e648d not found: ID does not exist" Aug 02 11:17:28.657359 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.657339 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw"] Aug 02 11:17:28.667303 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:28.667286 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a9dd0457-7b975d5994-vgxqw"] Aug 02 11:17:30.667306 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:30.667274 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="646a37d4-c16a-4e8e-8fba-9021eac333b7" path="/var/lib/kubelet/pods/646a37d4-c16a-4e8e-8fba-9021eac333b7/volumes" Aug 02 11:17:31.134887 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:17:31.134854 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:18:12.812690 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:18:12.812661 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:18:12.816969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:18:12.816950 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:18:16.741331 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:18:16.741297 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:18:28.942909 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:18:28.942875 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:18:35.654472 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:18:35.654436 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:18:43.255573 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:18:43.255536 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:19:25.981463 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.981424 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g"] Aug 02 11:19:25.982087 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.981776 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646a37d4-c16a-4e8e-8fba-9021eac333b7" containerName="payload-processing" Aug 02 11:19:25.982087 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.981787 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="646a37d4-c16a-4e8e-8fba-9021eac333b7" containerName="payload-processing" Aug 02 11:19:25.982087 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.981849 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="646a37d4-c16a-4e8e-8fba-9021eac333b7" containerName="payload-processing" Aug 02 11:19:25.984997 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.984975 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:25.988663 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.988643 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-638e7f\"" Aug 02 11:19:25.988773 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:25.988757 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-638e7f-dockercfg-2q4rv\"" Aug 02 11:19:26.008040 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.008010 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g"] Aug 02 11:19:26.103319 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.103276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.103498 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.103420 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnfd9\" (UniqueName: \"kubernetes.io/projected/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-kube-api-access-hnfd9\") pod \"payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.204049 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.204018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnfd9\" (UniqueName: \"kubernetes.io/projected/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-kube-api-access-hnfd9\") pod \"payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.204261 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.204185 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.204846 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.204826 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.212143 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.212107 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnfd9\" (UniqueName: \"kubernetes.io/projected/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-kube-api-access-hnfd9\") pod \"payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.296156 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.296046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:26.427687 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:26.427658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g"] Aug 02 11:19:26.429740 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:19:26.429712 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00723d19_05ff_4d63_a3ed_8d9b2a3cec04.slice/crio-96337f724c180f97c382684120769498b1844806ba21909cd74dc63ca19cf568 WatchSource:0}: Error finding container 96337f724c180f97c382684120769498b1844806ba21909cd74dc63ca19cf568: Status 404 returned error can't find the container with id 96337f724c180f97c382684120769498b1844806ba21909cd74dc63ca19cf568 Aug 02 11:19:27.202630 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:27.202592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" event={"ID":"00723d19-05ff-4d63-a3ed-8d9b2a3cec04","Type":"ContainerStarted","Data":"a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb"} Aug 02 11:19:27.203016 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:27.202654 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" event={"ID":"00723d19-05ff-4d63-a3ed-8d9b2a3cec04","Type":"ContainerStarted","Data":"96337f724c180f97c382684120769498b1844806ba21909cd74dc63ca19cf568"} Aug 02 11:19:27.203016 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:27.202684 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:27.217512 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:27.217449 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" podStartSLOduration=2.217432912 podStartE2EDuration="2.217432912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:19:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:19:27.216634762 +0000 UTC m=+2774.998989727" watchObservedRunningTime="2026-08-02 11:19:27.217432912 +0000 UTC m=+2774.999787876" Aug 02 11:19:27.843675 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:27.843640 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:19:38.209374 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:38.209342 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:19:54.046202 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.046167 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv"] Aug 02 11:19:54.049532 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.049514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.051954 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.051935 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-66e93e\"" Aug 02 11:19:54.052050 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.051936 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-66e93e-dockercfg-l6qdd\"" Aug 02 11:19:54.060346 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.060322 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv"] Aug 02 11:19:54.092133 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.092099 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq"] Aug 02 11:19:54.095314 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.095297 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.104085 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.104061 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq"] Aug 02 11:19:54.169502 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.169473 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24a5dc78-d45c-4884-9f46-ca20cecb5137-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.169662 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.169559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wq8\" (UniqueName: \"kubernetes.io/projected/24a5dc78-d45c-4884-9f46-ca20cecb5137-kube-api-access-m9wq8\") pod \"payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.169662 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.169588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b29a256-57eb-4e58-84af-6c76c7f14e8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.169740 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.169655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84l9v\" (UniqueName: \"kubernetes.io/projected/1b29a256-57eb-4e58-84af-6c76c7f14e8a-kube-api-access-84l9v\") pod \"payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.270677 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.270641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84l9v\" (UniqueName: \"kubernetes.io/projected/1b29a256-57eb-4e58-84af-6c76c7f14e8a-kube-api-access-84l9v\") pod \"payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.270866 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.270688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24a5dc78-d45c-4884-9f46-ca20cecb5137-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.270866 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.270748 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wq8\" (UniqueName: \"kubernetes.io/projected/24a5dc78-d45c-4884-9f46-ca20cecb5137-kube-api-access-m9wq8\") pod \"payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.270866 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.270772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b29a256-57eb-4e58-84af-6c76c7f14e8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.271545 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.271520 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24a5dc78-d45c-4884-9f46-ca20cecb5137-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.271649 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.271526 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b29a256-57eb-4e58-84af-6c76c7f14e8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.278768 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.278738 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wq8\" (UniqueName: \"kubernetes.io/projected/24a5dc78-d45c-4884-9f46-ca20cecb5137-kube-api-access-m9wq8\") pod \"payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.278857 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.278741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84l9v\" (UniqueName: \"kubernetes.io/projected/1b29a256-57eb-4e58-84af-6c76c7f14e8a-kube-api-access-84l9v\") pod \"payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.360676 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.360594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:54.406068 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.406039 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:54.504875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.504838 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv"] Aug 02 11:19:54.508450 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:19:54.508420 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a5dc78_d45c_4884_9f46_ca20cecb5137.slice/crio-5e77b922d11af04cc587aa72388dd486b77ab0dd1592c3f30279190f93bd7784 WatchSource:0}: Error finding container 5e77b922d11af04cc587aa72388dd486b77ab0dd1592c3f30279190f93bd7784: Status 404 returned error can't find the container with id 5e77b922d11af04cc587aa72388dd486b77ab0dd1592c3f30279190f93bd7784 Aug 02 11:19:54.553208 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:54.553090 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq"] Aug 02 11:19:54.555403 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:19:54.555356 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b29a256_57eb_4e58_84af_6c76c7f14e8a.slice/crio-e58ec95c6a84e1e4a939327380a13ac4351e5295605ea5e5c9403e4720433174 WatchSource:0}: Error finding container e58ec95c6a84e1e4a939327380a13ac4351e5295605ea5e5c9403e4720433174: Status 404 returned error can't find the container with id e58ec95c6a84e1e4a939327380a13ac4351e5295605ea5e5c9403e4720433174 Aug 02 11:19:55.335973 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.335937 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" event={"ID":"24a5dc78-d45c-4884-9f46-ca20cecb5137","Type":"ContainerStarted","Data":"2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5"} Aug 02 11:19:55.336440 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.336004 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" event={"ID":"24a5dc78-d45c-4884-9f46-ca20cecb5137","Type":"ContainerStarted","Data":"5e77b922d11af04cc587aa72388dd486b77ab0dd1592c3f30279190f93bd7784"} Aug 02 11:19:55.336440 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.336036 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:19:55.337478 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.337451 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" event={"ID":"1b29a256-57eb-4e58-84af-6c76c7f14e8a","Type":"ContainerStarted","Data":"04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb"} Aug 02 11:19:55.337557 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.337498 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" event={"ID":"1b29a256-57eb-4e58-84af-6c76c7f14e8a","Type":"ContainerStarted","Data":"e58ec95c6a84e1e4a939327380a13ac4351e5295605ea5e5c9403e4720433174"} Aug 02 11:19:55.337557 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.337518 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:19:55.352678 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.352634 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" podStartSLOduration=1.352620871 podStartE2EDuration="1.352620871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:19:55.350799981 +0000 UTC m=+2803.133154939" watchObservedRunningTime="2026-08-02 11:19:55.352620871 +0000 UTC m=+2803.134975812" Aug 02 11:19:55.369370 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.369328 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" podStartSLOduration=1.369314501 podStartE2EDuration="1.369314501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:19:55.367697741 +0000 UTC m=+2803.150052706" watchObservedRunningTime="2026-08-02 11:19:55.369314501 +0000 UTC m=+2803.151669530" Aug 02 11:19:55.937663 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:19:55.937629 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:20:06.344812 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:20:06.344782 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:20:06.345304 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:20:06.344933 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:20:26.844524 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:20:26.844492 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:20:35.347107 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:20:35.347065 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:21:05.334151 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:05.334053 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:21:15.841110 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:15.841078 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:21:58.840327 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:58.840297 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g"] Aug 02 11:21:58.840849 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:58.840531 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" podUID="00723d19-05ff-4d63-a3ed-8d9b2a3cec04" containerName="payload-processing" containerID="cri-o://a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb" gracePeriod=30 Aug 02 11:21:59.092280 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.092228 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:21:59.236927 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.236899 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-plugins-config-volume\") pod \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " Aug 02 11:21:59.237050 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.236935 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnfd9\" (UniqueName: \"kubernetes.io/projected/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-kube-api-access-hnfd9\") pod \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\" (UID: \"00723d19-05ff-4d63-a3ed-8d9b2a3cec04\") " Aug 02 11:21:59.237336 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.237315 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00723d19-05ff-4d63-a3ed-8d9b2a3cec04" (UID: "00723d19-05ff-4d63-a3ed-8d9b2a3cec04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:21:59.238945 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.238926 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-kube-api-access-hnfd9" (OuterVolumeSpecName: "kube-api-access-hnfd9") pod "00723d19-05ff-4d63-a3ed-8d9b2a3cec04" (UID: "00723d19-05ff-4d63-a3ed-8d9b2a3cec04"). InnerVolumeSpecName "kube-api-access-hnfd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:21:59.338148 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.338109 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:21:59.338148 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.338144 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnfd9\" (UniqueName: \"kubernetes.io/projected/00723d19-05ff-4d63-a3ed-8d9b2a3cec04-kube-api-access-hnfd9\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:21:59.943133 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.943089 2554 generic.go:356] "Generic (PLEG): container finished" podID="00723d19-05ff-4d63-a3ed-8d9b2a3cec04" containerID="a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb" exitCode=0 Aug 02 11:21:59.943545 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.943145 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" Aug 02 11:21:59.943545 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.943155 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" event={"ID":"00723d19-05ff-4d63-a3ed-8d9b2a3cec04","Type":"ContainerDied","Data":"a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb"} Aug 02 11:21:59.943545 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.943211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g" event={"ID":"00723d19-05ff-4d63-a3ed-8d9b2a3cec04","Type":"ContainerDied","Data":"96337f724c180f97c382684120769498b1844806ba21909cd74dc63ca19cf568"} Aug 02 11:21:59.943545 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.943233 2554 scope.go:117] "RemoveContainer" containerID="a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb" Aug 02 11:21:59.952242 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.952222 2554 scope.go:117] "RemoveContainer" containerID="a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb" Aug 02 11:21:59.952506 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:21:59.952489 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb\": container with ID starting with a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb not found: ID does not exist" containerID="a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb" Aug 02 11:21:59.952556 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.952513 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb"} err="failed to get container status \"a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb\": rpc error: code = NotFound desc = could not find container \"a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb\": container with ID starting with a6a1c190ebb0ec4d11855432755f6c68b7f1ab71abbf6ada8946e54828983fbb not found: ID does not exist" Aug 02 11:21:59.963244 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.963223 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g"] Aug 02 11:21:59.965310 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:21:59.965286 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-638e7f-7899874868-dxc8g"] Aug 02 11:22:00.668393 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:00.668363 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00723d19-05ff-4d63-a3ed-8d9b2a3cec04" path="/var/lib/kubelet/pods/00723d19-05ff-4d63-a3ed-8d9b2a3cec04/volumes" Aug 02 11:22:02.235786 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:02.235753 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:22:07.336326 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:07.336281 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:22:42.684566 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:42.684534 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq"] Aug 02 11:22:42.685007 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:42.684755 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" podUID="1b29a256-57eb-4e58-84af-6c76c7f14e8a" containerName="payload-processing" containerID="cri-o://04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb" gracePeriod=30 Aug 02 11:22:42.688233 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:42.688198 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv"] Aug 02 11:22:42.688639 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:42.688609 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" podUID="24a5dc78-d45c-4884-9f46-ca20cecb5137" containerName="payload-pre-processing" containerID="cri-o://2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5" gracePeriod=30 Aug 02 11:22:42.947685 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:42.947662 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:22:42.957211 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:42.957193 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:22:43.074998 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.074968 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24a5dc78-d45c-4884-9f46-ca20cecb5137-plugins-config-volume\") pod \"24a5dc78-d45c-4884-9f46-ca20cecb5137\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " Aug 02 11:22:43.075152 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.075056 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84l9v\" (UniqueName: \"kubernetes.io/projected/1b29a256-57eb-4e58-84af-6c76c7f14e8a-kube-api-access-84l9v\") pod \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " Aug 02 11:22:43.075152 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.075102 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9wq8\" (UniqueName: \"kubernetes.io/projected/24a5dc78-d45c-4884-9f46-ca20cecb5137-kube-api-access-m9wq8\") pod \"24a5dc78-d45c-4884-9f46-ca20cecb5137\" (UID: \"24a5dc78-d45c-4884-9f46-ca20cecb5137\") " Aug 02 11:22:43.075273 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.075160 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b29a256-57eb-4e58-84af-6c76c7f14e8a-plugins-config-volume\") pod \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\" (UID: \"1b29a256-57eb-4e58-84af-6c76c7f14e8a\") " Aug 02 11:22:43.075511 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.075486 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a5dc78-d45c-4884-9f46-ca20cecb5137-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24a5dc78-d45c-4884-9f46-ca20cecb5137" (UID: "24a5dc78-d45c-4884-9f46-ca20cecb5137"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:22:43.075592 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.075522 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b29a256-57eb-4e58-84af-6c76c7f14e8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b29a256-57eb-4e58-84af-6c76c7f14e8a" (UID: "1b29a256-57eb-4e58-84af-6c76c7f14e8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:22:43.077092 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.077070 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a5dc78-d45c-4884-9f46-ca20cecb5137-kube-api-access-m9wq8" (OuterVolumeSpecName: "kube-api-access-m9wq8") pod "24a5dc78-d45c-4884-9f46-ca20cecb5137" (UID: "24a5dc78-d45c-4884-9f46-ca20cecb5137"). InnerVolumeSpecName "kube-api-access-m9wq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:22:43.077092 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.077080 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b29a256-57eb-4e58-84af-6c76c7f14e8a-kube-api-access-84l9v" (OuterVolumeSpecName: "kube-api-access-84l9v") pod "1b29a256-57eb-4e58-84af-6c76c7f14e8a" (UID: "1b29a256-57eb-4e58-84af-6c76c7f14e8a"). InnerVolumeSpecName "kube-api-access-84l9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:22:43.156941 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.156913 2554 generic.go:356] "Generic (PLEG): container finished" podID="24a5dc78-d45c-4884-9f46-ca20cecb5137" containerID="2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5" exitCode=0 Aug 02 11:22:43.157061 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.156959 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" Aug 02 11:22:43.157061 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.157004 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" event={"ID":"24a5dc78-d45c-4884-9f46-ca20cecb5137","Type":"ContainerDied","Data":"2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5"} Aug 02 11:22:43.157190 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.157070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv" event={"ID":"24a5dc78-d45c-4884-9f46-ca20cecb5137","Type":"ContainerDied","Data":"5e77b922d11af04cc587aa72388dd486b77ab0dd1592c3f30279190f93bd7784"} Aug 02 11:22:43.157190 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.157105 2554 scope.go:117] "RemoveContainer" containerID="2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5" Aug 02 11:22:43.158421 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.158390 2554 generic.go:356] "Generic (PLEG): container finished" podID="1b29a256-57eb-4e58-84af-6c76c7f14e8a" containerID="04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb" exitCode=0 Aug 02 11:22:43.158520 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.158424 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" Aug 02 11:22:43.158520 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.158458 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" event={"ID":"1b29a256-57eb-4e58-84af-6c76c7f14e8a","Type":"ContainerDied","Data":"04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb"} Aug 02 11:22:43.158520 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.158489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq" event={"ID":"1b29a256-57eb-4e58-84af-6c76c7f14e8a","Type":"ContainerDied","Data":"e58ec95c6a84e1e4a939327380a13ac4351e5295605ea5e5c9403e4720433174"} Aug 02 11:22:43.165772 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.165742 2554 scope.go:117] "RemoveContainer" containerID="2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5" Aug 02 11:22:43.166021 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:22:43.166003 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5\": container with ID starting with 2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5 not found: ID does not exist" containerID="2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5" Aug 02 11:22:43.166081 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.166028 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5"} err="failed to get container status \"2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5\": rpc error: code = NotFound desc = could not find container \"2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5\": container with ID starting with 2eb27bb0660a292e7d41b18209d285f3669d1133b50d7120bc7ceb27c34a85a5 not found: ID does not exist" Aug 02 11:22:43.166081 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.166045 2554 scope.go:117] "RemoveContainer" containerID="04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb" Aug 02 11:22:43.173578 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.173555 2554 scope.go:117] "RemoveContainer" containerID="04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb" Aug 02 11:22:43.173811 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:22:43.173789 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb\": container with ID starting with 04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb not found: ID does not exist" containerID="04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb" Aug 02 11:22:43.173863 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.173818 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb"} err="failed to get container status \"04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb\": rpc error: code = NotFound desc = could not find container \"04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb\": container with ID starting with 04c77c40b54b5378d358c2b57f6d241fb1e0a931e13b24fdc54a3f861a5116cb not found: ID does not exist" Aug 02 11:22:43.176211 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.176193 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24a5dc78-d45c-4884-9f46-ca20cecb5137-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:22:43.176284 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.176214 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84l9v\" (UniqueName: \"kubernetes.io/projected/1b29a256-57eb-4e58-84af-6c76c7f14e8a-kube-api-access-84l9v\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:22:43.176284 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.176227 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9wq8\" (UniqueName: \"kubernetes.io/projected/24a5dc78-d45c-4884-9f46-ca20cecb5137-kube-api-access-m9wq8\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:22:43.176284 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.176239 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b29a256-57eb-4e58-84af-6c76c7f14e8a-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:22:43.180527 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.180506 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq"] Aug 02 11:22:43.186701 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.186681 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-66e93e-7bbcbfb47b-p8dkq"] Aug 02 11:22:43.199897 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.199878 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv"] Aug 02 11:22:43.204317 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:43.204298 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-66e93e-847d9d79c6-m2hvv"] Aug 02 11:22:44.668735 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:44.668697 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b29a256-57eb-4e58-84af-6c76c7f14e8a" path="/var/lib/kubelet/pods/1b29a256-57eb-4e58-84af-6c76c7f14e8a/volumes" Aug 02 11:22:44.669165 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:44.669051 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a5dc78-d45c-4884-9f46-ca20cecb5137" path="/var/lib/kubelet/pods/24a5dc78-d45c-4884-9f46-ca20cecb5137/volumes" Aug 02 11:22:45.442280 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:45.442240 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:22:55.156459 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156423 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr"] Aug 02 11:22:55.156799 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156763 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00723d19-05ff-4d63-a3ed-8d9b2a3cec04" containerName="payload-processing" Aug 02 11:22:55.156799 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156774 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="00723d19-05ff-4d63-a3ed-8d9b2a3cec04" containerName="payload-processing" Aug 02 11:22:55.156799 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156785 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a5dc78-d45c-4884-9f46-ca20cecb5137" containerName="payload-pre-processing" Aug 02 11:22:55.156799 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156790 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a5dc78-d45c-4884-9f46-ca20cecb5137" containerName="payload-pre-processing" Aug 02 11:22:55.156969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156806 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b29a256-57eb-4e58-84af-6c76c7f14e8a" containerName="payload-processing" Aug 02 11:22:55.156969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156813 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b29a256-57eb-4e58-84af-6c76c7f14e8a" containerName="payload-processing" Aug 02 11:22:55.156969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156869 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a5dc78-d45c-4884-9f46-ca20cecb5137" containerName="payload-pre-processing" Aug 02 11:22:55.156969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156881 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="00723d19-05ff-4d63-a3ed-8d9b2a3cec04" containerName="payload-processing" Aug 02 11:22:55.156969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.156888 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b29a256-57eb-4e58-84af-6c76c7f14e8a" containerName="payload-processing" Aug 02 11:22:55.159618 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.159601 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.162142 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.162103 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-8cfbc4-dockercfg-htmn2\"" Aug 02 11:22:55.162240 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.162211 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-8cfbc4\"" Aug 02 11:22:55.167239 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.167174 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr"] Aug 02 11:22:55.182175 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.182150 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd"] Aug 02 11:22:55.185308 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.185294 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.194295 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.194275 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd"] Aug 02 11:22:55.270913 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.270886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9nhr\" (UniqueName: \"kubernetes.io/projected/1113a858-3b62-4898-bc06-4336085b98aa-kube-api-access-r9nhr\") pod \"payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.271090 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.270941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8x6m\" (UniqueName: \"kubernetes.io/projected/0407b69b-5fd2-4490-a653-3a32886c76aa-kube-api-access-t8x6m\") pod \"payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.271090 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.271015 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1113a858-3b62-4898-bc06-4336085b98aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.271090 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.271081 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0407b69b-5fd2-4490-a653-3a32886c76aa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.372005 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.371976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8x6m\" (UniqueName: \"kubernetes.io/projected/0407b69b-5fd2-4490-a653-3a32886c76aa-kube-api-access-t8x6m\") pod \"payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.372149 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.372022 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1113a858-3b62-4898-bc06-4336085b98aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.372149 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.372065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0407b69b-5fd2-4490-a653-3a32886c76aa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.372265 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.372169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9nhr\" (UniqueName: \"kubernetes.io/projected/1113a858-3b62-4898-bc06-4336085b98aa-kube-api-access-r9nhr\") pod \"payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.372766 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.372742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1113a858-3b62-4898-bc06-4336085b98aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.372845 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.372792 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0407b69b-5fd2-4490-a653-3a32886c76aa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.380017 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.379991 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9nhr\" (UniqueName: \"kubernetes.io/projected/1113a858-3b62-4898-bc06-4336085b98aa-kube-api-access-r9nhr\") pod \"payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.380113 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.380095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8x6m\" (UniqueName: \"kubernetes.io/projected/0407b69b-5fd2-4490-a653-3a32886c76aa-kube-api-access-t8x6m\") pod \"payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.470857 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.470831 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:55.495732 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.495711 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:55.611276 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.611241 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr"] Aug 02 11:22:55.613536 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:22:55.613505 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1113a858_3b62_4898_bc06_4336085b98aa.slice/crio-ff829211968199172788e3aeb8d9b4132d211801948f1d5a819af886beead07d WatchSource:0}: Error finding container ff829211968199172788e3aeb8d9b4132d211801948f1d5a819af886beead07d: Status 404 returned error can't find the container with id ff829211968199172788e3aeb8d9b4132d211801948f1d5a819af886beead07d Aug 02 11:22:55.633613 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:55.633586 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd"] Aug 02 11:22:55.635799 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:22:55.635779 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0407b69b_5fd2_4490_a653_3a32886c76aa.slice/crio-7fff7d563611b15782df9c5985a21c28d9d5548a2005cf59d5973ce717c18291 WatchSource:0}: Error finding container 7fff7d563611b15782df9c5985a21c28d9d5548a2005cf59d5973ce717c18291: Status 404 returned error can't find the container with id 7fff7d563611b15782df9c5985a21c28d9d5548a2005cf59d5973ce717c18291 Aug 02 11:22:56.228711 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.228671 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" event={"ID":"1113a858-3b62-4898-bc06-4336085b98aa","Type":"ContainerStarted","Data":"03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245"} Aug 02 11:22:56.229183 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.228736 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" event={"ID":"1113a858-3b62-4898-bc06-4336085b98aa","Type":"ContainerStarted","Data":"ff829211968199172788e3aeb8d9b4132d211801948f1d5a819af886beead07d"} Aug 02 11:22:56.229183 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.228765 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:22:56.230211 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.230187 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" event={"ID":"0407b69b-5fd2-4490-a653-3a32886c76aa","Type":"ContainerStarted","Data":"aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478"} Aug 02 11:22:56.230311 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.230226 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" event={"ID":"0407b69b-5fd2-4490-a653-3a32886c76aa","Type":"ContainerStarted","Data":"7fff7d563611b15782df9c5985a21c28d9d5548a2005cf59d5973ce717c18291"} Aug 02 11:22:56.230311 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.230299 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:22:56.260553 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.260509 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" podStartSLOduration=1.260496029 podStartE2EDuration="1.260496029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:22:56.259320583 +0000 UTC m=+2984.041675545" watchObservedRunningTime="2026-08-02 11:22:56.260496029 +0000 UTC m=+2984.042850991" Aug 02 11:22:56.261287 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.261263 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" podStartSLOduration=1.261256465 podStartE2EDuration="1.261256465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:22:56.243502044 +0000 UTC m=+2984.025857007" watchObservedRunningTime="2026-08-02 11:22:56.261256465 +0000 UTC m=+2984.043611406" Aug 02 11:22:56.743332 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:22:56.743306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:23:07.236111 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:07.236072 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:23:07.236498 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:07.236300 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:23:12.842752 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:12.842723 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:23:12.848645 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:12.848624 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:23:23.995539 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:23.995503 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7"] Aug 02 11:23:23.998843 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:23.998826 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.001257 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.001235 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5afe3e-dockercfg-pdfbz\"" Aug 02 11:23:24.001363 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.001242 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5afe3e\"" Aug 02 11:23:24.007011 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.006988 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7"] Aug 02 11:23:24.014893 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.014868 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vln8r\" (UniqueName: \"kubernetes.io/projected/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-kube-api-access-vln8r\") pod \"payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.014991 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.014925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.115404 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.115371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln8r\" (UniqueName: \"kubernetes.io/projected/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-kube-api-access-vln8r\") pod \"payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.115567 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.115449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.116129 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.116099 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.123069 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.123039 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vln8r\" (UniqueName: \"kubernetes.io/projected/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-kube-api-access-vln8r\") pod \"payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.309391 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.309335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:24.434091 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:24.434062 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7"] Aug 02 11:23:24.435942 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:23:24.435915 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8760fb75_a8e1_4a2c_9153_b3d88f812f1a.slice/crio-24b958b3cc670f184adcee6479174ff7644cee5bd3b73a1335290eaba3d782e8 WatchSource:0}: Error finding container 24b958b3cc670f184adcee6479174ff7644cee5bd3b73a1335290eaba3d782e8: Status 404 returned error can't find the container with id 24b958b3cc670f184adcee6479174ff7644cee5bd3b73a1335290eaba3d782e8 Aug 02 11:23:25.382521 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:25.382488 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" event={"ID":"8760fb75-a8e1-4a2c-9153-b3d88f812f1a","Type":"ContainerStarted","Data":"f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88"} Aug 02 11:23:25.382952 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:25.382538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" event={"ID":"8760fb75-a8e1-4a2c-9153-b3d88f812f1a","Type":"ContainerStarted","Data":"24b958b3cc670f184adcee6479174ff7644cee5bd3b73a1335290eaba3d782e8"} Aug 02 11:23:25.382952 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:25.382565 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:25.397132 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:25.397063 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" podStartSLOduration=2.397048886 podStartE2EDuration="2.397048886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:23:25.396313848 +0000 UTC m=+3013.178668812" watchObservedRunningTime="2026-08-02 11:23:25.397048886 +0000 UTC m=+3013.179403854" Aug 02 11:23:26.444004 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:26.443970 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:23:36.390582 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:36.390547 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:23:55.737176 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:55.737139 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd"] Aug 02 11:23:55.738032 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:55.737383 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" podUID="0407b69b-5fd2-4490-a653-3a32886c76aa" containerName="payload-processing" containerID="cri-o://aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478" gracePeriod=30 Aug 02 11:23:55.745195 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:55.745108 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr"] Aug 02 11:23:55.745379 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:55.745353 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" podUID="1113a858-3b62-4898-bc06-4336085b98aa" containerName="payload-pre-processing" containerID="cri-o://03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245" gracePeriod=30 Aug 02 11:23:56.011285 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.011262 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:23:56.014241 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.014213 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:23:56.060311 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060292 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8x6m\" (UniqueName: \"kubernetes.io/projected/0407b69b-5fd2-4490-a653-3a32886c76aa-kube-api-access-t8x6m\") pod \"0407b69b-5fd2-4490-a653-3a32886c76aa\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " Aug 02 11:23:56.060421 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060325 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1113a858-3b62-4898-bc06-4336085b98aa-plugins-config-volume\") pod \"1113a858-3b62-4898-bc06-4336085b98aa\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " Aug 02 11:23:56.060421 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060390 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9nhr\" (UniqueName: \"kubernetes.io/projected/1113a858-3b62-4898-bc06-4336085b98aa-kube-api-access-r9nhr\") pod \"1113a858-3b62-4898-bc06-4336085b98aa\" (UID: \"1113a858-3b62-4898-bc06-4336085b98aa\") " Aug 02 11:23:56.060508 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060486 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0407b69b-5fd2-4490-a653-3a32886c76aa-plugins-config-volume\") pod \"0407b69b-5fd2-4490-a653-3a32886c76aa\" (UID: \"0407b69b-5fd2-4490-a653-3a32886c76aa\") " Aug 02 11:23:56.060724 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060700 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1113a858-3b62-4898-bc06-4336085b98aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1113a858-3b62-4898-bc06-4336085b98aa" (UID: "1113a858-3b62-4898-bc06-4336085b98aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:23:56.060908 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060886 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1113a858-3b62-4898-bc06-4336085b98aa-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:23:56.060975 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.060893 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0407b69b-5fd2-4490-a653-3a32886c76aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0407b69b-5fd2-4490-a653-3a32886c76aa" (UID: "0407b69b-5fd2-4490-a653-3a32886c76aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:23:56.062924 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.062901 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1113a858-3b62-4898-bc06-4336085b98aa-kube-api-access-r9nhr" (OuterVolumeSpecName: "kube-api-access-r9nhr") pod "1113a858-3b62-4898-bc06-4336085b98aa" (UID: "1113a858-3b62-4898-bc06-4336085b98aa"). InnerVolumeSpecName "kube-api-access-r9nhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:23:56.062999 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.062937 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0407b69b-5fd2-4490-a653-3a32886c76aa-kube-api-access-t8x6m" (OuterVolumeSpecName: "kube-api-access-t8x6m") pod "0407b69b-5fd2-4490-a653-3a32886c76aa" (UID: "0407b69b-5fd2-4490-a653-3a32886c76aa"). InnerVolumeSpecName "kube-api-access-t8x6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:23:56.162162 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.162138 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0407b69b-5fd2-4490-a653-3a32886c76aa-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:23:56.162162 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.162159 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8x6m\" (UniqueName: \"kubernetes.io/projected/0407b69b-5fd2-4490-a653-3a32886c76aa-kube-api-access-t8x6m\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:23:56.162287 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.162167 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9nhr\" (UniqueName: \"kubernetes.io/projected/1113a858-3b62-4898-bc06-4336085b98aa-kube-api-access-r9nhr\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:23:56.538869 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.538837 2554 generic.go:356] "Generic (PLEG): container finished" podID="0407b69b-5fd2-4490-a653-3a32886c76aa" containerID="aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478" exitCode=0 Aug 02 11:23:56.538985 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.538884 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" Aug 02 11:23:56.538985 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.538918 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" event={"ID":"0407b69b-5fd2-4490-a653-3a32886c76aa","Type":"ContainerDied","Data":"aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478"} Aug 02 11:23:56.538985 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.538977 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd" event={"ID":"0407b69b-5fd2-4490-a653-3a32886c76aa","Type":"ContainerDied","Data":"7fff7d563611b15782df9c5985a21c28d9d5548a2005cf59d5973ce717c18291"} Aug 02 11:23:56.539183 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.539002 2554 scope.go:117] "RemoveContainer" containerID="aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478" Aug 02 11:23:56.540418 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.540397 2554 generic.go:356] "Generic (PLEG): container finished" podID="1113a858-3b62-4898-bc06-4336085b98aa" containerID="03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245" exitCode=0 Aug 02 11:23:56.540538 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.540429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" event={"ID":"1113a858-3b62-4898-bc06-4336085b98aa","Type":"ContainerDied","Data":"03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245"} Aug 02 11:23:56.540538 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.540443 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" Aug 02 11:23:56.540538 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.540477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr" event={"ID":"1113a858-3b62-4898-bc06-4336085b98aa","Type":"ContainerDied","Data":"ff829211968199172788e3aeb8d9b4132d211801948f1d5a819af886beead07d"} Aug 02 11:23:56.547770 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.547648 2554 scope.go:117] "RemoveContainer" containerID="aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478" Aug 02 11:23:56.547995 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:23:56.547925 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478\": container with ID starting with aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478 not found: ID does not exist" containerID="aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478" Aug 02 11:23:56.547995 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.547966 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478"} err="failed to get container status \"aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478\": rpc error: code = NotFound desc = could not find container \"aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478\": container with ID starting with aa373d7b3d4619d30208158697900dbc822ad3406e1d86dab6ec78ae454c0478 not found: ID does not exist" Aug 02 11:23:56.547995 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.547989 2554 scope.go:117] "RemoveContainer" containerID="03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245" Aug 02 11:23:56.555761 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.555743 2554 scope.go:117] "RemoveContainer" containerID="03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245" Aug 02 11:23:56.556015 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:23:56.555996 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245\": container with ID starting with 03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245 not found: ID does not exist" containerID="03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245" Aug 02 11:23:56.556094 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.556022 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245"} err="failed to get container status \"03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245\": rpc error: code = NotFound desc = could not find container \"03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245\": container with ID starting with 03da5224e243a2e461c84e25489e3a8c8626d52accef75fb3babf7800577b245 not found: ID does not exist" Aug 02 11:23:56.561965 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.561945 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr"] Aug 02 11:23:56.565497 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.565473 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8cfbc4-dc586cd44-gjfmr"] Aug 02 11:23:56.574652 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.574631 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd"] Aug 02 11:23:56.580603 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.580584 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8cfbc4-7cd4b9c688-ph6qd"] Aug 02 11:23:56.667904 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.667882 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0407b69b-5fd2-4490-a653-3a32886c76aa" path="/var/lib/kubelet/pods/0407b69b-5fd2-4490-a653-3a32886c76aa/volumes" Aug 02 11:23:56.668214 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:56.668200 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1113a858-3b62-4898-bc06-4336085b98aa" path="/var/lib/kubelet/pods/1113a858-3b62-4898-bc06-4336085b98aa/volumes" Aug 02 11:23:57.434017 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:23:57.433991 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:24:08.349485 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.349445 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7"] Aug 02 11:24:08.349950 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.349697 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" podUID="8760fb75-a8e1-4a2c-9153-b3d88f812f1a" containerName="payload-processing" containerID="cri-o://f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88" gracePeriod=30 Aug 02 11:24:08.595178 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.595156 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:24:08.600876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.600818 2554 generic.go:356] "Generic (PLEG): container finished" podID="8760fb75-a8e1-4a2c-9153-b3d88f812f1a" containerID="f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88" exitCode=0 Aug 02 11:24:08.600876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.600851 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" Aug 02 11:24:08.600876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.600866 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" event={"ID":"8760fb75-a8e1-4a2c-9153-b3d88f812f1a","Type":"ContainerDied","Data":"f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88"} Aug 02 11:24:08.601066 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.600919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7" event={"ID":"8760fb75-a8e1-4a2c-9153-b3d88f812f1a","Type":"ContainerDied","Data":"24b958b3cc670f184adcee6479174ff7644cee5bd3b73a1335290eaba3d782e8"} Aug 02 11:24:08.601066 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.600941 2554 scope.go:117] "RemoveContainer" containerID="f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88" Aug 02 11:24:08.608494 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.608479 2554 scope.go:117] "RemoveContainer" containerID="f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88" Aug 02 11:24:08.608740 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:24:08.608722 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88\": container with ID starting with f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88 not found: ID does not exist" containerID="f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88" Aug 02 11:24:08.608784 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.608748 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88"} err="failed to get container status \"f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88\": rpc error: code = NotFound desc = could not find container \"f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88\": container with ID starting with f484b566a15a19533093099587bf71c30c4a43f91a92cabeb4bb5fcf5a26ea88 not found: ID does not exist" Aug 02 11:24:08.662076 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.662046 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vln8r\" (UniqueName: \"kubernetes.io/projected/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-kube-api-access-vln8r\") pod \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " Aug 02 11:24:08.662233 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.662165 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-plugins-config-volume\") pod \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\" (UID: \"8760fb75-a8e1-4a2c-9153-b3d88f812f1a\") " Aug 02 11:24:08.662535 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.662511 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8760fb75-a8e1-4a2c-9153-b3d88f812f1a" (UID: "8760fb75-a8e1-4a2c-9153-b3d88f812f1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:24:08.664044 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.664018 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-kube-api-access-vln8r" (OuterVolumeSpecName: "kube-api-access-vln8r") pod "8760fb75-a8e1-4a2c-9153-b3d88f812f1a" (UID: "8760fb75-a8e1-4a2c-9153-b3d88f812f1a"). InnerVolumeSpecName "kube-api-access-vln8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:24:08.763331 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.763309 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:24:08.763410 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.763334 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vln8r\" (UniqueName: \"kubernetes.io/projected/8760fb75-a8e1-4a2c-9153-b3d88f812f1a-kube-api-access-vln8r\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:24:08.915611 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.915553 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7"] Aug 02 11:24:08.918660 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:08.918635 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5afe3e-565fcd77fb-n8nc7"] Aug 02 11:24:10.668242 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:10.668208 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8760fb75-a8e1-4a2c-9153-b3d88f812f1a" path="/var/lib/kubelet/pods/8760fb75-a8e1-4a2c-9153-b3d88f812f1a/volumes" Aug 02 11:24:11.145451 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:11.145413 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:24:20.667894 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.667860 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl"] Aug 02 11:24:20.668414 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668393 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1113a858-3b62-4898-bc06-4336085b98aa" containerName="payload-pre-processing" Aug 02 11:24:20.668493 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668417 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1113a858-3b62-4898-bc06-4336085b98aa" containerName="payload-pre-processing" Aug 02 11:24:20.668493 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668452 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0407b69b-5fd2-4490-a653-3a32886c76aa" containerName="payload-processing" Aug 02 11:24:20.668493 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668461 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0407b69b-5fd2-4490-a653-3a32886c76aa" containerName="payload-processing" Aug 02 11:24:20.668493 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668486 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8760fb75-a8e1-4a2c-9153-b3d88f812f1a" containerName="payload-processing" Aug 02 11:24:20.668676 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668495 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8760fb75-a8e1-4a2c-9153-b3d88f812f1a" containerName="payload-processing" Aug 02 11:24:20.668676 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668594 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0407b69b-5fd2-4490-a653-3a32886c76aa" containerName="payload-processing" Aug 02 11:24:20.668676 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668608 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8760fb75-a8e1-4a2c-9153-b3d88f812f1a" containerName="payload-processing" Aug 02 11:24:20.668676 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.668620 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1113a858-3b62-4898-bc06-4336085b98aa" containerName="payload-pre-processing" Aug 02 11:24:20.673028 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.673007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.675584 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.675561 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-3951f6-dockercfg-lvrjv\"" Aug 02 11:24:20.675584 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.675576 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-3951f6\"" Aug 02 11:24:20.679891 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.679864 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl"] Aug 02 11:24:20.695058 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.695025 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9"] Aug 02 11:24:20.698544 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.698522 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.708262 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.708240 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9"] Aug 02 11:24:20.770197 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.770159 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.770377 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.770266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2s9\" (UniqueName: \"kubernetes.io/projected/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-kube-api-access-6z2s9\") pod \"payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.870854 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.870819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.871032 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.870870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2s9\" (UniqueName: \"kubernetes.io/projected/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-kube-api-access-6z2s9\") pod \"payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.871032 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.870998 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvf4w\" (UniqueName: \"kubernetes.io/projected/c36e454f-a6b2-46ba-9e09-2bea467ff172-kube-api-access-rvf4w\") pod \"payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.871216 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.871088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c36e454f-a6b2-46ba-9e09-2bea467ff172-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.871614 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.871593 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.878105 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.878085 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2s9\" (UniqueName: \"kubernetes.io/projected/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-kube-api-access-6z2s9\") pod \"payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:20.971944 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.971912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c36e454f-a6b2-46ba-9e09-2bea467ff172-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.972103 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.972030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvf4w\" (UniqueName: \"kubernetes.io/projected/c36e454f-a6b2-46ba-9e09-2bea467ff172-kube-api-access-rvf4w\") pod \"payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.972634 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.972615 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c36e454f-a6b2-46ba-9e09-2bea467ff172-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.979657 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.979637 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvf4w\" (UniqueName: \"kubernetes.io/projected/c36e454f-a6b2-46ba-9e09-2bea467ff172-kube-api-access-rvf4w\") pod \"payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:20.984588 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:20.984568 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:21.009787 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.009759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:21.158213 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.158187 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9"] Aug 02 11:24:21.159930 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:24:21.159896 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36e454f_a6b2_46ba_9e09_2bea467ff172.slice/crio-a8bc609285b3c90e4b5fd6164a694740d872cea0aa6f820115a166a1747db56d WatchSource:0}: Error finding container a8bc609285b3c90e4b5fd6164a694740d872cea0aa6f820115a166a1747db56d: Status 404 returned error can't find the container with id a8bc609285b3c90e4b5fd6164a694740d872cea0aa6f820115a166a1747db56d Aug 02 11:24:21.333456 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.333428 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl"] Aug 02 11:24:21.335784 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:24:21.335757 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9f7f23_2fe6_4dbe_b7cc_9f57c4f6ce55.slice/crio-fa47230181c5e598c57dfd2d5042fd68958c449acad1f89256819b77866aabd3 WatchSource:0}: Error finding container fa47230181c5e598c57dfd2d5042fd68958c449acad1f89256819b77866aabd3: Status 404 returned error can't find the container with id fa47230181c5e598c57dfd2d5042fd68958c449acad1f89256819b77866aabd3 Aug 02 11:24:21.663622 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.663534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" event={"ID":"c36e454f-a6b2-46ba-9e09-2bea467ff172","Type":"ContainerStarted","Data":"72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7"} Aug 02 11:24:21.663622 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.663590 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" event={"ID":"c36e454f-a6b2-46ba-9e09-2bea467ff172","Type":"ContainerStarted","Data":"a8bc609285b3c90e4b5fd6164a694740d872cea0aa6f820115a166a1747db56d"} Aug 02 11:24:21.663835 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.663625 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:21.665025 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.664996 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" event={"ID":"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55","Type":"ContainerStarted","Data":"f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6"} Aug 02 11:24:21.665149 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.665053 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:21.665149 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.665071 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" event={"ID":"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55","Type":"ContainerStarted","Data":"fa47230181c5e598c57dfd2d5042fd68958c449acad1f89256819b77866aabd3"} Aug 02 11:24:21.678679 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.678631 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" podStartSLOduration=1.6786181980000001 podStartE2EDuration="1.678618198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:24:21.677480184 +0000 UTC m=+3069.459835146" watchObservedRunningTime="2026-08-02 11:24:21.678618198 +0000 UTC m=+3069.460973139" Aug 02 11:24:21.696538 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:21.696495 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" podStartSLOduration=1.696480671 podStartE2EDuration="1.696480671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:24:21.694677968 +0000 UTC m=+3069.477032932" watchObservedRunningTime="2026-08-02 11:24:21.696480671 +0000 UTC m=+3069.478835634" Aug 02 11:24:22.645195 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:22.645165 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:24:32.671342 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:32.671306 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:24:32.671791 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:32.671379 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:24:49.469066 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.469028 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4"] Aug 02 11:24:49.472769 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.472747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.475546 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.475525 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-4f1bb7-dockercfg-6s9kr\"" Aug 02 11:24:49.475651 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.475522 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-4f1bb7\"" Aug 02 11:24:49.483296 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.483276 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4"] Aug 02 11:24:49.524586 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.524556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnbn\" (UniqueName: \"kubernetes.io/projected/9f698cb3-8976-4a8c-b7b8-8d660c69accd-kube-api-access-rhnbn\") pod \"payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.524740 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.524604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f698cb3-8976-4a8c-b7b8-8d660c69accd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.626019 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.625984 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnbn\" (UniqueName: \"kubernetes.io/projected/9f698cb3-8976-4a8c-b7b8-8d660c69accd-kube-api-access-rhnbn\") pod \"payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.626208 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.626035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f698cb3-8976-4a8c-b7b8-8d660c69accd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.626705 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.626686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f698cb3-8976-4a8c-b7b8-8d660c69accd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.633828 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.633799 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnbn\" (UniqueName: \"kubernetes.io/projected/9f698cb3-8976-4a8c-b7b8-8d660c69accd-kube-api-access-rhnbn\") pod \"payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.785209 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.785103 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:49.915932 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:49.915908 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4"] Aug 02 11:24:49.918454 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:24:49.918416 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f698cb3_8976_4a8c_b7b8_8d660c69accd.slice/crio-1c44c5649d450bcc8ac6f6ed52ed285b8f26f87a7c96b24944f33161ef7f13f6 WatchSource:0}: Error finding container 1c44c5649d450bcc8ac6f6ed52ed285b8f26f87a7c96b24944f33161ef7f13f6: Status 404 returned error can't find the container with id 1c44c5649d450bcc8ac6f6ed52ed285b8f26f87a7c96b24944f33161ef7f13f6 Aug 02 11:24:50.805409 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:50.805377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" event={"ID":"9f698cb3-8976-4a8c-b7b8-8d660c69accd","Type":"ContainerStarted","Data":"bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3"} Aug 02 11:24:50.805811 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:50.805428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" event={"ID":"9f698cb3-8976-4a8c-b7b8-8d660c69accd","Type":"ContainerStarted","Data":"1c44c5649d450bcc8ac6f6ed52ed285b8f26f87a7c96b24944f33161ef7f13f6"} Aug 02 11:24:50.805811 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:50.805469 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:24:50.821086 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:50.821034 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" podStartSLOduration=1.8210167720000001 podStartE2EDuration="1.821016772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:24:50.82074406 +0000 UTC m=+3098.603099023" watchObservedRunningTime="2026-08-02 11:24:50.821016772 +0000 UTC m=+3098.603371735" Aug 02 11:24:52.238704 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:24:52.238659 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:25:01.812003 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:25:01.811975 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:25:28.442405 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:25:28.442376 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:25:55.138307 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:25:55.138265 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:26:23.039608 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:26:23.039572 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:26:38.743509 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:26:38.743475 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:26:49.341225 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:26:49.341191 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:27:04.739023 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:27:04.738990 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:27:15.344937 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:27:15.344901 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:27:31.239840 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:27:31.239805 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:27:46.434594 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:27:46.434561 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:27:56.740520 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:27:56.740490 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:28:12.735328 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:28:12.735294 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:28:12.871363 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:28:12.871341 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:28:12.878598 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:28:12.878576 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:28:26.150653 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:28:26.150612 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:28:36.345964 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:28:36.345882 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:28:52.736298 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:28:52.736264 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:29:07.945310 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:07.945275 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:29:19.642567 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:19.642530 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:29:34.135425 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:34.135388 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:29:44.436695 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:44.436657 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:29:50.044172 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.044143 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf"] Aug 02 11:29:50.051875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.051847 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.054915 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.054886 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"default-dockercfg-44xf5\"" Aug 02 11:29:50.055207 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.055175 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"sub-test-model-3951f6-kserve-self-signed-certs\"" Aug 02 11:29:50.055523 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.055497 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"kube-root-ca.crt\"" Aug 02 11:29:50.055706 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.055680 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"openshift-service-ca.crt\"" Aug 02 11:29:50.056628 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.056608 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf"] Aug 02 11:29:50.152576 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.152546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7pd\" (UniqueName: \"kubernetes.io/projected/b095f4d7-5d1c-464a-8c01-2ce035fff044-kube-api-access-zc7pd\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.152576 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.152579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-home\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.152779 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.152609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-dshm\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.152779 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.152628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-tmp-dir\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.152779 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.152741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-model-cache\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.152879 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.152779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b095f4d7-5d1c-464a-8c01-2ce035fff044-tls-certs\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254171 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-tmp-dir\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254355 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254210 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-model-cache\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254355 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b095f4d7-5d1c-464a-8c01-2ce035fff044-tls-certs\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254355 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7pd\" (UniqueName: \"kubernetes.io/projected/b095f4d7-5d1c-464a-8c01-2ce035fff044-kube-api-access-zc7pd\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254355 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254287 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-home\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254355 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-dshm\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254611 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254530 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-tmp-dir\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254611 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254592 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-model-cache\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.254688 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.254617 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-home\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.256468 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.256444 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-dshm\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.256621 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.256605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b095f4d7-5d1c-464a-8c01-2ce035fff044-tls-certs\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.261409 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.261388 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7pd\" (UniqueName: \"kubernetes.io/projected/b095f4d7-5d1c-464a-8c01-2ce035fff044-kube-api-access-zc7pd\") pod \"sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.363629 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.363559 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:29:50.488779 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:50.488731 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf"] Aug 02 11:29:50.491156 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:29:50.491088 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb095f4d7_5d1c_464a_8c01_2ce035fff044.slice/crio-0dc635a6c0ee96383299a683abdb5659c6e87466e5d0c0b542a366c74a92af9f WatchSource:0}: Error finding container 0dc635a6c0ee96383299a683abdb5659c6e87466e5d0c0b542a366c74a92af9f: Status 404 returned error can't find the container with id 0dc635a6c0ee96383299a683abdb5659c6e87466e5d0c0b542a366c74a92af9f Aug 02 11:29:51.224465 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:51.224389 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" event={"ID":"b095f4d7-5d1c-464a-8c01-2ce035fff044","Type":"ContainerStarted","Data":"eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b"} Aug 02 11:29:51.224844 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:51.224483 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" event={"ID":"b095f4d7-5d1c-464a-8c01-2ce035fff044","Type":"ContainerStarted","Data":"0dc635a6c0ee96383299a683abdb5659c6e87466e5d0c0b542a366c74a92af9f"} Aug 02 11:29:51.240282 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:51.240234 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" podStartSLOduration=1.240219742 podStartE2EDuration="1.240219742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:29:51.238965791 +0000 UTC m=+3399.021320766" watchObservedRunningTime="2026-08-02 11:29:51.240219742 +0000 UTC m=+3399.022574704" Aug 02 11:29:52.438459 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:29:52.438428 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:30:00.364631 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:30:00.364598 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:30:00.365016 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:30:00.364844 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:30:00.377225 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:30:00.377199 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:30:01.282957 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:30:01.282924 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:30:15.647834 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:30:15.647793 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:31:12.045283 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:12.045245 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:31:24.648544 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:24.648507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:31:35.746481 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:35.746403 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:31:39.802625 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:39.802583 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf"] Aug 02 11:31:46.841314 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:46.841282 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:31:53.039310 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:53.039276 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:31:54.821172 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:54.821092 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" podUID="b095f4d7-5d1c-464a-8c01-2ce035fff044" containerName="main" containerID="cri-o://eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b" gracePeriod=45 Aug 02 11:31:55.064097 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.064074 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:31:55.115155 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115084 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc7pd\" (UniqueName: \"kubernetes.io/projected/b095f4d7-5d1c-464a-8c01-2ce035fff044-kube-api-access-zc7pd\") pod \"b095f4d7-5d1c-464a-8c01-2ce035fff044\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " Aug 02 11:31:55.115155 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115136 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-home\") pod \"b095f4d7-5d1c-464a-8c01-2ce035fff044\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " Aug 02 11:31:55.115337 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115166 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-model-cache\") pod \"b095f4d7-5d1c-464a-8c01-2ce035fff044\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " Aug 02 11:31:55.115337 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115217 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b095f4d7-5d1c-464a-8c01-2ce035fff044-tls-certs\") pod \"b095f4d7-5d1c-464a-8c01-2ce035fff044\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " Aug 02 11:31:55.115337 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115245 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-dshm\") pod \"b095f4d7-5d1c-464a-8c01-2ce035fff044\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " Aug 02 11:31:55.115337 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115273 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-tmp-dir\") pod \"b095f4d7-5d1c-464a-8c01-2ce035fff044\" (UID: \"b095f4d7-5d1c-464a-8c01-2ce035fff044\") " Aug 02 11:31:55.115528 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115379 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-home" (OuterVolumeSpecName: "home") pod "b095f4d7-5d1c-464a-8c01-2ce035fff044" (UID: "b095f4d7-5d1c-464a-8c01-2ce035fff044"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 11:31:55.115528 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115476 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-model-cache" (OuterVolumeSpecName: "model-cache") pod "b095f4d7-5d1c-464a-8c01-2ce035fff044" (UID: "b095f4d7-5d1c-464a-8c01-2ce035fff044"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 11:31:55.115603 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115547 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b095f4d7-5d1c-464a-8c01-2ce035fff044" (UID: "b095f4d7-5d1c-464a-8c01-2ce035fff044"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 11:31:55.115665 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115616 2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-home\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:31:55.115665 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.115630 2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-model-cache\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:31:55.117316 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.117292 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b095f4d7-5d1c-464a-8c01-2ce035fff044-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b095f4d7-5d1c-464a-8c01-2ce035fff044" (UID: "b095f4d7-5d1c-464a-8c01-2ce035fff044"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 02 11:31:55.117398 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.117295 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-dshm" (OuterVolumeSpecName: "dshm") pod "b095f4d7-5d1c-464a-8c01-2ce035fff044" (UID: "b095f4d7-5d1c-464a-8c01-2ce035fff044"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 02 11:31:55.117434 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.117394 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b095f4d7-5d1c-464a-8c01-2ce035fff044-kube-api-access-zc7pd" (OuterVolumeSpecName: "kube-api-access-zc7pd") pod "b095f4d7-5d1c-464a-8c01-2ce035fff044" (UID: "b095f4d7-5d1c-464a-8c01-2ce035fff044"). InnerVolumeSpecName "kube-api-access-zc7pd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:31:55.216601 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.216575 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc7pd\" (UniqueName: \"kubernetes.io/projected/b095f4d7-5d1c-464a-8c01-2ce035fff044-kube-api-access-zc7pd\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:31:55.216601 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.216599 2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b095f4d7-5d1c-464a-8c01-2ce035fff044-tls-certs\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:31:55.216746 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.216610 2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-dshm\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:31:55.216746 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.216617 2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b095f4d7-5d1c-464a-8c01-2ce035fff044-tmp-dir\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:31:55.807176 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.807147 2554 generic.go:356] "Generic (PLEG): container finished" podID="b095f4d7-5d1c-464a-8c01-2ce035fff044" containerID="eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b" exitCode=0 Aug 02 11:31:55.807335 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.807191 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" Aug 02 11:31:55.807335 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.807226 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" event={"ID":"b095f4d7-5d1c-464a-8c01-2ce035fff044","Type":"ContainerDied","Data":"eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b"} Aug 02 11:31:55.807335 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.807255 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf" event={"ID":"b095f4d7-5d1c-464a-8c01-2ce035fff044","Type":"ContainerDied","Data":"0dc635a6c0ee96383299a683abdb5659c6e87466e5d0c0b542a366c74a92af9f"} Aug 02 11:31:55.807335 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.807270 2554 scope.go:117] "RemoveContainer" containerID="eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b" Aug 02 11:31:55.816094 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.816077 2554 scope.go:117] "RemoveContainer" containerID="eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b" Aug 02 11:31:55.816345 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:31:55.816326 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b\": container with ID starting with eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b not found: ID does not exist" containerID="eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b" Aug 02 11:31:55.816404 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.816353 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b"} err="failed to get container status \"eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b\": rpc error: code = NotFound desc = could not find container \"eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b\": container with ID starting with eed2ef968714d6b46e213701c1946dddc693f7ea6d5c7d821e0574cf789dc33b not found: ID does not exist" Aug 02 11:31:55.827642 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.827620 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf"] Aug 02 11:31:55.832638 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:55.832614 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/sub-test-model-3951f6-kserve-78bc97b7bc-tnlhf"] Aug 02 11:31:56.667850 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:31:56.667820 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b095f4d7-5d1c-464a-8c01-2ce035fff044" path="/var/lib/kubelet/pods/b095f4d7-5d1c-464a-8c01-2ce035fff044/volumes" Aug 02 11:32:25.044263 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:32:25.044234 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:32:58.243167 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:32:58.243109 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:33:10.838316 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:10.838284 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:33:12.899867 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:12.899836 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:33:12.908313 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:12.908294 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:33:23.733059 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:23.733027 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:33:32.940149 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:32.940103 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:33:54.903534 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.903504 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9"] Aug 02 11:33:54.903934 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.903876 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b095f4d7-5d1c-464a-8c01-2ce035fff044" containerName="main" Aug 02 11:33:54.903934 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.903887 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b095f4d7-5d1c-464a-8c01-2ce035fff044" containerName="main" Aug 02 11:33:54.904006 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.903956 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b095f4d7-5d1c-464a-8c01-2ce035fff044" containerName="main" Aug 02 11:33:54.907041 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.907025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:54.909472 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.909444 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-fe62c7-dockercfg-7sxzx\"" Aug 02 11:33:54.909614 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.909587 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-fe62c7\"" Aug 02 11:33:54.914715 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.914638 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9"] Aug 02 11:33:54.929151 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.929113 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9"] Aug 02 11:33:54.932427 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.932407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:54.942378 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.942355 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9"] Aug 02 11:33:54.969876 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.969849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhtf8\" (UniqueName: \"kubernetes.io/projected/9608f178-d0cb-4260-ab4e-a61aca50c673-kube-api-access-mhtf8\") pod \"payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:54.969977 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.969882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9608f178-d0cb-4260-ab4e-a61aca50c673-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:54.970022 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.969972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f0a952-9a2d-4155-8645-6539f3b12117-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:54.970022 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:54.970011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9zbh\" (UniqueName: \"kubernetes.io/projected/86f0a952-9a2d-4155-8645-6539f3b12117-kube-api-access-t9zbh\") pod \"payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:55.070797 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.070764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhtf8\" (UniqueName: \"kubernetes.io/projected/9608f178-d0cb-4260-ab4e-a61aca50c673-kube-api-access-mhtf8\") pod \"payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:55.070797 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.070799 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9608f178-d0cb-4260-ab4e-a61aca50c673-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:55.070993 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.070900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f0a952-9a2d-4155-8645-6539f3b12117-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:55.070993 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.070949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9zbh\" (UniqueName: \"kubernetes.io/projected/86f0a952-9a2d-4155-8645-6539f3b12117-kube-api-access-t9zbh\") pod \"payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:55.071749 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.071726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f0a952-9a2d-4155-8645-6539f3b12117-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:55.071801 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.071726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9608f178-d0cb-4260-ab4e-a61aca50c673-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:55.079100 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.079070 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhtf8\" (UniqueName: \"kubernetes.io/projected/9608f178-d0cb-4260-ab4e-a61aca50c673-kube-api-access-mhtf8\") pod \"payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:55.079240 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.079070 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9zbh\" (UniqueName: \"kubernetes.io/projected/86f0a952-9a2d-4155-8645-6539f3b12117-kube-api-access-t9zbh\") pod \"payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:55.218252 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.218229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:55.243246 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.243223 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:55.364642 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.364620 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9"] Aug 02 11:33:55.366836 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:33:55.366809 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9608f178_d0cb_4260_ab4e_a61aca50c673.slice/crio-c834f759513b99efb5a8328d2dfadbebd14657c0fb396ef216f261c0be341953 WatchSource:0}: Error finding container c834f759513b99efb5a8328d2dfadbebd14657c0fb396ef216f261c0be341953: Status 404 returned error can't find the container with id c834f759513b99efb5a8328d2dfadbebd14657c0fb396ef216f261c0be341953 Aug 02 11:33:55.383222 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.383179 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9"] Aug 02 11:33:55.400188 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.400163 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" event={"ID":"9608f178-d0cb-4260-ab4e-a61aca50c673","Type":"ContainerStarted","Data":"c834f759513b99efb5a8328d2dfadbebd14657c0fb396ef216f261c0be341953"} Aug 02 11:33:55.401258 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:55.401230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" event={"ID":"86f0a952-9a2d-4155-8645-6539f3b12117","Type":"ContainerStarted","Data":"00b3b30df77f727fd64cd8a12dbe021583bd9efdad5ef89ef5423d382c31fa90"} Aug 02 11:33:56.407413 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:56.407378 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" event={"ID":"86f0a952-9a2d-4155-8645-6539f3b12117","Type":"ContainerStarted","Data":"95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4"} Aug 02 11:33:56.407834 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:56.407530 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:33:56.409026 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:56.409001 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" event={"ID":"9608f178-d0cb-4260-ab4e-a61aca50c673","Type":"ContainerStarted","Data":"5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027"} Aug 02 11:33:56.409163 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:56.409043 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:33:56.423373 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:56.423331 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" podStartSLOduration=2.423316636 podStartE2EDuration="2.423316636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:33:56.422317706 +0000 UTC m=+3644.204672668" watchObservedRunningTime="2026-08-02 11:33:56.423316636 +0000 UTC m=+3644.205671600" Aug 02 11:33:56.437609 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:56.437565 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" podStartSLOduration=2.437553051 podStartE2EDuration="2.437553051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:33:56.435801516 +0000 UTC m=+3644.218156479" watchObservedRunningTime="2026-08-02 11:33:56.437553051 +0000 UTC m=+3644.219908013" Aug 02 11:33:57.541749 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:33:57.541716 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:34:07.416889 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:07.416859 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:34:07.417244 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:07.417036 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:34:24.212714 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.212674 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7"] Aug 02 11:34:24.216611 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.216594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.218817 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.218796 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9b1f20\"" Aug 02 11:34:24.218938 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.218842 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9b1f20-dockercfg-m7qpc\"" Aug 02 11:34:24.226471 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.226447 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7"] Aug 02 11:34:24.256211 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.256178 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj"] Aug 02 11:34:24.265234 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.260869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.270065 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.270039 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj"] Aug 02 11:34:24.338166 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.338109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgcz2\" (UniqueName: \"kubernetes.io/projected/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-kube-api-access-hgcz2\") pod \"payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.338341 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.338302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.439621 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.439584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srxvf\" (UniqueName: \"kubernetes.io/projected/9942dbac-1615-45d4-b2a9-7236990c51c8-kube-api-access-srxvf\") pod \"payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.439808 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.439631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.439808 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.439669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcz2\" (UniqueName: \"kubernetes.io/projected/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-kube-api-access-hgcz2\") pod \"payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.439808 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.439750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9942dbac-1615-45d4-b2a9-7236990c51c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.440797 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.440772 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.447639 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.447617 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgcz2\" (UniqueName: \"kubernetes.io/projected/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-kube-api-access-hgcz2\") pod \"payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.528476 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.528383 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:24.540838 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.540815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9942dbac-1615-45d4-b2a9-7236990c51c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.540947 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.540864 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srxvf\" (UniqueName: \"kubernetes.io/projected/9942dbac-1615-45d4-b2a9-7236990c51c8-kube-api-access-srxvf\") pod \"payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.541537 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.541516 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9942dbac-1615-45d4-b2a9-7236990c51c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.550557 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.550530 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srxvf\" (UniqueName: \"kubernetes.io/projected/9942dbac-1615-45d4-b2a9-7236990c51c8-kube-api-access-srxvf\") pod \"payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.577874 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.577714 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:24.673092 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.673056 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7"] Aug 02 11:34:24.676088 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:34:24.676060 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2d6ac2_af7f_484f_a9ca_7f39b4dbf2a5.slice/crio-ebf47b1ce1018da888fb9e6069f12fd12eeef82b5ad3ca0fb17200cc5a06d5d4 WatchSource:0}: Error finding container ebf47b1ce1018da888fb9e6069f12fd12eeef82b5ad3ca0fb17200cc5a06d5d4: Status 404 returned error can't find the container with id ebf47b1ce1018da888fb9e6069f12fd12eeef82b5ad3ca0fb17200cc5a06d5d4 Aug 02 11:34:24.730552 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:24.730528 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj"] Aug 02 11:34:24.732547 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:34:24.732521 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9942dbac_1615_45d4_b2a9_7236990c51c8.slice/crio-a9a0e4d5b9c522b5cbba2b704222f060bc117d16bedc087bbbcc06c048d446fe WatchSource:0}: Error finding container a9a0e4d5b9c522b5cbba2b704222f060bc117d16bedc087bbbcc06c048d446fe: Status 404 returned error can't find the container with id a9a0e4d5b9c522b5cbba2b704222f060bc117d16bedc087bbbcc06c048d446fe Aug 02 11:34:25.556655 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.556613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" event={"ID":"9942dbac-1615-45d4-b2a9-7236990c51c8","Type":"ContainerStarted","Data":"d720e389411620569aadf8e3485fa2b0582a6ec7391c27ebf36871105b48cbc1"} Aug 02 11:34:25.557111 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.556681 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:25.557111 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.556703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" event={"ID":"9942dbac-1615-45d4-b2a9-7236990c51c8","Type":"ContainerStarted","Data":"a9a0e4d5b9c522b5cbba2b704222f060bc117d16bedc087bbbcc06c048d446fe"} Aug 02 11:34:25.558184 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.558158 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" event={"ID":"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5","Type":"ContainerStarted","Data":"6201d2d9822a82a138458f6b179912ba0a8c7e4660eda6c51a2f3272e2614550"} Aug 02 11:34:25.558304 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.558205 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" event={"ID":"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5","Type":"ContainerStarted","Data":"ebf47b1ce1018da888fb9e6069f12fd12eeef82b5ad3ca0fb17200cc5a06d5d4"} Aug 02 11:34:25.558304 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.558227 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:25.574526 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.574478 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" podStartSLOduration=1.5744623180000001 podStartE2EDuration="1.574462318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:34:25.573317468 +0000 UTC m=+3673.355672433" watchObservedRunningTime="2026-08-02 11:34:25.574462318 +0000 UTC m=+3673.356817272" Aug 02 11:34:25.591755 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:25.591692 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" podStartSLOduration=1.5916738590000001 podStartE2EDuration="1.591673859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:34:25.591242966 +0000 UTC m=+3673.373597929" watchObservedRunningTime="2026-08-02 11:34:25.591673859 +0000 UTC m=+3673.374028823" Aug 02 11:34:27.237451 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:27.237413 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:34:36.565356 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:36.565271 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:34:36.565784 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:36.565654 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:34:54.416419 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:34:54.416343 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj_9942dbac-1615-45d4-b2a9-7236990c51c8/payload-processing/0.log" Aug 02 11:35:05.341358 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:05.341315 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:35:27.843223 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:27.843192 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:35:39.018736 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:39.018707 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9_86f0a952-9a2d-4155-8645-6539f3b12117/payload-processing/0.log" Aug 02 11:35:39.254490 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:39.254459 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj_9942dbac-1615-45d4-b2a9-7236990c51c8/payload-processing/0.log" Aug 02 11:35:44.504456 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.504420 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877"] Aug 02 11:35:44.508204 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.508187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.510748 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.510724 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-52c040-dockercfg-r4nfw\"" Aug 02 11:35:44.510883 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.510760 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-52c040\"" Aug 02 11:35:44.518504 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.518480 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877"] Aug 02 11:35:44.521275 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.521249 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9"] Aug 02 11:35:44.525354 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.525335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.531005 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.530984 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9"] Aug 02 11:35:44.676297 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.676266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdfg2\" (UniqueName: \"kubernetes.io/projected/44e60b21-b0ab-4faf-9e34-866e892b81ef-kube-api-access-xdfg2\") pod \"payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.676485 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.676323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqx52\" (UniqueName: \"kubernetes.io/projected/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-kube-api-access-mqx52\") pod \"payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.676485 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.676374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e60b21-b0ab-4faf-9e34-866e892b81ef-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.676608 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.676498 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.777559 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.777484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e60b21-b0ab-4faf-9e34-866e892b81ef-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.777559 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.777552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.777743 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.777612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdfg2\" (UniqueName: \"kubernetes.io/projected/44e60b21-b0ab-4faf-9e34-866e892b81ef-kube-api-access-xdfg2\") pod \"payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.777743 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.777677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqx52\" (UniqueName: \"kubernetes.io/projected/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-kube-api-access-mqx52\") pod \"payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.778183 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.778160 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e60b21-b0ab-4faf-9e34-866e892b81ef-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.778258 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.778216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.785096 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.785073 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdfg2\" (UniqueName: \"kubernetes.io/projected/44e60b21-b0ab-4faf-9e34-866e892b81ef-kube-api-access-xdfg2\") pod \"payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.785096 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.785092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqx52\" (UniqueName: \"kubernetes.io/projected/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-kube-api-access-mqx52\") pod \"payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.821082 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.821050 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:44.837388 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.837368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:44.961943 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.961900 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877"] Aug 02 11:35:44.964924 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:35:44.964889 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c24dc1_6e27_4c1e_a1e9_addce0298fd7.slice/crio-1fc1d958293a1d28c052f8401912f8bfcea11f70055db2ebce7426b8388c924b WatchSource:0}: Error finding container 1fc1d958293a1d28c052f8401912f8bfcea11f70055db2ebce7426b8388c924b: Status 404 returned error can't find the container with id 1fc1d958293a1d28c052f8401912f8bfcea11f70055db2ebce7426b8388c924b Aug 02 11:35:44.995253 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:44.995230 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9"] Aug 02 11:35:44.998316 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:35:44.998289 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e60b21_b0ab_4faf_9e34_866e892b81ef.slice/crio-e7c81bfc6b835fd0e8f331bde642a0087824650a32c22657eca17244edcb3ff1 WatchSource:0}: Error finding container e7c81bfc6b835fd0e8f331bde642a0087824650a32c22657eca17244edcb3ff1: Status 404 returned error can't find the container with id e7c81bfc6b835fd0e8f331bde642a0087824650a32c22657eca17244edcb3ff1 Aug 02 11:35:45.951332 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.951294 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" event={"ID":"44e60b21-b0ab-4faf-9e34-866e892b81ef","Type":"ContainerStarted","Data":"71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9"} Aug 02 11:35:45.951780 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.951356 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" event={"ID":"44e60b21-b0ab-4faf-9e34-866e892b81ef","Type":"ContainerStarted","Data":"e7c81bfc6b835fd0e8f331bde642a0087824650a32c22657eca17244edcb3ff1"} Aug 02 11:35:45.951780 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.951388 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:35:45.952749 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.952724 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" event={"ID":"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7","Type":"ContainerStarted","Data":"30a028e6329314e248af728ac75303394a2dda7c088027339c49ecbf72230e2c"} Aug 02 11:35:45.952858 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.952769 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" event={"ID":"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7","Type":"ContainerStarted","Data":"1fc1d958293a1d28c052f8401912f8bfcea11f70055db2ebce7426b8388c924b"} Aug 02 11:35:45.952858 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.952797 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:45.966726 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.966680 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" podStartSLOduration=1.966666223 podStartE2EDuration="1.966666223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:35:45.96522488 +0000 UTC m=+3753.747579843" watchObservedRunningTime="2026-08-02 11:35:45.966666223 +0000 UTC m=+3753.749021187" Aug 02 11:35:45.980459 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:45.980421 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" podStartSLOduration=1.9804105060000001 podStartE2EDuration="1.980410506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:35:45.97851244 +0000 UTC m=+3753.760867395" watchObservedRunningTime="2026-08-02 11:35:45.980410506 +0000 UTC m=+3753.762765468" Aug 02 11:35:49.341180 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:49.341110 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:35:56.959223 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:56.959190 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:35:56.959600 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:35:56.959270 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:36:08.793018 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:08.792984 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9"] Aug 02 11:36:08.793635 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:08.793227 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" podUID="44e60b21-b0ab-4faf-9e34-866e892b81ef" containerName="payload-processing" containerID="cri-o://71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9" gracePeriod=30 Aug 02 11:36:08.797061 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:08.797027 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877"] Aug 02 11:36:08.797294 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:08.797248 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" podUID="c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" containerName="payload-pre-processing" containerID="cri-o://30a028e6329314e248af728ac75303394a2dda7c088027339c49ecbf72230e2c" gracePeriod=30 Aug 02 11:36:09.056655 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.056632 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:36:09.070981 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.070956 2554 generic.go:356] "Generic (PLEG): container finished" podID="c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" containerID="30a028e6329314e248af728ac75303394a2dda7c088027339c49ecbf72230e2c" exitCode=0 Aug 02 11:36:09.071113 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.071018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" event={"ID":"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7","Type":"ContainerDied","Data":"30a028e6329314e248af728ac75303394a2dda7c088027339c49ecbf72230e2c"} Aug 02 11:36:09.071113 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.071087 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" event={"ID":"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7","Type":"ContainerDied","Data":"1fc1d958293a1d28c052f8401912f8bfcea11f70055db2ebce7426b8388c924b"} Aug 02 11:36:09.071246 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.071110 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fc1d958293a1d28c052f8401912f8bfcea11f70055db2ebce7426b8388c924b" Aug 02 11:36:09.073066 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.073042 2554 generic.go:356] "Generic (PLEG): container finished" podID="44e60b21-b0ab-4faf-9e34-866e892b81ef" containerID="71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9" exitCode=0 Aug 02 11:36:09.073223 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.073087 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" event={"ID":"44e60b21-b0ab-4faf-9e34-866e892b81ef","Type":"ContainerDied","Data":"71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9"} Aug 02 11:36:09.073223 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.073142 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" Aug 02 11:36:09.073223 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.073158 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9" event={"ID":"44e60b21-b0ab-4faf-9e34-866e892b81ef","Type":"ContainerDied","Data":"e7c81bfc6b835fd0e8f331bde642a0087824650a32c22657eca17244edcb3ff1"} Aug 02 11:36:09.073223 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.073191 2554 scope.go:117] "RemoveContainer" containerID="71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9" Aug 02 11:36:09.074299 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.074172 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:36:09.083512 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.083494 2554 scope.go:117] "RemoveContainer" containerID="71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9" Aug 02 11:36:09.083745 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:36:09.083726 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9\": container with ID starting with 71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9 not found: ID does not exist" containerID="71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9" Aug 02 11:36:09.083798 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.083757 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9"} err="failed to get container status \"71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9\": rpc error: code = NotFound desc = could not find container \"71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9\": container with ID starting with 71a594fb9bca338c11f2bebf4dd55643d5ec88015653574756e4091fea406ba9 not found: ID does not exist" Aug 02 11:36:09.107460 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.107424 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e60b21-b0ab-4faf-9e34-866e892b81ef-plugins-config-volume\") pod \"44e60b21-b0ab-4faf-9e34-866e892b81ef\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " Aug 02 11:36:09.107586 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.107547 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdfg2\" (UniqueName: \"kubernetes.io/projected/44e60b21-b0ab-4faf-9e34-866e892b81ef-kube-api-access-xdfg2\") pod \"44e60b21-b0ab-4faf-9e34-866e892b81ef\" (UID: \"44e60b21-b0ab-4faf-9e34-866e892b81ef\") " Aug 02 11:36:09.107839 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.107815 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e60b21-b0ab-4faf-9e34-866e892b81ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44e60b21-b0ab-4faf-9e34-866e892b81ef" (UID: "44e60b21-b0ab-4faf-9e34-866e892b81ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:36:09.109563 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.109538 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e60b21-b0ab-4faf-9e34-866e892b81ef-kube-api-access-xdfg2" (OuterVolumeSpecName: "kube-api-access-xdfg2") pod "44e60b21-b0ab-4faf-9e34-866e892b81ef" (UID: "44e60b21-b0ab-4faf-9e34-866e892b81ef"). InnerVolumeSpecName "kube-api-access-xdfg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:36:09.208617 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.208586 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-plugins-config-volume\") pod \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " Aug 02 11:36:09.208617 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.208619 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqx52\" (UniqueName: \"kubernetes.io/projected/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-kube-api-access-mqx52\") pod \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\" (UID: \"c2c24dc1-6e27-4c1e-a1e9-addce0298fd7\") " Aug 02 11:36:09.208813 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.208788 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdfg2\" (UniqueName: \"kubernetes.io/projected/44e60b21-b0ab-4faf-9e34-866e892b81ef-kube-api-access-xdfg2\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:09.208813 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.208798 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e60b21-b0ab-4faf-9e34-866e892b81ef-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:09.208908 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.208889 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" (UID: "c2c24dc1-6e27-4c1e-a1e9-addce0298fd7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:36:09.210567 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.210542 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-kube-api-access-mqx52" (OuterVolumeSpecName: "kube-api-access-mqx52") pod "c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" (UID: "c2c24dc1-6e27-4c1e-a1e9-addce0298fd7"). InnerVolumeSpecName "kube-api-access-mqx52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:36:09.309482 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.309425 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:09.309482 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.309447 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqx52\" (UniqueName: \"kubernetes.io/projected/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7-kube-api-access-mqx52\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:09.396126 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.396095 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9"] Aug 02 11:36:09.399562 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:09.399539 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-52c040-7dc9b58c64-qrhx9"] Aug 02 11:36:10.078629 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:10.078546 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877" Aug 02 11:36:10.099091 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:10.099066 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877"] Aug 02 11:36:10.102366 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:10.102346 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-52c040-cd696f744-5j877"] Aug 02 11:36:10.668461 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:10.668431 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44e60b21-b0ab-4faf-9e34-866e892b81ef" path="/var/lib/kubelet/pods/44e60b21-b0ab-4faf-9e34-866e892b81ef/volumes" Aug 02 11:36:10.668783 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:10.668771 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" path="/var/lib/kubelet/pods/c2c24dc1-6e27-4c1e-a1e9-addce0298fd7/volumes" Aug 02 11:36:11.936028 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:11.935995 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:36:23.545832 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:23.545799 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:36:24.162904 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.162868 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9"] Aug 02 11:36:24.163102 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.163076 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" podUID="86f0a952-9a2d-4155-8645-6539f3b12117" containerName="payload-processing" containerID="cri-o://95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4" gracePeriod=30 Aug 02 11:36:24.168271 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.168243 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9"] Aug 02 11:36:24.168504 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.168461 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" podUID="9608f178-d0cb-4260-ab4e-a61aca50c673" containerName="payload-pre-processing" containerID="cri-o://5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027" gracePeriod=30 Aug 02 11:36:24.451508 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.451484 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:36:24.454310 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.454292 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:36:24.537576 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.537551 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9608f178-d0cb-4260-ab4e-a61aca50c673-plugins-config-volume\") pod \"9608f178-d0cb-4260-ab4e-a61aca50c673\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " Aug 02 11:36:24.537723 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.537586 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9zbh\" (UniqueName: \"kubernetes.io/projected/86f0a952-9a2d-4155-8645-6539f3b12117-kube-api-access-t9zbh\") pod \"86f0a952-9a2d-4155-8645-6539f3b12117\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " Aug 02 11:36:24.537723 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.537635 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f0a952-9a2d-4155-8645-6539f3b12117-plugins-config-volume\") pod \"86f0a952-9a2d-4155-8645-6539f3b12117\" (UID: \"86f0a952-9a2d-4155-8645-6539f3b12117\") " Aug 02 11:36:24.537723 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.537657 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhtf8\" (UniqueName: \"kubernetes.io/projected/9608f178-d0cb-4260-ab4e-a61aca50c673-kube-api-access-mhtf8\") pod \"9608f178-d0cb-4260-ab4e-a61aca50c673\" (UID: \"9608f178-d0cb-4260-ab4e-a61aca50c673\") " Aug 02 11:36:24.537945 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.537920 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9608f178-d0cb-4260-ab4e-a61aca50c673-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9608f178-d0cb-4260-ab4e-a61aca50c673" (UID: "9608f178-d0cb-4260-ab4e-a61aca50c673"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:36:24.537984 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.537956 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f0a952-9a2d-4155-8645-6539f3b12117-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86f0a952-9a2d-4155-8645-6539f3b12117" (UID: "86f0a952-9a2d-4155-8645-6539f3b12117"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:36:24.539707 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.539683 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9608f178-d0cb-4260-ab4e-a61aca50c673-kube-api-access-mhtf8" (OuterVolumeSpecName: "kube-api-access-mhtf8") pod "9608f178-d0cb-4260-ab4e-a61aca50c673" (UID: "9608f178-d0cb-4260-ab4e-a61aca50c673"). InnerVolumeSpecName "kube-api-access-mhtf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:36:24.539774 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.539750 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f0a952-9a2d-4155-8645-6539f3b12117-kube-api-access-t9zbh" (OuterVolumeSpecName: "kube-api-access-t9zbh") pod "86f0a952-9a2d-4155-8645-6539f3b12117" (UID: "86f0a952-9a2d-4155-8645-6539f3b12117"). InnerVolumeSpecName "kube-api-access-t9zbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:36:24.639065 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.639035 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f0a952-9a2d-4155-8645-6539f3b12117-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:24.639065 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.639060 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhtf8\" (UniqueName: \"kubernetes.io/projected/9608f178-d0cb-4260-ab4e-a61aca50c673-kube-api-access-mhtf8\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:24.639065 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.639069 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9608f178-d0cb-4260-ab4e-a61aca50c673-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:24.639496 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:24.639081 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9zbh\" (UniqueName: \"kubernetes.io/projected/86f0a952-9a2d-4155-8645-6539f3b12117-kube-api-access-t9zbh\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:36:25.152339 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.152307 2554 generic.go:356] "Generic (PLEG): container finished" podID="86f0a952-9a2d-4155-8645-6539f3b12117" containerID="95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4" exitCode=0 Aug 02 11:36:25.152530 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.152355 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" Aug 02 11:36:25.152530 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.152385 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" event={"ID":"86f0a952-9a2d-4155-8645-6539f3b12117","Type":"ContainerDied","Data":"95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4"} Aug 02 11:36:25.152530 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.152435 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9" event={"ID":"86f0a952-9a2d-4155-8645-6539f3b12117","Type":"ContainerDied","Data":"00b3b30df77f727fd64cd8a12dbe021583bd9efdad5ef89ef5423d382c31fa90"} Aug 02 11:36:25.152530 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.152460 2554 scope.go:117] "RemoveContainer" containerID="95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4" Aug 02 11:36:25.153841 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.153816 2554 generic.go:356] "Generic (PLEG): container finished" podID="9608f178-d0cb-4260-ab4e-a61aca50c673" containerID="5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027" exitCode=0 Aug 02 11:36:25.153970 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.153849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" event={"ID":"9608f178-d0cb-4260-ab4e-a61aca50c673","Type":"ContainerDied","Data":"5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027"} Aug 02 11:36:25.153970 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.153866 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" Aug 02 11:36:25.153970 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.153892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9" event={"ID":"9608f178-d0cb-4260-ab4e-a61aca50c673","Type":"ContainerDied","Data":"c834f759513b99efb5a8328d2dfadbebd14657c0fb396ef216f261c0be341953"} Aug 02 11:36:25.161003 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.160928 2554 scope.go:117] "RemoveContainer" containerID="95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4" Aug 02 11:36:25.161223 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:36:25.161206 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4\": container with ID starting with 95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4 not found: ID does not exist" containerID="95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4" Aug 02 11:36:25.161283 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.161229 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4"} err="failed to get container status \"95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4\": rpc error: code = NotFound desc = could not find container \"95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4\": container with ID starting with 95b0be27768951dd5cb723346e044fa17f952b1b372094b4f454877cbe86bfc4 not found: ID does not exist" Aug 02 11:36:25.161283 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.161244 2554 scope.go:117] "RemoveContainer" containerID="5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027" Aug 02 11:36:25.171393 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.170985 2554 scope.go:117] "RemoveContainer" containerID="5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027" Aug 02 11:36:25.171393 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:36:25.171354 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027\": container with ID starting with 5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027 not found: ID does not exist" containerID="5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027" Aug 02 11:36:25.171563 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.171393 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027"} err="failed to get container status \"5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027\": rpc error: code = NotFound desc = could not find container \"5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027\": container with ID starting with 5af8ae4c44e1b352c15d4bc1a1c36af8f6bd4a6499bd0254346f20eaef1f2027 not found: ID does not exist" Aug 02 11:36:25.173579 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.173556 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9"] Aug 02 11:36:25.177106 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.177081 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-fe62c7-6d88cd4d68-rk4p9"] Aug 02 11:36:25.186267 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.186249 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9"] Aug 02 11:36:25.189785 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:25.189765 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-fe62c7-548d4d8fd8-vpll9"] Aug 02 11:36:26.667705 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:26.667675 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f0a952-9a2d-4155-8645-6539f3b12117" path="/var/lib/kubelet/pods/86f0a952-9a2d-4155-8645-6539f3b12117/volumes" Aug 02 11:36:26.668053 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:26.668008 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9608f178-d0cb-4260-ab4e-a61aca50c673" path="/var/lib/kubelet/pods/9608f178-d0cb-4260-ab4e-a61aca50c673/volumes" Aug 02 11:36:30.437421 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:36:30.437387 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:37:14.176162 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.176106 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj"] Aug 02 11:37:14.176884 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.176416 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" podUID="9942dbac-1615-45d4-b2a9-7236990c51c8" containerName="payload-processing" containerID="cri-o://d720e389411620569aadf8e3485fa2b0582a6ec7391c27ebf36871105b48cbc1" gracePeriod=30 Aug 02 11:37:14.184281 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.184254 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7"] Aug 02 11:37:14.184562 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.184535 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" podUID="1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" containerName="payload-pre-processing" containerID="cri-o://6201d2d9822a82a138458f6b179912ba0a8c7e4660eda6c51a2f3272e2614550" gracePeriod=30 Aug 02 11:37:14.409832 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.409644 2554 generic.go:356] "Generic (PLEG): container finished" podID="9942dbac-1615-45d4-b2a9-7236990c51c8" containerID="d720e389411620569aadf8e3485fa2b0582a6ec7391c27ebf36871105b48cbc1" exitCode=0 Aug 02 11:37:14.409832 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.409754 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" event={"ID":"9942dbac-1615-45d4-b2a9-7236990c51c8","Type":"ContainerDied","Data":"d720e389411620569aadf8e3485fa2b0582a6ec7391c27ebf36871105b48cbc1"} Aug 02 11:37:14.412261 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.412232 2554 generic.go:356] "Generic (PLEG): container finished" podID="1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" containerID="6201d2d9822a82a138458f6b179912ba0a8c7e4660eda6c51a2f3272e2614550" exitCode=0 Aug 02 11:37:14.412479 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.412335 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" event={"ID":"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5","Type":"ContainerDied","Data":"6201d2d9822a82a138458f6b179912ba0a8c7e4660eda6c51a2f3272e2614550"} Aug 02 11:37:14.478192 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.478169 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:37:14.481282 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.481264 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:37:14.534021 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.533993 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9942dbac-1615-45d4-b2a9-7236990c51c8-plugins-config-volume\") pod \"9942dbac-1615-45d4-b2a9-7236990c51c8\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " Aug 02 11:37:14.534162 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534044 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgcz2\" (UniqueName: \"kubernetes.io/projected/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-kube-api-access-hgcz2\") pod \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " Aug 02 11:37:14.534162 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534109 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-plugins-config-volume\") pod \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\" (UID: \"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5\") " Aug 02 11:37:14.534285 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534269 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srxvf\" (UniqueName: \"kubernetes.io/projected/9942dbac-1615-45d4-b2a9-7236990c51c8-kube-api-access-srxvf\") pod \"9942dbac-1615-45d4-b2a9-7236990c51c8\" (UID: \"9942dbac-1615-45d4-b2a9-7236990c51c8\") " Aug 02 11:37:14.534443 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534419 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" (UID: "1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:37:14.534443 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534430 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9942dbac-1615-45d4-b2a9-7236990c51c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9942dbac-1615-45d4-b2a9-7236990c51c8" (UID: "9942dbac-1615-45d4-b2a9-7236990c51c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:37:14.534581 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534548 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:14.534581 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.534560 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9942dbac-1615-45d4-b2a9-7236990c51c8-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:14.536054 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.536035 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-kube-api-access-hgcz2" (OuterVolumeSpecName: "kube-api-access-hgcz2") pod "1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" (UID: "1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5"). InnerVolumeSpecName "kube-api-access-hgcz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:37:14.536151 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.536134 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9942dbac-1615-45d4-b2a9-7236990c51c8-kube-api-access-srxvf" (OuterVolumeSpecName: "kube-api-access-srxvf") pod "9942dbac-1615-45d4-b2a9-7236990c51c8" (UID: "9942dbac-1615-45d4-b2a9-7236990c51c8"). InnerVolumeSpecName "kube-api-access-srxvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:37:14.634969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.634945 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srxvf\" (UniqueName: \"kubernetes.io/projected/9942dbac-1615-45d4-b2a9-7236990c51c8-kube-api-access-srxvf\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:14.634969 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:14.634969 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgcz2\" (UniqueName: \"kubernetes.io/projected/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5-kube-api-access-hgcz2\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:15.418365 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.418331 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" Aug 02 11:37:15.418758 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.418338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj" event={"ID":"9942dbac-1615-45d4-b2a9-7236990c51c8","Type":"ContainerDied","Data":"a9a0e4d5b9c522b5cbba2b704222f060bc117d16bedc087bbbcc06c048d446fe"} Aug 02 11:37:15.418758 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.418471 2554 scope.go:117] "RemoveContainer" containerID="d720e389411620569aadf8e3485fa2b0582a6ec7391c27ebf36871105b48cbc1" Aug 02 11:37:15.419938 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.419915 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" event={"ID":"1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5","Type":"ContainerDied","Data":"ebf47b1ce1018da888fb9e6069f12fd12eeef82b5ad3ca0fb17200cc5a06d5d4"} Aug 02 11:37:15.420038 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.419928 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7" Aug 02 11:37:15.427078 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.427063 2554 scope.go:117] "RemoveContainer" containerID="6201d2d9822a82a138458f6b179912ba0a8c7e4660eda6c51a2f3272e2614550" Aug 02 11:37:15.437532 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.437510 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7"] Aug 02 11:37:15.442056 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.442035 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b1f20-7c7468c984-rw6s7"] Aug 02 11:37:15.450934 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.450913 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj"] Aug 02 11:37:15.454139 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:15.454107 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9b1f20-fc498655b-zlxwj"] Aug 02 11:37:16.668040 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:16.668005 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" path="/var/lib/kubelet/pods/1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5/volumes" Aug 02 11:37:16.668471 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:16.668419 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9942dbac-1615-45d4-b2a9-7236990c51c8" path="/var/lib/kubelet/pods/9942dbac-1615-45d4-b2a9-7236990c51c8/volumes" Aug 02 11:37:17.746444 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:17.746413 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:37:21.800762 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:21.800729 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9"] Aug 02 11:37:21.801184 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:21.801016 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" podUID="c36e454f-a6b2-46ba-9e09-2bea467ff172" containerName="payload-processing" containerID="cri-o://72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7" gracePeriod=30 Aug 02 11:37:21.807461 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:21.807382 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl"] Aug 02 11:37:21.807654 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:21.807609 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" podUID="9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" containerName="payload-pre-processing" containerID="cri-o://f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6" gracePeriod=30 Aug 02 11:37:22.081327 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.081303 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:37:22.084143 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.084110 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:37:22.202967 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.202942 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-plugins-config-volume\") pod \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " Aug 02 11:37:22.202967 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.202971 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z2s9\" (UniqueName: \"kubernetes.io/projected/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-kube-api-access-6z2s9\") pod \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\" (UID: \"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55\") " Aug 02 11:37:22.203185 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.203065 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvf4w\" (UniqueName: \"kubernetes.io/projected/c36e454f-a6b2-46ba-9e09-2bea467ff172-kube-api-access-rvf4w\") pod \"c36e454f-a6b2-46ba-9e09-2bea467ff172\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " Aug 02 11:37:22.203185 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.203098 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c36e454f-a6b2-46ba-9e09-2bea467ff172-plugins-config-volume\") pod \"c36e454f-a6b2-46ba-9e09-2bea467ff172\" (UID: \"c36e454f-a6b2-46ba-9e09-2bea467ff172\") " Aug 02 11:37:22.203306 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.203283 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" (UID: "9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:37:22.203388 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.203376 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:22.203596 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.203568 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c36e454f-a6b2-46ba-9e09-2bea467ff172-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c36e454f-a6b2-46ba-9e09-2bea467ff172" (UID: "c36e454f-a6b2-46ba-9e09-2bea467ff172"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:37:22.205179 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.205152 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c36e454f-a6b2-46ba-9e09-2bea467ff172-kube-api-access-rvf4w" (OuterVolumeSpecName: "kube-api-access-rvf4w") pod "c36e454f-a6b2-46ba-9e09-2bea467ff172" (UID: "c36e454f-a6b2-46ba-9e09-2bea467ff172"). InnerVolumeSpecName "kube-api-access-rvf4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:37:22.205276 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.205238 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-kube-api-access-6z2s9" (OuterVolumeSpecName: "kube-api-access-6z2s9") pod "9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" (UID: "9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55"). InnerVolumeSpecName "kube-api-access-6z2s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:37:22.303991 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.303936 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z2s9\" (UniqueName: \"kubernetes.io/projected/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55-kube-api-access-6z2s9\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:22.303991 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.303956 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvf4w\" (UniqueName: \"kubernetes.io/projected/c36e454f-a6b2-46ba-9e09-2bea467ff172-kube-api-access-rvf4w\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:22.303991 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.303967 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c36e454f-a6b2-46ba-9e09-2bea467ff172-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:22.456678 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.456646 2554 generic.go:356] "Generic (PLEG): container finished" podID="c36e454f-a6b2-46ba-9e09-2bea467ff172" containerID="72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7" exitCode=0 Aug 02 11:37:22.456826 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.456688 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" Aug 02 11:37:22.456826 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.456728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" event={"ID":"c36e454f-a6b2-46ba-9e09-2bea467ff172","Type":"ContainerDied","Data":"72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7"} Aug 02 11:37:22.456826 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.456785 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9" event={"ID":"c36e454f-a6b2-46ba-9e09-2bea467ff172","Type":"ContainerDied","Data":"a8bc609285b3c90e4b5fd6164a694740d872cea0aa6f820115a166a1747db56d"} Aug 02 11:37:22.456826 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.456817 2554 scope.go:117] "RemoveContainer" containerID="72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7" Aug 02 11:37:22.458484 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.458460 2554 generic.go:356] "Generic (PLEG): container finished" podID="9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" containerID="f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6" exitCode=0 Aug 02 11:37:22.458614 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.458500 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" Aug 02 11:37:22.458614 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.458552 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" event={"ID":"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55","Type":"ContainerDied","Data":"f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6"} Aug 02 11:37:22.458614 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.458602 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl" event={"ID":"9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55","Type":"ContainerDied","Data":"fa47230181c5e598c57dfd2d5042fd68958c449acad1f89256819b77866aabd3"} Aug 02 11:37:22.466576 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.466556 2554 scope.go:117] "RemoveContainer" containerID="72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7" Aug 02 11:37:22.466860 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:37:22.466837 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7\": container with ID starting with 72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7 not found: ID does not exist" containerID="72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7" Aug 02 11:37:22.466956 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.466868 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7"} err="failed to get container status \"72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7\": rpc error: code = NotFound desc = could not find container \"72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7\": container with ID starting with 72b0cda48097b324a4283e5c9140bde0c6ddc48ac789858cd0db14295beff2f7 not found: ID does not exist" Aug 02 11:37:22.466956 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.466892 2554 scope.go:117] "RemoveContainer" containerID="f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6" Aug 02 11:37:22.474312 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.474293 2554 scope.go:117] "RemoveContainer" containerID="f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6" Aug 02 11:37:22.474535 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:37:22.474518 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6\": container with ID starting with f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6 not found: ID does not exist" containerID="f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6" Aug 02 11:37:22.474602 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.474541 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6"} err="failed to get container status \"f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6\": rpc error: code = NotFound desc = could not find container \"f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6\": container with ID starting with f5756c05c48f807427f1ad52602f11bc84b1bdf6b96f94c2cfb3f887b1b730f6 not found: ID does not exist" Aug 02 11:37:22.481810 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.481791 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9"] Aug 02 11:37:22.486935 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.486916 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3951f6-5d5f445f74-2k9j9"] Aug 02 11:37:22.496314 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.496294 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl"] Aug 02 11:37:22.500101 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.500080 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3951f6-c597d5976-gbkvl"] Aug 02 11:37:22.668585 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.668527 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" path="/var/lib/kubelet/pods/9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55/volumes" Aug 02 11:37:22.668873 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:22.668860 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c36e454f-a6b2-46ba-9e09-2bea467ff172" path="/var/lib/kubelet/pods/c36e454f-a6b2-46ba-9e09-2bea467ff172/volumes" Aug 02 11:37:23.411386 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:23.411361 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:37:29.741932 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:29.741898 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4"] Aug 02 11:37:29.742425 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:29.742181 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" podUID="9f698cb3-8976-4a8c-b7b8-8d660c69accd" containerName="payload-pre-processing" containerID="cri-o://bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3" gracePeriod=30 Aug 02 11:37:29.991880 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:29.991856 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:37:30.170926 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.170855 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f698cb3-8976-4a8c-b7b8-8d660c69accd-plugins-config-volume\") pod \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " Aug 02 11:37:30.170926 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.170906 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhnbn\" (UniqueName: \"kubernetes.io/projected/9f698cb3-8976-4a8c-b7b8-8d660c69accd-kube-api-access-rhnbn\") pod \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\" (UID: \"9f698cb3-8976-4a8c-b7b8-8d660c69accd\") " Aug 02 11:37:30.171200 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.171178 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f698cb3-8976-4a8c-b7b8-8d660c69accd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f698cb3-8976-4a8c-b7b8-8d660c69accd" (UID: "9f698cb3-8976-4a8c-b7b8-8d660c69accd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 02 11:37:30.172957 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.172929 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f698cb3-8976-4a8c-b7b8-8d660c69accd-kube-api-access-rhnbn" (OuterVolumeSpecName: "kube-api-access-rhnbn") pod "9f698cb3-8976-4a8c-b7b8-8d660c69accd" (UID: "9f698cb3-8976-4a8c-b7b8-8d660c69accd"). InnerVolumeSpecName "kube-api-access-rhnbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 02 11:37:30.272093 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.272069 2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f698cb3-8976-4a8c-b7b8-8d660c69accd-plugins-config-volume\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:30.272093 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.272090 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhnbn\" (UniqueName: \"kubernetes.io/projected/9f698cb3-8976-4a8c-b7b8-8d660c69accd-kube-api-access-rhnbn\") on node \"ip-10-0-141-208.ec2.internal\" DevicePath \"\"" Aug 02 11:37:30.501820 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.501785 2554 generic.go:356] "Generic (PLEG): container finished" podID="9f698cb3-8976-4a8c-b7b8-8d660c69accd" containerID="bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3" exitCode=0 Aug 02 11:37:30.501932 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.501835 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" Aug 02 11:37:30.501932 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.501873 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" event={"ID":"9f698cb3-8976-4a8c-b7b8-8d660c69accd","Type":"ContainerDied","Data":"bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3"} Aug 02 11:37:30.501932 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.501926 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4" event={"ID":"9f698cb3-8976-4a8c-b7b8-8d660c69accd","Type":"ContainerDied","Data":"1c44c5649d450bcc8ac6f6ed52ed285b8f26f87a7c96b24944f33161ef7f13f6"} Aug 02 11:37:30.502064 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.501950 2554 scope.go:117] "RemoveContainer" containerID="bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3" Aug 02 11:37:30.510397 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.510382 2554 scope.go:117] "RemoveContainer" containerID="bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3" Aug 02 11:37:30.510665 ip-10-0-141-208 kubenswrapper[2554]: E0802 11:37:30.510644 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3\": container with ID starting with bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3 not found: ID does not exist" containerID="bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3" Aug 02 11:37:30.510711 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.510674 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3"} err="failed to get container status \"bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3\": rpc error: code = NotFound desc = could not find container \"bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3\": container with ID starting with bedf3b200d575e0a752d9f409d493ef84611fd83a45f3971fe961ddb30dfaab3 not found: ID does not exist" Aug 02 11:37:30.522156 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.522109 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4"] Aug 02 11:37:30.526180 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.526160 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4f1bb7-767c997db4-mwjb4"] Aug 02 11:37:30.668047 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:30.668026 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f698cb3-8976-4a8c-b7b8-8d660c69accd" path="/var/lib/kubelet/pods/9f698cb3-8976-4a8c-b7b8-8d660c69accd/volumes" Aug 02 11:37:31.440495 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:31.440465 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-7mphf"] Aug 02 11:37:42.600326 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:42.600249 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xsz7s_6c4db938-1995-446f-a2b1-2d0b7eb07ebe/server/0.log" Aug 02 11:37:42.931237 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:42.931152 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-mdflg_801a4879-c943-4c0c-a9f1-cea2f0a3908b/copy-manifests/0.log" Aug 02 11:37:42.944660 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:42.944628 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-mdflg_801a4879-c943-4c0c-a9f1-cea2f0a3908b/manager/0.log" Aug 02 11:37:44.776852 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:44.776818 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-7mphf_eba8ffef-9f1c-490d-8dc2-059f50c428fa/limitador/0.log" Aug 02 11:37:45.339009 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:45.338981 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l68v2_281a51cb-41f6-4c3b-92f7-f483232576dc/discovery/0.log" Aug 02 11:37:46.337438 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:46.337404 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rtnzs_59d39082-dd47-4e2b-945f-b014ec3be17c/main/0.log" Aug 02 11:37:46.550085 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:46.550059 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-z5b89_b7732b2b-6db6-4dfa-88a1-e9e1266a0b2d/main/0.log" Aug 02 11:37:54.657158 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:54.657112 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9zzhv_e19d4e47-67bb-4e6f-a97c-9177040e3552/global-pull-secret-syncer/0.log" Aug 02 11:37:54.870680 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:54.870651 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ctnjw_36093ce8-c36e-46b8-8cf0-42c27e9b7066/konnectivity-agent/0.log" Aug 02 11:37:54.937771 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:37:54.937708 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-208.ec2.internal_8d404b1b7bc2e059ff3b97eda506ec18/haproxy/0.log" Aug 02 11:38:00.442275 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:00.442236 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-7mphf_eba8ffef-9f1c-490d-8dc2-059f50c428fa/limitador/0.log" Aug 02 11:38:02.004983 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.004957 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/alertmanager/0.log" Aug 02 11:38:02.044044 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.044023 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/config-reloader/0.log" Aug 02 11:38:02.067566 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.067548 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/kube-rbac-proxy-web/0.log" Aug 02 11:38:02.088740 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.088713 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/kube-rbac-proxy/0.log" Aug 02 11:38:02.109335 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.109315 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/kube-rbac-proxy-metric/0.log" Aug 02 11:38:02.128377 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.128360 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/prom-label-proxy/0.log" Aug 02 11:38:02.153182 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.153163 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b23b4a80-af6a-4b98-9532-0fa5adc89ba2/init-config-reloader/0.log" Aug 02 11:38:02.234270 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.234218 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-wxsfw_a3a6aad5-4498-4317-8575-41ac13aa7ffc/kube-state-metrics/0.log" Aug 02 11:38:02.251931 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.251912 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-wxsfw_a3a6aad5-4498-4317-8575-41ac13aa7ffc/kube-rbac-proxy-main/0.log" Aug 02 11:38:02.273113 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.273092 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-wxsfw_a3a6aad5-4498-4317-8575-41ac13aa7ffc/kube-rbac-proxy-self/0.log" Aug 02 11:38:02.306540 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.306523 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d48f86fdf-wc62b_276fe4c4-b411-4735-bd80-ca4a321b6639/metrics-server/0.log" Aug 02 11:38:02.489059 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.489008 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pbv8c_2819adc9-ec1f-419c-b9c4-8ced7b332449/node-exporter/0.log" Aug 02 11:38:02.508914 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.508899 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pbv8c_2819adc9-ec1f-419c-b9c4-8ced7b332449/kube-rbac-proxy/0.log" Aug 02 11:38:02.526765 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.526748 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pbv8c_2819adc9-ec1f-419c-b9c4-8ced7b332449/init-textfile/0.log" Aug 02 11:38:02.632625 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.632604 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mvmpg_aff29baa-8bcd-4d42-ab92-b6c9ec213feb/kube-rbac-proxy-main/0.log" Aug 02 11:38:02.655196 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.655178 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mvmpg_aff29baa-8bcd-4d42-ab92-b6c9ec213feb/kube-rbac-proxy-self/0.log" Aug 02 11:38:02.675057 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.675040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mvmpg_aff29baa-8bcd-4d42-ab92-b6c9ec213feb/openshift-state-metrics/0.log" Aug 02 11:38:02.708008 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.707989 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/prometheus/0.log" Aug 02 11:38:02.727445 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.727431 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/config-reloader/0.log" Aug 02 11:38:02.746991 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.746941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/thanos-sidecar/0.log" Aug 02 11:38:02.768660 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.768642 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/kube-rbac-proxy-web/0.log" Aug 02 11:38:02.790046 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.790029 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/kube-rbac-proxy/0.log" Aug 02 11:38:02.809928 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.809910 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/kube-rbac-proxy-thanos/0.log" Aug 02 11:38:02.828469 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.828451 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d7decf5-2658-4795-a039-c193c98e737c/init-config-reloader/0.log" Aug 02 11:38:02.912998 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:02.912977 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-lpm5d_8312cf70-c4c4-4e0f-a72f-36337c574ff1/prometheus-operator-admission-webhook/0.log" Aug 02 11:38:05.179836 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.179799 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2"] Aug 02 11:38:05.180259 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180239 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9608f178-d0cb-4260-ab4e-a61aca50c673" containerName="payload-pre-processing" Aug 02 11:38:05.180316 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180269 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9608f178-d0cb-4260-ab4e-a61aca50c673" containerName="payload-pre-processing" Aug 02 11:38:05.180316 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180287 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" containerName="payload-pre-processing" Aug 02 11:38:05.180316 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180297 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180317 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9942dbac-1615-45d4-b2a9-7236990c51c8" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180328 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9942dbac-1615-45d4-b2a9-7236990c51c8" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180341 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f698cb3-8976-4a8c-b7b8-8d660c69accd" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180347 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f698cb3-8976-4a8c-b7b8-8d660c69accd" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180359 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c36e454f-a6b2-46ba-9e09-2bea467ff172" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180366 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c36e454f-a6b2-46ba-9e09-2bea467ff172" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180373 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180379 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180385 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180390 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" containerName="payload-pre-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180403 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f0a952-9a2d-4155-8645-6539f3b12117" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180412 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f0a952-9a2d-4155-8645-6539f3b12117" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180430 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e60b21-b0ab-4faf-9e34-866e892b81ef" containerName="payload-processing" Aug 02 11:38:05.180475 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180436 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e60b21-b0ab-4faf-9e34-866e892b81ef" containerName="payload-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180506 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c36e454f-a6b2-46ba-9e09-2bea467ff172" containerName="payload-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180515 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9608f178-d0cb-4260-ab4e-a61aca50c673" containerName="payload-pre-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180522 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2d6ac2-af7f-484f-a9ca-7f39b4dbf2a5" containerName="payload-pre-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180528 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f698cb3-8976-4a8c-b7b8-8d660c69accd" containerName="payload-pre-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180534 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2c24dc1-6e27-4c1e-a1e9-addce0298fd7" containerName="payload-pre-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180542 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9f7f23-2fe6-4dbe-b7cc-9f57c4f6ce55" containerName="payload-pre-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180547 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f0a952-9a2d-4155-8645-6539f3b12117" containerName="payload-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180554 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9942dbac-1615-45d4-b2a9-7236990c51c8" containerName="payload-processing" Aug 02 11:38:05.180875 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.180559 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="44e60b21-b0ab-4faf-9e34-866e892b81ef" containerName="payload-processing" Aug 02 11:38:05.183812 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.183795 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.186375 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.186351 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9p2g8\"/\"default-dockercfg-jktht\"" Aug 02 11:38:05.187614 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.187592 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9p2g8\"/\"openshift-service-ca.crt\"" Aug 02 11:38:05.187785 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.187630 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9p2g8\"/\"kube-root-ca.crt\"" Aug 02 11:38:05.191698 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.191679 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2"] Aug 02 11:38:05.241432 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.241409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-lib-modules\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.241527 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.241437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-podres\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.241527 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.241471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-proc\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.241527 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.241504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-sys\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.241631 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.241556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5d2\" (UniqueName: \"kubernetes.io/projected/49814b3c-e86e-4f61-b3f0-897c5fe803d7-kube-api-access-5s5d2\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342271 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-lib-modules\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342363 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-podres\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342363 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-proc\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342453 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-proc\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342453 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-sys\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342541 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342452 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-sys\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342541 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342421 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-podres\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342541 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342421 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49814b3c-e86e-4f61-b3f0-897c5fe803d7-lib-modules\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.342541 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.342496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5d2\" (UniqueName: \"kubernetes.io/projected/49814b3c-e86e-4f61-b3f0-897c5fe803d7-kube-api-access-5s5d2\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.359159 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.359102 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5d2\" (UniqueName: \"kubernetes.io/projected/49814b3c-e86e-4f61-b3f0-897c5fe803d7-kube-api-access-5s5d2\") pod \"perf-node-gather-daemonset-qlwj2\" (UID: \"49814b3c-e86e-4f61-b3f0-897c5fe803d7\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.495978 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.495953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:05.626586 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.626479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2"] Aug 02 11:38:05.629191 ip-10-0-141-208 kubenswrapper[2554]: W0802 11:38:05.629145 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49814b3c_e86e_4f61_b3f0_897c5fe803d7.slice/crio-99cf2345e309e93afaecb21dc55921f8276cf69b291397c0dd1e51f13d58b0b3 WatchSource:0}: Error finding container 99cf2345e309e93afaecb21dc55921f8276cf69b291397c0dd1e51f13d58b0b3: Status 404 returned error can't find the container with id 99cf2345e309e93afaecb21dc55921f8276cf69b291397c0dd1e51f13d58b0b3 Aug 02 11:38:05.678811 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:05.678741 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" event={"ID":"49814b3c-e86e-4f61-b3f0-897c5fe803d7","Type":"ContainerStarted","Data":"99cf2345e309e93afaecb21dc55921f8276cf69b291397c0dd1e51f13d58b0b3"} Aug 02 11:38:06.684485 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:06.684449 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" event={"ID":"49814b3c-e86e-4f61-b3f0-897c5fe803d7","Type":"ContainerStarted","Data":"8bf51055ffcafcf94c3d66bcca5b91c1255919ac3d1cd7a896c9c74902cea892"} Aug 02 11:38:06.684862 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:06.684547 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:06.701222 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:06.701183 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" podStartSLOduration=1.701169917 podStartE2EDuration="1.701169917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 11:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:38:06.700341107 +0000 UTC m=+3894.482696085" watchObservedRunningTime="2026-08-02 11:38:06.701169917 +0000 UTC m=+3894.483524880" Aug 02 11:38:07.620283 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:07.620254 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wggsn_d559cd67-31aa-4392-8ec0-1fcd701b4eb2/dns/0.log" Aug 02 11:38:07.638313 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:07.638270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wggsn_d559cd67-31aa-4392-8ec0-1fcd701b4eb2/kube-rbac-proxy/0.log" Aug 02 11:38:07.704383 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:07.704359 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mnx6v_4402ce57-5dd1-4e02-b524-79b116c2f040/dns-node-resolver/0.log" Aug 02 11:38:08.364318 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:08.364288 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5v79_ca39a0ce-4030-4d12-b7d9-99f45bffa241/node-ca/0.log" Aug 02 11:38:09.470238 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:09.470210 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l68v2_281a51cb-41f6-4c3b-92f7-f483232576dc/discovery/0.log" Aug 02 11:38:10.494421 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:10.494391 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9grhz_0cf01d8c-c1c3-46ce-8bca-cdbd039e0c3c/serve-healthcheck-canary/0.log" Aug 02 11:38:10.985697 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:10.985669 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rtp4t_e297a6b6-91b5-482d-a721-666326b0876e/insights-operator/0.log" Aug 02 11:38:10.986404 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:10.986386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-rtp4t_e297a6b6-91b5-482d-a721-666326b0876e/insights-operator/1.log" Aug 02 11:38:11.077250 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:11.077229 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5r7l9_0bb500e6-e4fb-4f66-aa28-9b868a7f44db/kube-rbac-proxy/0.log" Aug 02 11:38:11.095913 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:11.095896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5r7l9_0bb500e6-e4fb-4f66-aa28-9b868a7f44db/exporter/0.log" Aug 02 11:38:11.115473 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:11.115436 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5r7l9_0bb500e6-e4fb-4f66-aa28-9b868a7f44db/extractor/0.log" Aug 02 11:38:12.698295 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:12.698271 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-qlwj2" Aug 02 11:38:12.930325 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:12.930300 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:38:12.939525 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:12.939505 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bd5dw_2727b693-d5c7-4e0f-9a01-568bab7341ed/ovn-acl-logging/0.log" Aug 02 11:38:13.733646 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:13.733626 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xsz7s_6c4db938-1995-446f-a2b1-2d0b7eb07ebe/server/0.log" Aug 02 11:38:13.947912 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:13.947884 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-mdflg_801a4879-c943-4c0c-a9f1-cea2f0a3908b/manager/0.log" Aug 02 11:38:13.963801 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:13.963777 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-mdflg_801a4879-c943-4c0c-a9f1-cea2f0a3908b/copy-manifests/0.log" Aug 02 11:38:15.427399 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:15.427373 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-669466dd64-fjf42_4437378c-12fa-47e7-8e98-71e8160f77a8/manager/0.log" Aug 02 11:38:15.472038 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:15.472017 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-24hc4_e36f09c8-4f28-41d4-84d0-1dc69b09e387/openshift-lws-operator/0.log" Aug 02 11:38:16.414596 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:16.414534 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l68v2_281a51cb-41f6-4c3b-92f7-f483232576dc/discovery/0.log" Aug 02 11:38:18.122399 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:18.122359 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l68v2_281a51cb-41f6-4c3b-92f7-f483232576dc/discovery/0.log" Aug 02 11:38:21.861653 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:21.861624 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6pdz4_94850f41-6f74-48a9-a8bf-d0f91f1ea63b/kube-multus/0.log" Aug 02 11:38:22.192042 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.191975 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/kube-multus-additional-cni-plugins/0.log" Aug 02 11:38:22.209869 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.209851 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/egress-router-binary-copy/0.log" Aug 02 11:38:22.226868 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.226851 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/cni-plugins/0.log" Aug 02 11:38:22.244317 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.244302 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/bond-cni-plugin/0.log" Aug 02 11:38:22.264667 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.264647 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/routeoverride-cni/0.log" Aug 02 11:38:22.282407 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.282390 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/whereabouts-cni-bincopy/0.log" Aug 02 11:38:22.300241 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.300219 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svb6t_0965e2da-cc3e-491e-b98f-e0dff34143eb/whereabouts-cni/0.log" Aug 02 11:38:22.466356 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.466337 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sg228_118f5d77-248c-4b45-a0cd-1e9648441505/network-metrics-daemon/0.log" Aug 02 11:38:22.484018 ip-10-0-141-208 kubenswrapper[2554]: I0802 11:38:22.483998 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sg228_118f5d77-248c-4b45-a0cd-1e9648441505/kube-rbac-proxy/0.log"